starred/ALwrity
1
0
Fork 0
mirror of https://github.com/AJaySi/ALwrity.git synced 2026-04-25 08:55:58 +03:00
Code Issues 82 Projects Releases 4 Packages Wiki Activity

[GH-ISSUE #241] ALwrity AI Hallucination Detector with Exa.ai #499

New issue
Closed
opened 2026-03-13 20:38:28 +03:00 by kerem · 1 comment
kerem commented 2026-03-13 20:38:28 +03:00
Owner
Copy link

Originally created by @AJaySi on GitHub (Sep 7, 2025).
Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/241

Originally assigned to: @AJaySi on GitHub.

https://github.com/AJaySi/ALwrity/pull/240

Originally created by @AJaySi on GitHub (Sep 7, 2025). Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/241 Originally assigned to: @AJaySi on GitHub. https://github.com/AJaySi/ALwrity/pull/240 ------------------------------------------------------------
kerem commented 2026-03-13 20:38:44 +03:00
Author
Owner
Copy link

@AJaySi commented on GitHub (Sep 7, 2025):

@DikshaDisciplines

LinkedIn Fact Check Feature - User Guide

Overview

The LinkedIn Fact Check feature is an AI-powered tool that helps you verify the accuracy of factual claims in your LinkedIn posts before publishing. This feature uses advanced artificial intelligence and real-time web search to analyze your content and provide confidence scores for each verifiable claim.

Why Use Fact Check?

  • Build Trust: Ensure your content is accurate and credible
  • Avoid Misinformation: Catch potential factual errors before they reach your audience
  • Professional Credibility: Maintain your professional reputation with verified information
  • Source Verification: Get supporting evidence for your claims
  • Quality Assurance: Improve the overall quality of your content
Image

How to Use the Fact Check Feature

Step 1: Generate or Write Your LinkedIn Post

  1. Navigate to the LinkedIn Writer in your dashboard
  2. Generate a new post using AI or write your own content
  3. Ensure your post contains factual statements, statistics, or claims

Step 2: Select Text for Fact Checking

  1. Highlight the text you want to fact-check by clicking and dragging your mouse over it
  2. Minimum length: Select at least 10 characters of text
  3. Best practices: Select complete sentences or paragraphs that contain verifiable facts

Examples of good text to fact-check:

  • "The AI market is projected to reach $50 billion by 2025"
  • "Our company increased sales by 25% last quarter"
  • "Studies show that 80% of businesses use AI tools"

Step 3: Access the Fact Check Menu

  1. After selecting text, a blue menu will appear above your selection
  2. The menu contains a "🔍 Check Facts" button
  3. If the menu doesn't appear, try selecting a longer piece of text (at least 10 characters)

Step 4: Start the Fact Check Process

  1. Click the "🔍 Check Facts" button
  2. A progress modal will appear showing the fact-checking process
  3. The system will show you what's happening in real-time:
    • "Extracting verifiable claims..." (20%)
    • "Searching for evidence..." (40%)
    • "Analyzing claims against sources..." (70%)
    • "Generating final assessment..." (90%)
    • "Completing fact-check..." (100%)

Step 5: Review the Results

Image

The fact-check results will appear in a comprehensive modal with the following sections:

Summary Section

  • Overall Confidence Score: Percentage indicating the overall reliability of your claims
  • Total Claims: Number of verifiable statements found
  • Supported Claims: Claims backed by evidence
  • Refuted Claims: Claims contradicted by sources
  • Insufficient Claims: Claims that need more evidence

Key Insights

  • Quick summary of findings with emoji indicators:
    • ✅ Verified claims with supporting evidence
    • ❌ Claims contradicted by sources
    • ⚠️ Claims needing more evidence

Detailed Claims Analysis

Each claim is analyzed individually with:

Claim Header:

  • The exact text being verified
  • Confidence score (0-100%)
  • Assessment status (Supported/Refuted/Insufficient Information)

Analysis Details:

  • Reasoning: AI explanation of why the claim was assessed this way
  • Supporting Sources: Evidence that backs up the claim
  • Refuting Sources: Evidence that contradicts the claim

Source Information:

  • Title: Source article or document title
  • URL: Direct link to the source
  • Relevance Score: How relevant the source is to your claim
  • Author: Source author (when available)
  • Publication Date: When the source was published
  • Relevant Excerpt: Key text from the source that relates to your claim

Understanding the Results

Confidence Scores

  • 80-100%: High confidence - claim is well-supported
  • 60-79%: Medium confidence - some evidence but may need verification
  • 0-59%: Low confidence - insufficient or contradictory evidence

Assessment Types

✅ Supported

  • The claim is backed by reliable sources
  • Evidence directly supports the statement
  • High confidence score (usually 80%+)

❌ Refuted

  • Sources contradict the claim
  • Evidence shows the statement is incorrect
  • Low confidence score (usually below 60%)

⚠️ Insufficient Information

  • Not enough evidence to verify or refute
  • Sources don't contain relevant information
  • May need additional research

Best Practices

What to Fact-Check

  • Statistics and numbers: "25% increase", "$50 billion market"
  • Specific claims: "Our product is the first to..."
  • Historical facts: "Founded in 2020"
  • Research findings: "Studies show that..."
  • Industry trends: "The market is growing rapidly"

What NOT to Fact-Check

  • Opinions: "This is the best product"
  • Subjective statements: "Customers love our service"
  • Future predictions: "The future looks bright"
  • Personal experiences: "I believe that..."

Tips for Better Results

  1. Select complete sentences rather than fragments
  2. Include context when selecting text
  3. Check multiple claims in longer posts
  4. Review supporting sources before publishing
  5. Update your content based on fact-check results

Interpreting Source Information

Source Quality Indicators

  • High Relevance Score (80%+): Source directly relates to your claim
  • Recent Publication Date: More current information
  • Author Information: Credible sources often have named authors
  • Domain Authority: .edu, .gov, and established news sites are generally more reliable

Using Source Excerpts

  • Read the relevant excerpts to understand the context
  • Check if the source actually supports your claim
  • Look for any limitations or caveats mentioned in the source

Troubleshooting

Common Issues

Menu Doesn't Appear

  • Solution: Select at least 10 characters of text
  • Tip: Try selecting a complete sentence

"No Verifiable Claims Found"

  • Cause: Text contains only opinions or subjective statements
  • Solution: Select text with factual claims, statistics, or specific information

Low Confidence Scores

  • Cause: Insufficient evidence or contradictory sources
  • Solution:
    • Verify your information from multiple sources
    • Update your claim to be more accurate
    • Add more context or qualifying language

"Error During Verification"

  • Cause: Technical issue or API limitation
  • Solution: Try again in a few moments, or select different text

Getting Help

  • If you encounter persistent issues, try refreshing the page
  • Ensure you have a stable internet connection
  • Contact support if problems continue

Privacy and Security

Data Handling

  • Your selected text is processed securely
  • No personal information is stored
  • Fact-check results are not saved permanently
  • Sources are accessed through public APIs

Source Links

  • All source links open in new tabs
  • External websites are not controlled by our platform
  • Exercise caution when visiting external sources

Limitations

What Fact Check Cannot Do

  • Verify opinions or subjective statements
  • Check claims about future events
  • Verify personal experiences or anecdotes
  • Check claims in languages other than English
  • Verify claims about private or confidential information

Accuracy Considerations

  • AI analysis is not 100% infallible
  • Always use your judgment when interpreting results
  • Consider multiple sources for important claims
  • Fact-check results are a tool to assist, not replace, your research

Examples

Good Example: Verifiable Claim

Selected Text: "The global AI market is projected to reach $1.8 trillion by 2030"

Result: ✅ Supported (90% confidence)

  • Multiple sources confirm this projection
  • Recent reports from reputable research firms
  • Consistent numbers across different sources

Poor Example: Opinion Statement

Selected Text: "Our AI solution is the most innovative in the market"

Result: ⚠️ Insufficient Information (30% confidence)

  • This is a subjective claim that cannot be objectively verified
  • No measurable criteria for "most innovative"
  • Consider rephrasing with specific, verifiable benefits

Conclusion

The LinkedIn Fact Check feature is a powerful tool for maintaining credibility and accuracy in your professional content. By following these guidelines and best practices, you can ensure your LinkedIn posts are well-researched, trustworthy, and professional.

Remember: Fact-checking is a tool to enhance your content quality, not a replacement for good judgment and professional responsibility. Always use the results as guidance while maintaining your own critical thinking about the information you share.

For technical support or questions about this feature, please contact our support team.

<!-- gh-comment-id:3263614911 --> @AJaySi commented on GitHub (Sep 7, 2025): @DikshaDisciplines # LinkedIn Fact Check Feature - User Guide ## Overview The LinkedIn Fact Check feature is an AI-powered tool that helps you verify the accuracy of factual claims in your LinkedIn posts before publishing. This feature uses advanced artificial intelligence and real-time web search to analyze your content and provide confidence scores for each verifiable claim. ## Why Use Fact Check? - **Build Trust**: Ensure your content is accurate and credible - **Avoid Misinformation**: Catch potential factual errors before they reach your audience - **Professional Credibility**: Maintain your professional reputation with verified information - **Source Verification**: Get supporting evidence for your claims - **Quality Assurance**: Improve the overall quality of your content <img width="938" height="518" alt="Image" src="https://github.com/user-attachments/assets/52be3546-4f8c-45f8-a070-7dc3f94c2b94" /> ## How to Use the Fact Check Feature ### Step 1: Generate or Write Your LinkedIn Post 1. Navigate to the LinkedIn Writer in your dashboard 2. Generate a new post using AI or write your own content 3. Ensure your post contains factual statements, statistics, or claims ### Step 2: Select Text for Fact Checking 1. **Highlight the text** you want to fact-check by clicking and dragging your mouse over it 2. **Minimum length**: Select at least 10 characters of text 3. **Best practices**: Select complete sentences or paragraphs that contain verifiable facts **Examples of good text to fact-check:** - "The AI market is projected to reach $50 billion by 2025" - "Our company increased sales by 25% last quarter" - "Studies show that 80% of businesses use AI tools" ### Step 3: Access the Fact Check Menu 1. After selecting text, a **blue menu** will appear above your selection 2. The menu contains a **"🔍 Check Facts"** button 3. If the menu doesn't appear, try selecting a longer piece of text (at least 10 characters) ### Step 4: Start the Fact Check Process 1. Click the **"🔍 Check Facts"** button 2. A progress modal will appear showing the fact-checking process 3. The system will show you what's happening in real-time: - "Extracting verifiable claims..." (20%) - "Searching for evidence..." (40%) - "Analyzing claims against sources..." (70%) - "Generating final assessment..." (90%) - "Completing fact-check..." (100%) ### Step 5: Review the Results <img width="941" height="510" alt="Image" src="https://github.com/user-attachments/assets/04032265-213b-4673-ab38-c7f1cf54e609" /> The fact-check results will appear in a comprehensive modal with the following sections: #### Summary Section - **Overall Confidence Score**: Percentage indicating the overall reliability of your claims - **Total Claims**: Number of verifiable statements found - **Supported Claims**: Claims backed by evidence - **Refuted Claims**: Claims contradicted by sources - **Insufficient Claims**: Claims that need more evidence #### Key Insights - Quick summary of findings with emoji indicators: - ✅ Verified claims with supporting evidence - ❌ Claims contradicted by sources - ⚠️ Claims needing more evidence #### Detailed Claims Analysis Each claim is analyzed individually with: **Claim Header:** - The exact text being verified - Confidence score (0-100%) - Assessment status (Supported/Refuted/Insufficient Information) **Analysis Details:** - **Reasoning**: AI explanation of why the claim was assessed this way - **Supporting Sources**: Evidence that backs up the claim - **Refuting Sources**: Evidence that contradicts the claim **Source Information:** - **Title**: Source article or document title - **URL**: Direct link to the source - **Relevance Score**: How relevant the source is to your claim - **Author**: Source author (when available) - **Publication Date**: When the source was published - **Relevant Excerpt**: Key text from the source that relates to your claim ## Understanding the Results ### Confidence Scores - **80-100%**: High confidence - claim is well-supported - **60-79%**: Medium confidence - some evidence but may need verification - **0-59%**: Low confidence - insufficient or contradictory evidence ### Assessment Types #### ✅ Supported - The claim is backed by reliable sources - Evidence directly supports the statement - High confidence score (usually 80%+) #### ❌ Refuted - Sources contradict the claim - Evidence shows the statement is incorrect - Low confidence score (usually below 60%) #### ⚠️ Insufficient Information - Not enough evidence to verify or refute - Sources don't contain relevant information - May need additional research ## Best Practices ### What to Fact-Check - **Statistics and numbers**: "25% increase", "$50 billion market" - **Specific claims**: "Our product is the first to..." - **Historical facts**: "Founded in 2020" - **Research findings**: "Studies show that..." - **Industry trends**: "The market is growing rapidly" ### What NOT to Fact-Check - **Opinions**: "This is the best product" - **Subjective statements**: "Customers love our service" - **Future predictions**: "The future looks bright" - **Personal experiences**: "I believe that..." ### Tips for Better Results 1. **Select complete sentences** rather than fragments 2. **Include context** when selecting text 3. **Check multiple claims** in longer posts 4. **Review supporting sources** before publishing 5. **Update your content** based on fact-check results ## Interpreting Source Information ### Source Quality Indicators - **High Relevance Score (80%+)**: Source directly relates to your claim - **Recent Publication Date**: More current information - **Author Information**: Credible sources often have named authors - **Domain Authority**: .edu, .gov, and established news sites are generally more reliable ### Using Source Excerpts - Read the relevant excerpts to understand the context - Check if the source actually supports your claim - Look for any limitations or caveats mentioned in the source ## Troubleshooting ### Common Issues #### Menu Doesn't Appear - **Solution**: Select at least 10 characters of text - **Tip**: Try selecting a complete sentence #### "No Verifiable Claims Found" - **Cause**: Text contains only opinions or subjective statements - **Solution**: Select text with factual claims, statistics, or specific information #### Low Confidence Scores - **Cause**: Insufficient evidence or contradictory sources - **Solution**: - Verify your information from multiple sources - Update your claim to be more accurate - Add more context or qualifying language #### "Error During Verification" - **Cause**: Technical issue or API limitation - **Solution**: Try again in a few moments, or select different text ### Getting Help - If you encounter persistent issues, try refreshing the page - Ensure you have a stable internet connection - Contact support if problems continue ## Privacy and Security ### Data Handling - Your selected text is processed securely - No personal information is stored - Fact-check results are not saved permanently - Sources are accessed through public APIs ### Source Links - All source links open in new tabs - External websites are not controlled by our platform - Exercise caution when visiting external sources ## Limitations ### What Fact Check Cannot Do - Verify opinions or subjective statements - Check claims about future events - Verify personal experiences or anecdotes - Check claims in languages other than English - Verify claims about private or confidential information ### Accuracy Considerations - AI analysis is not 100% infallible - Always use your judgment when interpreting results - Consider multiple sources for important claims - Fact-check results are a tool to assist, not replace, your research ## Examples ### Good Example: Verifiable Claim **Selected Text**: "The global AI market is projected to reach $1.8 trillion by 2030" **Result**: ✅ Supported (90% confidence) - Multiple sources confirm this projection - Recent reports from reputable research firms - Consistent numbers across different sources ### Poor Example: Opinion Statement **Selected Text**: "Our AI solution is the most innovative in the market" **Result**: ⚠️ Insufficient Information (30% confidence) - This is a subjective claim that cannot be objectively verified - No measurable criteria for "most innovative" - Consider rephrasing with specific, verifiable benefits ## Conclusion The LinkedIn Fact Check feature is a powerful tool for maintaining credibility and accuracy in your professional content. By following these guidelines and best practices, you can ensure your LinkedIn posts are well-researched, trustworthy, and professional. Remember: Fact-checking is a tool to enhance your content quality, not a replacement for good judgment and professional responsibility. Always use the results as guidance while maintaining your own critical thinking about the information you share. --- *For technical support or questions about this feature, please contact our support team.*
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
codex/task-title-3y5pbt
codex/task-title-lsrpho
codex/task-title
codex/locate-and-render-brollinfopanel-component
codex/import-scene-composition-symbols-in-broll_service
codex/refactor-preview-generation-flow
codex/standardize-chart-preview-route-usage
codex/import-b-roll-handler-and-update-router
codex/implement-podcast-research-response-updates
codex/add-cost-estimation-feature-to-podcastdashboard
codex/remove-heuristic-calculators-and-update-estimates-bhvhnh
codex/remove-heuristic-calculators-and-update-estimates
codex/implement-dedicated-podcastcostest-model
codex/add-podcast-maker-feature-documentation
codex/review-flat-file-context-system-implementation
codex/create-podcast-maker-best-practices-documentation
codex/add-podcast-maker-journey-pages-for-personas
codex/refactor-podcast-maker-documentation-structure
dependabot/npm_and_yarn/frontend/npm_and_yarn-7d3393088f
codex/log-skipped-and-loaded-items
codex/create-startup-phases-for-podcast-demo-tugrzv
codex/create-startup-phases-for-podcast-demo
codex/add-api-feature-profile-status-endpoint
codex/refactor-routermanager-to-use-registry
codex/add-new-modules-for-feature-management
codex/downgrade-api-key-warning-logging
codex/refactor-onboarding-loading-logic
codex/add-ci-lint-check-for-user_id-patterns
codex/remove-sessionlocal-import-and-add-health-check
codex/refactor-dubbed_audio_dir-to-tenant-path-resolver
codex/update-task-metadata-and-api-responses
codex/verify-podcast-analysis-and-cost-tracking
codex/assert-api-endpoints-on-startup
codex/add-env-controlled-guard-for-stripe-key
codex/remove-feature-flag-for-production-demo
codex/add-mode-aware-redirect-logic-in-pricingpage
codex/document-deployment-configuration-for-demo-mode
codex/ensure-api.subscription.router-always-included
codex/guard-onboarding-manager-and-endpoints
codex/wrap-router-inclusion-in-demo-mode-check
codex/add-podcast-only-demo-mode-toggle
dependabot/npm_and_yarn/frontend/npm_and_yarn-f5ea90b336
codex/update-reset_current_billing_period-logic
codex/update-error-handling-in-monitoring-middleware
codex/move-stripe_plan_price_mapping-to-env-driven-config
codex/refactor-billingservice-to-use-authenticated-user
codex/update-user-access-verification-for-routes
session/agent_eae6711f-e04b-4d48-8d66-43ee051feb7b
v0.5.0
v0.3
v0.2
v0.1
Labels
Clear labels   
AI Content Agents

   
AI Content Strategy

   
AI Content planning

   
AI Marketing Tools

   
AI SEO

   
AI personalization

   
AI writer

   
ALwrity Copi-lot

   
Alwrity web search

   
Anthropic

   
DeepSeek

   
Gemini AI

   
Integration

   
LLM

   
OnBoarding

   
OnBoarding

   
RAG knowledgebase Memory

   
bug

   
documentation

   
enhancement

   
good first issue

   
help wanted

   
invalid

   
openai

   
pull-request

Mirrored from GitHub Pull Request

No labels
AI Content Agents
AI Content Strategy
AI Content planning
AI Marketing Tools
AI SEO
AI personalization
AI writer
ALwrity Copi-lot
Alwrity web search
Anthropic
DeepSeek
Gemini AI
Integration
LLM
OnBoarding
OnBoarding
RAG knowledgebase Memory
bug
documentation
enhancement
good first issue
help wanted
invalid
openai
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/ALwrity#499
No description provided.