[GH-ISSUE #241] ALwrity AI Hallucination Detector with Exa.ai #161

New issue

Closed

opened 2026-03-02 23:34:05 +03:00 by kerem · 1 comment

kerem commented 2026-03-02 23:34:05 +03:00

Owner

Copy link

Originally created by @AJaySi on GitHub (Sep 7, 2025).
Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/241

Originally assigned to: @AJaySi on GitHub.

https://github.com/AJaySi/ALwrity/pull/240

---

Originally created by @AJaySi on GitHub (Sep 7, 2025). Original GitHub issue: https://github.com/AJaySi/ALwrity/issues/241 Originally assigned to: @AJaySi on GitHub. https://github.com/AJaySi/ALwrity/pull/240 ------------------------------------------------------------

kerem 2026-03-02 23:34:05 +03:00

• closed this issue
• added the
  LLM
  enhancement
  Alwrity web search
  AI writer
  labels

kerem commented 2026-03-02 23:34:06 +03:00

Author

Owner

Copy link

@AJaySi commented on GitHub (Sep 7, 2025):

@DikshaDisciplines

LinkedIn Fact Check Feature - User Guide

Overview

The LinkedIn Fact Check feature is an AI-powered tool that helps you verify the accuracy of factual claims in your LinkedIn posts before publishing. This feature uses advanced artificial intelligence and real-time web search to analyze your content and provide confidence scores for each verifiable claim.

Why Use Fact Check?

• Build Trust: Ensure your content is accurate and credible
• Avoid Misinformation: Catch potential factual errors before they reach your audience
• Professional Credibility: Maintain your professional reputation with verified information
• Source Verification: Get supporting evidence for your claims
• Quality Assurance: Improve the overall quality of your content

How to Use the Fact Check Feature

Step 1: Generate or Write Your LinkedIn Post

1. Navigate to the LinkedIn Writer in your dashboard
2. Generate a new post using AI or write your own content
3. Ensure your post contains factual statements, statistics, or claims

Step 2: Select Text for Fact Checking

1. Highlight the text you want to fact-check by clicking and dragging your mouse over it
2. Minimum length: Select at least 10 characters of text
3. Best practices: Select complete sentences or paragraphs that contain verifiable facts

Examples of good text to fact-check:

• "The AI market is projected to reach $50 billion by 2025"
• "Our company increased sales by 25% last quarter"
• "Studies show that 80% of businesses use AI tools"

Step 3: Access the Fact Check Menu

1. After selecting text, a blue menu will appear above your selection
2. The menu contains a "🔍 Check Facts" button
3. If the menu doesn't appear, try selecting a longer piece of text (at least 10 characters)

Step 4: Start the Fact Check Process

1. Click the "🔍 Check Facts" button
2. A progress modal will appear showing the fact-checking process
3. The system will show you what's happening in real-time:
   • "Extracting verifiable claims..." (20%)
   • "Searching for evidence..." (40%)
   • "Analyzing claims against sources..." (70%)
   • "Generating final assessment..." (90%)
   • "Completing fact-check..." (100%)

Step 5: Review the Results

The fact-check results will appear in a comprehensive modal with the following sections:

Summary Section

• Overall Confidence Score: Percentage indicating the overall reliability of your claims
• Total Claims: Number of verifiable statements found
• Supported Claims: Claims backed by evidence
• Refuted Claims: Claims contradicted by sources
• Insufficient Claims: Claims that need more evidence

Key Insights

• Quick summary of findings with emoji indicators:
  • ✅ Verified claims with supporting evidence
  • ❌ Claims contradicted by sources
  • ⚠️ Claims needing more evidence

Detailed Claims Analysis

Each claim is analyzed individually with:

Claim Header:

• The exact text being verified
• Confidence score (0-100%)
• Assessment status (Supported/Refuted/Insufficient Information)

Analysis Details:

• Reasoning: AI explanation of why the claim was assessed this way
• Supporting Sources: Evidence that backs up the claim
• Refuting Sources: Evidence that contradicts the claim

Source Information:

• Title: Source article or document title
• URL: Direct link to the source
• Relevance Score: How relevant the source is to your claim
• Author: Source author (when available)
• Publication Date: When the source was published
• Relevant Excerpt: Key text from the source that relates to your claim

Understanding the Results

Confidence Scores

• 80-100%: High confidence - claim is well-supported
• 60-79%: Medium confidence - some evidence but may need verification
• 0-59%: Low confidence - insufficient or contradictory evidence

Assessment Types

✅ Supported

• The claim is backed by reliable sources
• Evidence directly supports the statement
• High confidence score (usually 80%+)

❌ Refuted

• Sources contradict the claim
• Evidence shows the statement is incorrect
• Low confidence score (usually below 60%)

⚠️ Insufficient Information

• Not enough evidence to verify or refute
• Sources don't contain relevant information
• May need additional research

Best Practices

What to Fact-Check

• Statistics and numbers: "25% increase", "$50 billion market"
• Specific claims: "Our product is the first to..."
• Historical facts: "Founded in 2020"
• Research findings: "Studies show that..."
• Industry trends: "The market is growing rapidly"

What NOT to Fact-Check

• Opinions: "This is the best product"
• Subjective statements: "Customers love our service"
• Future predictions: "The future looks bright"
• Personal experiences: "I believe that..."

Tips for Better Results

1. Select complete sentences rather than fragments
2. Include context when selecting text
3. Check multiple claims in longer posts
4. Review supporting sources before publishing
5. Update your content based on fact-check results

Interpreting Source Information

Source Quality Indicators

• High Relevance Score (80%+): Source directly relates to your claim
• Recent Publication Date: More current information
• Author Information: Credible sources often have named authors
• Domain Authority: .edu, .gov, and established news sites are generally more reliable

Using Source Excerpts

• Read the relevant excerpts to understand the context
• Check if the source actually supports your claim
• Look for any limitations or caveats mentioned in the source

Troubleshooting

Common Issues

Menu Doesn't Appear

• Solution: Select at least 10 characters of text
• Tip: Try selecting a complete sentence

"No Verifiable Claims Found"

• Cause: Text contains only opinions or subjective statements
• Solution: Select text with factual claims, statistics, or specific information

Low Confidence Scores

• Cause: Insufficient evidence or contradictory sources
• Solution:
  • Verify your information from multiple sources
  • Update your claim to be more accurate
  • Add more context or qualifying language

"Error During Verification"

• Cause: Technical issue or API limitation
• Solution: Try again in a few moments, or select different text

Getting Help

• If you encounter persistent issues, try refreshing the page
• Ensure you have a stable internet connection
• Contact support if problems continue

Privacy and Security

Data Handling

• Your selected text is processed securely
• No personal information is stored
• Fact-check results are not saved permanently
• Sources are accessed through public APIs

Source Links

• All source links open in new tabs
• External websites are not controlled by our platform
• Exercise caution when visiting external sources

Limitations

What Fact Check Cannot Do

• Verify opinions or subjective statements
• Check claims about future events
• Verify personal experiences or anecdotes
• Check claims in languages other than English
• Verify claims about private or confidential information

Accuracy Considerations

• AI analysis is not 100% infallible
• Always use your judgment when interpreting results
• Consider multiple sources for important claims
• Fact-check results are a tool to assist, not replace, your research

Examples

Good Example: Verifiable Claim

Selected Text: "The global AI market is projected to reach $1.8 trillion by 2030"

Result: ✅ Supported (90% confidence)

• Multiple sources confirm this projection
• Recent reports from reputable research firms
• Consistent numbers across different sources

Poor Example: Opinion Statement

Selected Text: "Our AI solution is the most innovative in the market"

Result: ⚠️ Insufficient Information (30% confidence)

• This is a subjective claim that cannot be objectively verified
• No measurable criteria for "most innovative"
• Consider rephrasing with specific, verifiable benefits

Conclusion

The LinkedIn Fact Check feature is a powerful tool for maintaining credibility and accuracy in your professional content. By following these guidelines and best practices, you can ensure your LinkedIn posts are well-researched, trustworthy, and professional.

Remember: Fact-checking is a tool to enhance your content quality, not a replacement for good judgment and professional responsibility. Always use the results as guidance while maintaining your own critical thinking about the information you share.

---

For technical support or questions about this feature, please contact our support team.

<!-- gh-comment-id:3263614911 --> @AJaySi commented on GitHub (Sep 7, 2025): @DikshaDisciplines # LinkedIn Fact Check Feature - User Guide ## Overview The LinkedIn Fact Check feature is an AI-powered tool that helps you verify the accuracy of factual claims in your LinkedIn posts before publishing. This feature uses advanced artificial intelligence and real-time web search to analyze your content and provide confidence scores for each verifiable claim. ## Why Use Fact Check? - **Build Trust**: Ensure your content is accurate and credible - **Avoid Misinformation**: Catch potential factual errors before they reach your audience - **Professional Credibility**: Maintain your professional reputation with verified information - **Source Verification**: Get supporting evidence for your claims - **Quality Assurance**: Improve the overall quality of your content <img width="938" height="518" alt="Image" src="https://github.com/user-attachments/assets/52be3546-4f8c-45f8-a070-7dc3f94c2b94" /> ## How to Use the Fact Check Feature ### Step 1: Generate or Write Your LinkedIn Post 1. Navigate to the LinkedIn Writer in your dashboard 2. Generate a new post using AI or write your own content 3. Ensure your post contains factual statements, statistics, or claims ### Step 2: Select Text for Fact Checking 1. **Highlight the text** you want to fact-check by clicking and dragging your mouse over it 2. **Minimum length**: Select at least 10 characters of text 3. **Best practices**: Select complete sentences or paragraphs that contain verifiable facts **Examples of good text to fact-check:** - "The AI market is projected to reach $50 billion by 2025" - "Our company increased sales by 25% last quarter" - "Studies show that 80% of businesses use AI tools" ### Step 3: Access the Fact Check Menu 1. After selecting text, a **blue menu** will appear above your selection 2. The menu contains a **"🔍 Check Facts"** button 3. If the menu doesn't appear, try selecting a longer piece of text (at least 10 characters) ### Step 4: Start the Fact Check Process 1. Click the **"🔍 Check Facts"** button 2. A progress modal will appear showing the fact-checking process 3. The system will show you what's happening in real-time: - "Extracting verifiable claims..." (20%) - "Searching for evidence..." (40%) - "Analyzing claims against sources..." (70%) - "Generating final assessment..." (90%) - "Completing fact-check..." (100%) ### Step 5: Review the Results <img width="941" height="510" alt="Image" src="https://github.com/user-attachments/assets/04032265-213b-4673-ab38-c7f1cf54e609" /> The fact-check results will appear in a comprehensive modal with the following sections: #### Summary Section - **Overall Confidence Score**: Percentage indicating the overall reliability of your claims - **Total Claims**: Number of verifiable statements found - **Supported Claims**: Claims backed by evidence - **Refuted Claims**: Claims contradicted by sources - **Insufficient Claims**: Claims that need more evidence #### Key Insights - Quick summary of findings with emoji indicators: - ✅ Verified claims with supporting evidence - ❌ Claims contradicted by sources - ⚠️ Claims needing more evidence #### Detailed Claims Analysis Each claim is analyzed individually with: **Claim Header:** - The exact text being verified - Confidence score (0-100%) - Assessment status (Supported/Refuted/Insufficient Information) **Analysis Details:** - **Reasoning**: AI explanation of why the claim was assessed this way - **Supporting Sources**: Evidence that backs up the claim - **Refuting Sources**: Evidence that contradicts the claim **Source Information:** - **Title**: Source article or document title - **URL**: Direct link to the source - **Relevance Score**: How relevant the source is to your claim - **Author**: Source author (when available) - **Publication Date**: When the source was published - **Relevant Excerpt**: Key text from the source that relates to your claim ## Understanding the Results ### Confidence Scores - **80-100%**: High confidence - claim is well-supported - **60-79%**: Medium confidence - some evidence but may need verification - **0-59%**: Low confidence - insufficient or contradictory evidence ### Assessment Types #### ✅ Supported - The claim is backed by reliable sources - Evidence directly supports the statement - High confidence score (usually 80%+) #### ❌ Refuted - Sources contradict the claim - Evidence shows the statement is incorrect - Low confidence score (usually below 60%) #### ⚠️ Insufficient Information - Not enough evidence to verify or refute - Sources don't contain relevant information - May need additional research ## Best Practices ### What to Fact-Check - **Statistics and numbers**: "25% increase", "$50 billion market" - **Specific claims**: "Our product is the first to..." - **Historical facts**: "Founded in 2020" - **Research findings**: "Studies show that..." - **Industry trends**: "The market is growing rapidly" ### What NOT to Fact-Check - **Opinions**: "This is the best product" - **Subjective statements**: "Customers love our service" - **Future predictions**: "The future looks bright" - **Personal experiences**: "I believe that..." ### Tips for Better Results 1. **Select complete sentences** rather than fragments 2. **Include context** when selecting text 3. **Check multiple claims** in longer posts 4. **Review supporting sources** before publishing 5. **Update your content** based on fact-check results ## Interpreting Source Information ### Source Quality Indicators - **High Relevance Score (80%+)**: Source directly relates to your claim - **Recent Publication Date**: More current information - **Author Information**: Credible sources often have named authors - **Domain Authority**: .edu, .gov, and established news sites are generally more reliable ### Using Source Excerpts - Read the relevant excerpts to understand the context - Check if the source actually supports your claim - Look for any limitations or caveats mentioned in the source ## Troubleshooting ### Common Issues #### Menu Doesn't Appear - **Solution**: Select at least 10 characters of text - **Tip**: Try selecting a complete sentence #### "No Verifiable Claims Found" - **Cause**: Text contains only opinions or subjective statements - **Solution**: Select text with factual claims, statistics, or specific information #### Low Confidence Scores - **Cause**: Insufficient evidence or contradictory sources - **Solution**: - Verify your information from multiple sources - Update your claim to be more accurate - Add more context or qualifying language #### "Error During Verification" - **Cause**: Technical issue or API limitation - **Solution**: Try again in a few moments, or select different text ### Getting Help - If you encounter persistent issues, try refreshing the page - Ensure you have a stable internet connection - Contact support if problems continue ## Privacy and Security ### Data Handling - Your selected text is processed securely - No personal information is stored - Fact-check results are not saved permanently - Sources are accessed through public APIs ### Source Links - All source links open in new tabs - External websites are not controlled by our platform - Exercise caution when visiting external sources ## Limitations ### What Fact Check Cannot Do - Verify opinions or subjective statements - Check claims about future events - Verify personal experiences or anecdotes - Check claims in languages other than English - Verify claims about private or confidential information ### Accuracy Considerations - AI analysis is not 100% infallible - Always use your judgment when interpreting results - Consider multiple sources for important claims - Fact-check results are a tool to assist, not replace, your research ## Examples ### Good Example: Verifiable Claim **Selected Text**: "The global AI market is projected to reach $1.8 trillion by 2030" **Result**: ✅ Supported (90% confidence) - Multiple sources confirm this projection - Recent reports from reputable research firms - Consistent numbers across different sources ### Poor Example: Opinion Statement **Selected Text**: "Our AI solution is the most innovative in the market" **Result**: ⚠️ Insufficient Information (30% confidence) - This is a subjective claim that cannot be objectively verified - No measurable criteria for "most innovative" - Consider rephrasing with specific, verifiable benefits ## Conclusion The LinkedIn Fact Check feature is a powerful tool for maintaining credibility and accuracy in your professional content. By following these guidelines and best practices, you can ensure your LinkedIn posts are well-researched, trustworthy, and professional. Remember: Fact-checking is a tool to enhance your content quality, not a replacement for good judgment and professional responsibility. Always use the results as guidance while maintaining your own critical thinking about the information you share. --- *For technical support or questions about this feature, please contact our support team.*

kerem referenced this issue 2026-03-13 20:29:17 +03:00

[GH-ISSUE #161] AI Blog Writer Error: [Errno 22] Invalid argument #455

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

main

codex/task-title-3y5pbt

codex/task-title-lsrpho

codex/task-title

codex/locate-and-render-brollinfopanel-component

codex/import-scene-composition-symbols-in-broll_service

codex/refactor-preview-generation-flow

codex/standardize-chart-preview-route-usage

codex/import-b-roll-handler-and-update-router

codex/implement-podcast-research-response-updates

codex/add-cost-estimation-feature-to-podcastdashboard

codex/remove-heuristic-calculators-and-update-estimates-bhvhnh

codex/remove-heuristic-calculators-and-update-estimates

codex/implement-dedicated-podcastcostest-model

codex/add-podcast-maker-feature-documentation

codex/review-flat-file-context-system-implementation

codex/create-podcast-maker-best-practices-documentation

codex/add-podcast-maker-journey-pages-for-personas

codex/refactor-podcast-maker-documentation-structure

dependabot/npm_and_yarn/frontend/npm_and_yarn-7d3393088f

codex/log-skipped-and-loaded-items

codex/create-startup-phases-for-podcast-demo-tugrzv

codex/create-startup-phases-for-podcast-demo

codex/add-api-feature-profile-status-endpoint

codex/refactor-routermanager-to-use-registry

codex/add-new-modules-for-feature-management

codex/downgrade-api-key-warning-logging

codex/refactor-onboarding-loading-logic

codex/add-ci-lint-check-for-user_id-patterns

codex/remove-sessionlocal-import-and-add-health-check

codex/refactor-dubbed_audio_dir-to-tenant-path-resolver

codex/update-task-metadata-and-api-responses

codex/verify-podcast-analysis-and-cost-tracking

codex/assert-api-endpoints-on-startup

codex/add-env-controlled-guard-for-stripe-key

codex/remove-feature-flag-for-production-demo

codex/add-mode-aware-redirect-logic-in-pricingpage

codex/document-deployment-configuration-for-demo-mode

codex/ensure-api.subscription.router-always-included

codex/guard-onboarding-manager-and-endpoints

codex/wrap-router-inclusion-in-demo-mode-check

codex/add-podcast-only-demo-mode-toggle

dependabot/npm_and_yarn/frontend/npm_and_yarn-f5ea90b336

codex/update-reset_current_billing_period-logic

codex/update-error-handling-in-monitoring-middleware

codex/move-stripe_plan_price_mapping-to-env-driven-config

codex/refactor-billingservice-to-use-authenticated-user

codex/update-user-access-verification-for-routes

session/agent_eae6711f-e04b-4d48-8d66-43ee051feb7b

v0.5.0

v0.3

v0.2

v0.1

Labels

Clear labels   

AI Content Agents

  

AI Content Strategy

  

AI Content planning

  

AI Marketing Tools

  

AI SEO

  

AI personalization

  

AI writer

  

ALwrity Copi-lot

  

Alwrity web search

  

Anthropic

  

DeepSeek

  

Gemini AI

  

Integration

  

LLM

  

OnBoarding

  

OnBoarding

  

RAG knowledgebase Memory

  

bug

  

documentation

  

enhancement

  

good first issue

  

help wanted

  

invalid

  

openai

  

pull-request

Mirrored from GitHub Pull Request

No labels

AI Content Agents

AI Content Strategy

AI Content planning

AI Marketing Tools

AI SEO

AI personalization

AI writer

ALwrity Copi-lot

Alwrity web search

Anthropic

DeepSeek

Gemini AI

Integration

LLM

OnBoarding

OnBoarding

RAG knowledgebase Memory

bug

documentation

enhancement

good first issue

help wanted

invalid

openai

pull-request

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/ALwrity#161

No description provided.