business

Verdict

Submitted 6/2/2026, 7:03:08 PM · Completed 6/2/2026, 7:04:10 PM

7.2
go
The idea

Show HN: Scholar Sidekick – citation verifier for the "real DOI, wrong paper"

Show original source text →
One of the harder AI citation failures is quite simple: the identifier is real, but the citation is still fake. The DOI resolves, but to a different paper - not the paper the citation claims it is. Topaz et al. reported their findings on citation hallucination in May in The Lancet. They scanned 2.5 million PubMed Central articles and estimated that 1 in 277 contained a fabricated citation. Some of their examples were this exact pattern: real identifier, fabricated title. I originally built Scholar Sidekick as a formatter for my own use as a clinician-educator preparing talks, articles, etc. After reading the Topaz paper, I added a verifier to catch the most common pattern they found: a real identifier attached to the wrong paper. My tool resolves the identifier, and then compares the title in your reference with the returned metadata (i.e. does this DOI, PMID, or arXiv ID actually point to the right paper?). It does not attempt to judge whether the cited paper actually supports the claim you make in your text. That still needs judgment, preferably human judgment. I ran 350 previously unseen citations through the API once each in a test. It correctly identified all 37 fabricated references, but wrongly flagged 5 of 285 real references: 1.8% (95% CI 0.8–4.0%). (Plain similarity comparison, without the optional LLM screening - I would expect the LLM to rescue some of those borderline cases. A handful of citations returned no result on upstream timeouts and weren't scorable either way.) The test suite, results and failures are public, so you do not have to take my word for it. You can check them yourself. The web version is free and anonymous. The REST API and MCP server use a RapidAPI key, with a free rate-limited tier and paid tiers above that. The MCP server is on npm, Smithery and Glama, and the Obsidian plugin is in the community store. Chrome/Firefox/Edge browser extensions in their stores as well. I'm very open to feedback and look forward to hearing from anyone who tries it - what works? What fails? Thanks in advance.
TRIZ inventive level: 3/5· Principles: parameter changes, preliminary action
Synthesis verdict
**Go**. The idea of Scholar Sidekick, a tool that detects fake citations with real identifiers, has a strong foundation in addressing a specific and growing problem in academic integrity. With a clear and measurable demand, a validated solution, and a multi-channel revenue model, the venture has a promising start. The tool's ability to detect DOI-title mismatches with high accuracy and its public test suite build trust and reduce friction for conversion. However, the venture's dependence on external APIs and a highly specialized use case pose risks to its sustainability.

Strengths

  • Validated solution with high accuracy (100% true positive rate, 1.8% false positive rate in testing)
  • Clear and measurable demand for the tool among academic researchers, clinicians, journal editors, and peer reviewers
  • Multi-channel revenue model with freemium web tool, paid API tiers, and distribution via app stores
  • Public test suite builds trust and reduces friction for conversion
  • Strong differentiation in a distinct and underserved failure mode

Weaknesses

  • Dependence on unstable external APIs (e.g., DOI, PMID, arXiv) poses a significant risk to the venture's sustainability
  • Highly specialized use case may limit the tool's appeal and retention rates beyond the initial curiosity phase
  • Platform risk due to reliance on third-party APIs, which could render the verifier useless in case of outages or changes
  • Churn might increase if users find the tool too specialized or not frequently used
  • Regulation could cripple the service if API access terms change, restricting free or low-cost access

Best angle

Scholar Sidekick should focus on integrating its verifier into broader academic workflows, such as direct plugins for popular citation managers, to increase its utility and appeal to a broader user base.

Panel verdicts

Competition

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning

7.0

A real‑identifier‑to‑wrong‑paper mismatch is a distinct, underserved failure mode that current citation tools do not address, giving the verifier a clear, defensible niche.

The core differentiation - detecting when a real identifier (DOI, PMID, arXiv) resolves to a different paper than the one cited - addresses a concrete, under‑served failure mode highlighted by Topaz et al. Existing citation managers (Zotero, Mendeley, EndNote) and metadata services (Crossref, PubMed, arXiv) verify that an identifier resolves, but they do not compare the resolved title to a user‑provided reference, so they cannot flag fabricated citations. Competitors such as Crossref's similarity check, SciSpace's citation verifier, and the open‑source tool 'CiteSeerX' provide partial overlap but lack the explicit title‑mismatch verification that Topaz identified as the most common hallucination pattern. This focus makes the differentiation both real and relatively durable, as it relies on stable identifier resolution APIs and a clear, narrow problem space. However, the market is niche (clinician‑educators, researchers) and larger platforms could integrate similar checks, threatening long‑term defensibility. The 1.8% false‑positive rate is acceptable for a free, anonymous service, and the public test suite provides transparency, reinforcing credibility. Overall, the idea shows strong differentiation now, but its durability will depend on continued API reliability and the ability to defend against feature‑copying by larger citation tools.

Market

qwen/qwen3-next-80b-a3b-instruct

8.0

Scholar Sidekick addresses a quantifiable, widespread, and rising threat to academic integrity - fake citations with real DOIs - that no other tool currently automates with high precision.

There is a clear, measurable, and growing demand for this tool among academic researchers, clinicians, journal editors, and peer reviewers - groups under increasing pressure to ensure citation integrity amid rising AI-generated hallucinations. The Topaz et al. study (The Lancet, May 2024) quantified the problem: 1 in 277 citations in PubMed Central are fabricated with real DOIs pointing to wrong papers. This isn't theoretical - it's a systemic risk in scholarly communication. Scholar Sidekick solves a specific, high-friction pain point: detecting DOI-title mismatches with 100% recall and only 1.8% false positives in testing. The audience is large: millions of researchers, medical educators, and reviewers who cite literature daily. Many are already using citation managers (Zotero, EndNote) and AI writing tools (ChatGPT, Perplexity) that generate fake citations. They need automated, lightweight verification - not full-text fact-checking, which is too complex. The product's multi-platform availability (browser extensions, Obsidian plugin, REST API, npm) lowers adoption friction. Monetization via RapidAPI tiers is smart: free tier captures users, paid tiers target institutions, publishers, and journals with compliance budgets. The public test suite builds trust. The only barriers are awareness and scaling adoption beyond early adopters. Competitors like Scite or Citethisforme don't focus on this exact failure mode. This isn't a niche tool - it's a necessary layer of scholarly infrastructure. With targeted outreach to medical journals, university libraries, and AI ethics teams, this could become a standard check in submission workflows.

Monetization

mistralai/mistral-medium-3.5-128b

8.0

A validated, high-accuracy tool for a painful niche problem with clear B2B and B2D monetization paths via API and integrations.

The idea addresses a concrete, high-value problem (citation hallucinations) with a validated solution (identifier-title mismatch detection) and demonstrated accuracy (100% true positive rate, 1.8% false positive rate in testing). The revenue model is multi-channel: freemium web tool (lead gen), paid API tiers (B2B/B2D), and distribution via app stores (MCP, Obsidian, browsers) with potential for volume-based pricing. Unit economics are favorable - low cost-to-serve (API calls + metadata lookups) and high margin (SaaS model). The public test suite builds trust, reducing friction for conversion. Upsell paths include LLM-assisted verification (premium tier) and enterprise integrations (e.g., journal workflows). The main risk is market size: citation verification is niche but critical for academia/medicine, where compliance and reputation drive willingness to pay.

Risk

nvidia/llama-3.3-nemotron-super-49b-v1

4.0

Dependence on unstable external APIs and a highly specialized use case threaten sustainability within 6-12 months.

The venture's vulnerability lies in its narrow scope and dependence on external factors. **Regulation** could cripple the service if API access terms for DOI, PMID, or arXiv change, restricting free or low-cost access, thereby increasing operational costs significantly. **Platform Risk** is high due to reliance on third-party APIs; outages or changes (e.g., PubMed Central altering its API) could render the verifier useless. **Churn** might increase if users find the tool too specialized, leading to low retention rates beyond the initial curiosity phase. While the tool excels in a specific task, its utility is highly situational, and without integration into broader academic workflows (e.g., direct plugins for popular citation managers like Zotero, Mendeley, or EndNote with seamless workflow integration), it may struggle to attract a broad, paying user base. The free tier's limitations might not be compelling enough to convert users to paid plans, especially if the primary use case (catching specific citation errors) is not a frequent, high-priority task for most academics.

Viability

nvidia/llama-3.3-nemotron-super-49b-v1(fallback #1)

8.0

Leverages existing APIs with moderate complexity, largely built, needing refinement and scaling.

The idea leverages existing infrastructure (e.g., DOI, PMID, arXiv resolution APIs) and builds upon a proven, personally validated concept (Scholar Sidekick). The technical complexity is moderate due to the integration of various APIs and the development of a verifier logic, which the founder has already partially overcome. The key challenge lies in scaling the API integrations, ensuring robustness against upstream timeouts, and potentially integrating LLMs for improved accuracy. Given the founder's existing work, a 2-person team could realistically enhance and stabilize v1 within 12 weeks, focusing on refining the algorithm, expanding API coverage, and developing the business tier. The main hurdles are not in the build itself but in user adoption and accurately positioning the tool within the academic and publishing ecosystems.

Synthesized by meta/llama-3.3-70b-instruct · 6.5s