business

Verdict

Submitted 7/29/2026, 3:03:11 AM · Completed 7/29/2026, 3:05:52 AM

5.8
pivot
The idea

Ask HN: Do we need a stronger process for vetting code?

Show original source text →
Now that writing code is largely automated, I've seen Github being filled to the brims with slop, and it feels like the overall quality of everything produced with code (either the tooling or the software itself) has been getting worse. Pre-AI, times were a bit simpler: You looked at the stars, looked at the issues, poked around the code, and gave the repository a chance. Today there's just way too much stuff being produced. I don't see this changing in the future, so I was thinking that I'd be cool to make some spin out of it: My idea is to create a data aggregator based on https://github.com/explore that is targeted towards developers. Think of it as the "Rotten Tomatoes" of code. Here are a few ideas that I've been bouncing around: Repositories having different scores and being organized by tech stack, language, etc. Certified classics by category and technology. Each repository has a scorecard. - its dependencies (too much - potential bloat) - issue progression over time (number of issues, time to close issues) - by maintainer count and reputation (changes hands often - bad). - by funding Allows users to set their own rating, giving a more nuanced distribution than just github stars. It also allows users to blacklist repositories, and exposes an MCP server that allows one's own agents to know what to avoid. What do you think?
TRIZ inventive level: 3/5· Principles: parameter changes, segmentation
Synthesis verdict
**Pivot** The idea taps into a real pain point - developer frustration with low-quality repositories in an AI-saturated GitHub ecosystem - and proposes a novel aggregation layer (a 'Rotten Tomatoes for code'). However, critical weaknesses in defensibility and monetization, compounded by high platform risk (dependence on GitHub's API and policies), make the current form unsustainable as a standalone venture. The scoring system's credibility and adoption hinge on community buy-in, which is hard to achieve without a clear, immediate value proposition that outshines free alternatives like GitHub Insights or SonarQube. The MCP server and blacklist features add differentiation but may not justify the effort without a stronger moat or revenue path. The viability and monetization scores (7/10 each) suggest potential, but the risk score (2/10) and competitive pressures (6/10) reveal fatal flaws: GitHub could shut down access, developers may distrust subjective metrics, and existing tools already cover parts of the proposed functionality. A pivot is warranted to address these gaps - either by narrowing the scope (e.g., focusing on enterprise-grade curation for specific tech stacks) or by integrating with established platforms (e.g., as a plugin for IDEs or CI tools) to reduce reliance on GitHub's data and improve monetization.

Strengths

  • - Timely problem: Addresses a growing pain point (AI-generated code slop) with a familiar metaphor (Rotten Tomatoes).
  • - Novel aggregation: Combines fragmented signals (dependencies, issue trends, maintainer reputation) into a unified scorecard.
  • - Niche integrations: MCP server and blacklist features cater to automation-heavy users (e.g., enterprises, agent builders).
  • - Feasible MVP: A small team could build a v1 in 12 weeks with prioritized metrics.

Weaknesses

  • - Platform risk: Over-reliance on GitHub's API and policies (could be revoked or restricted).
  • - Subjective metrics: Scoring system's credibility is hard to validate; developers may distrust automated quality assessments.
  • - Competitive fragmentation: Established tools (Code Climate, SonarQube) already cover parts of the functionality, reducing urgency.
  • - Unclear monetization: No proven willingness to pay; free alternatives (GitHub Insights, Awesome-* lists) are entrenched.
  • - Community dependency: Requires critical mass of user ratings/blacklists to be valuable, which is a chicken-and-egg problem.

Best angle

Pivot into a B2B plugin for IDEs/CI tools that overlays curated, stack-specific repository scores (e.g., 'Enterprise-Grade Python Repos') with paid tier for custom blacklists and agent integrations.

Panel verdicts

Competition

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning

6.0

“A unified, user - rated quality score for repositories is novel but will struggle against established tools and the difficulty of aggregating reliable metrics.”

The market already offers several sources of repository quality signals: GitHub's native Insights tab, Code Climate, SonarQube, Dependabot, and curated lists such as Libraries.io or Awesome - * collections. These tools provide metrics on dependencies, test coverage, issue resolution time, and maintainer activity, but they are fragmented and rarely combined into a single, easy - to - consume score. Your idea of aggregating multiple quantitative and user - generated ratings - stars, issue trends, maintainer reputation, funding, and a blacklist - into a "Rotten Tomatoes" - style scorecard is a novel aggregation layer. The MCP server for agent - level avoidance adds a niche integration angle that could appeal to automation platforms. However, durability is uncertain: building a trustworthy composite score requires consistent, high - quality data and a critical mass of community contributors to rate and blacklist repositories, which may be slow to achieve. Existing quality platforms already offer deep analysis (e.g., Code Climate's maintainability score) and can be extended via APIs, reducing the need for a separate aggregator. Moreover, the blacklist feature could be replicated easily, and the MCP endpoint may be redundant if major IDEs and CI tools already expose repository health metrics. Consequently, while the concept shows differentiation, it faces strong competition and the challenge of sustaining a reliable, community - driven rating system.

Viability

nvidia/llama-3.3-nemotron-super-49b-v1(fallback #1)

7.0

“Feasible for a small team within 12 weeks, but success hinges on the scoring system's credibility and mitigating GitHub API limitations.”

The idea leverages a timely concern about code quality amidst automation, and repurposing GitHub Explore with a 'Rotten Tomatoes' twist is intuitive. Technical feasibility is moderate due to the reliance on GitHub's API for data aggregation, which is generally accessible but may have rate limits and require robust error handling. The scoring system's complexity lies in defining and weighting metrics (e.g., dependency bloat, issue resolution rates, maintainer reputation) in a way that's universally accepted, which is challenging but not insurmountable. User rating and blacklisting features add social and personalization layers, increasing development complexity slightly. An MCP ( possibly 'My Custom Proxy' ) server for custom agents introduces additional backend and documentation workload. **Hard:** Metric validation, API rate limit management, ensuring scoring system's perceived fairness. **Easy:** Frontend for scorecard display, basic API integration for repo data. A solo/2-person team could build v1 in 12 weeks with careful prioritization, focusing on a limited set of metrics and tech stacks initially.

Risk

nvidia/llama-3.3-nemotron-super-49b-v1

2.0

“Dependence on GitHub data, subjective quality metrics, and lack of monetization strategy doom the project.”

The concept, while addressing a perceived issue, faces insurmountable challenges in its current form. Firstly, **regulation and platform risk** are high due to dependence on GitHub's data policies. If GitHub decides to restrict access or change its terms, the aggregator's foundation crumbles. GitHub's Explore feature is already curated, suggesting they might not welcome a competing, automated curation layer. **Churn** is another significant risk; developers, a notoriously skeptical group, might not trust an automated scoring system, especially if high-quality repos are undervalued or poor ones are highlighted as good due to algorithmic flaws. The subjective nature of 'quality' in codebases (e.g., a repo with many issues might be popular and actively maintained, not neglected) makes user adoption and retention doubtful. Lastly, **no-budget customers** imply a lack of a clear monetization strategy, which is crucial for sustainability. The idea doesn't offer a solution that developers would pay for, given the availability of free alternatives for discovery (like GitHub itself) and the skepticism towards automated quality metrics.

Market

meta/llama-3.3-70b-instruct

This agent failed to return a verdict (gave up after 1 attempts: ). The synthesis ran with the remaining agents.

Monetization

mistralai/mistral-nemotron(fallback #1)

7.0

“The success of this venture depends on the ability to accurately evaluate repositories and attract a critical mass of users willing to pay for the service.”

The idea addresses a real pain point in the developer ecosystem: the overwhelming volume of low-quality code and repositories on platforms like GitHub. By creating a 'Rotten Tomatoes' for code, you can provide a valuable service to developers looking for high-quality, reliable repositories. The proposed scoring system based on dependencies, issue progression, maintainer reputation, and funding is a solid foundation for evaluating repository quality. Additionally, allowing users to set their own ratings and blacklist repositories adds a layer of customization and community-driven curation. The potential to expose an MCP server for agents to avoid low-quality repositories is an innovative feature that could attract enterprise users. However, the success of this venture hinges on the ability to accurately and consistently evaluate repositories, which may require significant resources and expertise. The monetization path could include premium subscriptions for advanced features, API access for enterprises, and partnerships with companies looking to promote their repositories. The unit economics would depend on the cost of maintaining the evaluation infrastructure and the willingness of users to pay for the service.

Synthesized by mistralai/mistral-medium-3.5-128b (fallback #2) · 11.2s