AI Review Response Tool

intzi · v1.0.0 · Updated 2026-03-14T22:07:49.865933+00:00

productivity/ai-tools

This eval set tests the effectiveness of AI tools designed to assist small business owners in responding to negative reviews.

0 03 criteria

Eval Prompts (3)

Prompt

I want to build an AI tool that helps small restaurant owners automatically respond to negative Google reviews. Like, a lot of these mom and pop places get a 1-star review and either ignore it or write something defensive, and it tanks their rating. I'm thinking a tool that drafts a professional, empathetic response they can approve and post. Is there actually demand for this?

Expected Behavior

  • Report contains at least 5 clickable URLs (http/https links) to external sources — not just named sources without links
  • At least 2 community quotes show genuine user pain or active solution-seeking (e.g. 'I wish...', 'is there a tool that...', 'frustrated with...') — not generic mentions of the topic. Each quote includes a direct URL and a date from the last 12 months
  • At least 3 competitor prices cite the actual pricing page URL, not just a stated number
  • At least 3 cited sources include explicit publication or data dates from 2025 or later
  • Analysis explicitly states which geographic market(s) it covers (e.g. 'US market', 'North America') rather than generic 'the market'
  • Market size or growth figures cite a specific named report or study with a URL
  • Contradictory signals include at least one data point with a source that genuinely challenges the main verdict — not a softball
  • Report identifies at least 3 existing competitors by name with current pricing (verified date noted)
  • At least one open-source or GitHub competitor is identified with star count and recent activity status
  • Report includes a gap analysis specific to small/independent restaurants
  • Community Signals section distinguishes between direct signals (people asking for solutions), indirect signals (negative reviews, complaints), and behavioral signals (workarounds people have built)
  • All community quotes are from the last 12 months — no stale signals presented as current demand
  • Demand verdict explicitly rates signal strength (strong/moderate/weak/contradictory)
  • Report states a confidence level with explanation of what data is missing
  • Report follows the structured template (Idea Summary table, Competitor Landscape, Trend Analysis, Community Signals, Demand Verdict, Recommended Next Steps)

Companion Files

Tags

#ai#reviews#small-business#tools#automation