AI Review Response Tool
intzi · v1.0.0 · Updated 2026-03-14T22:07:49.865933+00:00
This eval set tests the effectiveness of AI tools designed to assist small business owners in responding to negative reviews.
0 03 criteria
Eval Prompts (3)
Prompt
I want to build an AI tool that helps small restaurant owners automatically respond to negative Google reviews. Like, a lot of these mom and pop places get a 1-star review and either ignore it or write something defensive, and it tanks their rating. I'm thinking a tool that drafts a professional, empathetic response they can approve and post. Is there actually demand for this?
Expected Behavior
- ✓Report contains at least 5 clickable URLs (http/https links) to external sources — not just named sources without links
- ✓At least 2 community quotes show genuine user pain or active solution-seeking (e.g. 'I wish...', 'is there a tool that...', 'frustrated with...') — not generic mentions of the topic. Each quote includes a direct URL and a date from the last 12 months
- ✓At least 3 competitor prices cite the actual pricing page URL, not just a stated number
- ✓At least 3 cited sources include explicit publication or data dates from 2025 or later
- ✓Analysis explicitly states which geographic market(s) it covers (e.g. 'US market', 'North America') rather than generic 'the market'
- ✓Market size or growth figures cite a specific named report or study with a URL
- ✓Contradictory signals include at least one data point with a source that genuinely challenges the main verdict — not a softball
- ✓Report identifies at least 3 existing competitors by name with current pricing (verified date noted)
- ✓At least one open-source or GitHub competitor is identified with star count and recent activity status
- ✓Report includes a gap analysis specific to small/independent restaurants
- ✓Community Signals section distinguishes between direct signals (people asking for solutions), indirect signals (negative reviews, complaints), and behavioral signals (workarounds people have built)
- ✓All community quotes are from the last 12 months — no stale signals presented as current demand
- ✓Demand verdict explicitly rates signal strength (strong/moderate/weak/contradictory)
- ✓Report states a confidence level with explanation of what data is missing
- ✓Report follows the structured template (Idea Summary table, Competitor Landscape, Trend Analysis, Community Signals, Demand Verdict, Recommended Next Steps)
Companion Files
Tags
#ai#reviews#small-business#tools#automation