Can AI replace IdeaFast?
KINDA · weekend projectThe pipeline is honest work an agent can do: pull public Reddit JSON, prefilter complaint-shaped text, classify with an LLM, embed and cluster, rank by frequency times severity times recency. A weekend gets you ranked pain themes with real permalinks for two or three subreddits you already know. What does not fall out of one session is everything after the demo: staying inside Reddit's rate limits at scale, picking which communities are worth scanning when you do not already know, deduping the same pain across runs so week two is not week one again, and keeping the LLM bill under the price of the subscription. Verdict is kinda, not yes, because the first run is easy and the tenth is where the product actually lives.
Build me a Reddit pain finder: a local CLI plus a small dashboard that reads public
Reddit and turns complaints into ranked pain themes with clickable evidence.
- TypeScript on Node 22, SQLite via better-sqlite3, Hono for the dashboard. One
repo, one `npm run scan` entrypoint. No accounts, no cloud, no telemetry.
- Input: subreddits.txt plus a timeframe flag (default 90 days). Fetch posts and
top level comments from Reddit's public JSON endpoints, for example
https://www.reddit.com/r/<sub>/top.json?t=year. One request every 2 seconds, a
real descriptive User-Agent, and cache every raw response in SQLite so re-runs
cost nothing. No OAuth, no logged-in scraping.
- Prefilter to complaint-shaped text with cheap regexes ("I hate", "why is there
no", "wasted hours", "workaround", "gave up on") before spending a single
token. This is the whole cost story, do it first.
- Classify survivors with Claude (ANTHROPIC_API_KEY in .env, batched, cached by
content hash) into: is_pain, severity 1 to 5, one line summary.
- Cluster: embed the summaries, group at cosine similarity above 0.82, then have
Claude name each cluster and pick its 5 strongest verbatim quotes with
permalinks. Never paraphrase a quote, evidence has to be clickable or it is
worthless.
- Score each cluster as frequency x mean severity x recency decay, and persist
scores per run so a later scan can show what moved.
- Dashboard on localhost:3000: ranked clusters, expandable quotes with permalinks,
filter by subreddit, CSV export.
- README: how to choose subreddits, the rate limit rule and why breaking it gets
you blocked, and rough token cost per 1000 comments.
- Out of scope: sources other than Reddit, idea generation, and cross-scan dedupe.
Get one subreddit list producing clusters you actually trust first.$ open in your agent (prompt prefilled, you press enter) or copy it raw
prompt copied. want to know what dies next week?
new verdicts + top votes, weekly. free. one-click out.
The clustering is not the hard part, the boring infrastructure around it is. Reddit throttles aggressive clients, so a real corpus takes patient background ingestion rather than a scan you kick off and watch. People pay to skip the warm-up and the API bill, not because the data is secret. It is all public.
xcommunity discovery, you can only scan subreddits you already thought of
xcross-scan dedupe, so repeat runs resurface the same pains as if they were new
xa warmed corpus, every fresh scan pays the full ingestion wait
xcost control, naive LLM classification of a busy subreddit gets expensive fast
xthe idea generation and validation layer on top of the raw clusters
Can AI replace IdeaFast?
Kinda. The core of IdeaFast is buildable in a weekend with the prompt on this page, but there are real gaps: community discovery, you can only scan subreddits you already thought of, cross-scan dedupe, so repeat runs resurface the same pains as if they were new. Read the honest list above before committing.
How much does IdeaFast cost?
IdeaFast costs about $19/month (Founder, checked 2026-08-01), which is $228 per year.
What do I lose by replacing IdeaFast?
Honestly: community discovery, you can only scan subreddits you already thought of; cross-scan dedupe, so repeat runs resurface the same pains as if they were new; a warmed corpus, every fresh scan pays the full ingestion wait; cost control, naive LLM classification of a busy subreddit gets expensive fast; the idea generation and validation layer on top of the raw clusters. If any of those are load-bearing for you, keep paying.
Is there an open-source alternative to IdeaFast?
Yes — PRAW (Python Reddit API wrapper, the usual starting point for the ingestion half), BERTopic (Topic clustering over embeddings, covers the grouping step without an LLM). Using prior art is also a valid exit; the prompt is for when you want it exactly your way.