📡 Idea Radar 每天 8:00 / 18:00 推送 · 18:00 生成精选
reddit · SideProject · 51 分 ← 返回列表

I built a prompt test that grades you live, then makes a second AI audit your grade before it’ll give you a cert

so i'm a dev at a bank building Tully Courses on the side, and the part i'm weirdly proudest of is the grader. every lesson ends with you actually doing something and getting graded on it, not a multiple choice quiz. i wanted people to be able to poke at that grader without signing up for anything, so i built the Prompt Gauntlet!! how it works under the hood, for anyone curious: - every question has a hidden reference answer that never leaves the server. your answer gets graded against it

五维评分

付费意愿
42
需求真实度
28
个人可落地
90
竞争空间
55
新鲜度
60

AI 分析

痛点:AI/prompt 技能缺乏可信、防作弊的实操能力认证,现有的多是选择题测验或纯主观打分,无法作为可验证的能力凭证。

目标用户:想证明 prompt 工程能力的求职者、需要筛选 AI 人才的招聘方,以及做 AI 培训/课程的内容创作者。

证据:every lesson ends with you actually doing something and getting graded on it, not a multiple choice quiz ... the full run + cert is $5 and gets a public verify link ... honestly it's been live for a bit and basically nobody's seen it bc i never posted it anywhere

变现:按次付费的认证($5/次,含可公开验证的证书链接);面向企业的批量测评席位;给训练营/课程方提供白标评分 API 按调用量收费。

MVP:两周内做一个极简版:20 道实操题 + 服务端隐藏参考答案 + 单一强模型评分(A-F)+ 一个公开 verify 链接页面,用 Stripe 收款,先自己做一版题库验证转化。

竞品:DeepLearning.AI / Coursera 的 prompt engineering 课程证书、各类 AI 认证平台(如 Vellum、PromptBase 相关测评)、Mock 面试类 AI 评分工具

摘要:一位银行开发者业余做了 Tully Courses,其中 Prompt Gauntlet 用服务端隐藏参考答案实时给用户答案打 A-F 分,付费版由第二个更强模型盲审后发 $5 的证书并附公开验证链接。作者称上线一段时间几乎无人使用,因为没有推广,全文没有任何付费用户数或收入数据。产品形态本身适合独立开发者复刻,但需求真实性完全未验证。