📡 Idea Radar 每天 8:00 / 18:00 推送 · 18:00 生成精选
reddit · SideProject · 53 分 ← 返回列表

I spent months trying to break my own security project, then published where it loses

I built an open source tool that stops AI agents doing things they were never allowed to do. Rather than publish the numbers that flatter it, I put every tool at its own default on public datasets and linked the script behind each number. One card on the benchmark page has a WE LOSE badge, for the test where a competing tool beats mine. It is still there. The number I am happy with: on a 588 attack benchmark, no guardrail lets all 588 through, the common open source guardrail lets 86 thro

五维评分

付费意愿
30
需求真实度
55
个人可落地
80
竞争空间
40
新鲜度
85

AI 分析

痛点:AI agent 可能执行未被授权的操作,缺少可靠的护栏来阻止越权行为

目标用户:构建和部署 AI agent 的开发者、安全团队

证据:on a 588 attack benchmark, no guardrail lets all 588 through, the common open source guardrail lets 86 through, mine lets 0 through.

变现:开源核心 + 企业版托管服务/合规审计/自定义策略支持,按 agent 调用量或席位订阅

MVP:做一个轻量级 SDK,在 agent 调用工具前做策略校验,支持常见框架(LangChain、AutoGPT),提供云托管和审计日志,2周内可出原型

竞品:Guardrails AI、NVIDIA NeMo Guardrails、Lakera Guard、AgentFox (the project itself)

摘要:开发者发布开源 AI agent 安全护栏 AgentFox,在 588 个攻击基准上拦截全部攻击,而常见开源护栏放行 86 个。项目免费开源,提供浏览器实时测试。AI agent 安全是新兴需求,但帖子未展示付费意愿或收入数据。