reddit · SideProject · 09-17 06:50 42 分 ← 返回列表

I got annoyed at paying for idle cloud GPUs or fighting for inventory, so I built a system that does the searching for me.

I run local AI models at home, but sometimes need more compute than I own. Cloud GPUs solve that problem, except I hated paying for an expensive GPU to idle while I wasn't actually running anything. So I started building Summon. The basic idea is to keep the cheap infrastructure and model cache around, but treat the GPU worker as disposable. Ask for compute, create the worker, attach the model cache, start inference, then destroy the expensive part when you're finished. My current GCP p

五维评分

付费意愿

需求真实度

个人可落地

竞争空间

新鲜度

AI 分析

痛点：偶尔需要超出本地算力的 GPU 时，按小时/包月租云 GPU 会在空闲时持续烧钱，而且要自己跟多区域库存抢容量

目标用户：在家跑本地大模型、偶尔需要额外算力的独立开发者、小型 AI 团队和业余爱好者

证据：I hated paying for an expensive GPU to idle while I wasn't actually running anything. / This started as something I wanted for myself, but I'm trying to figure out whether it's a problem other people actually have before I disappear down the infrastructure rabbit hole for another six months. / Would waiting ~90 seconds for a GPU in exchange for not paying for it while idle be useful, or is that already a dealbreaker?

变现：按秒计费的 GPU 用量加价（转售云算力差价）、orchestration 层订阅费（免费额度 + 团队版）、开源核心 + 托管控制面收费

MVP：两周内只做单一云（如 GCP）+ 单一模型引擎（llama.cpp/vLLM）：一条 CLI/API 命令按需拉起预绑定模型缓存的 L4 实例，推理结束自动销毁，暴露每秒钟实际计费与冷启动耗时，并加一个小型容量探测轮询器

竞品：RunPod、Modal、Replicate、Baseten、Beam Cloud、SkyPilot、dstack、Vast.ai、Salad

摘要：独立开发者在 r/SideProject 发布 Summon：把云 GPU 当作一次性资源，保留廉价的基础设施与模型缓存，用完即销毁，GCP 原型可在约 90 秒内从零拉起 L4 跑 llama.cpp，并正在做跨区域容量自动发现。痛点（为空闲 GPU 付费、抢库存）真实且所在市场本身付费能力强，但作者明确表示尚未验证别人是否也有同样问题，也无任何付费或收入数据，而 serverless GPU 赛道已有 RunPod、Modal、Replicate 等一众成熟竞品，独立开发者的差异化空间有限。