如何评估不同 LLM 提供商在延迟、吞吐量和正常运行时间上的性能
OpenRouter:Announcements(RSS): 如何评估不同 LLM 提供商在延迟、吞吐量和正常运行时间上的性能
同一模型在不同提供商端点上的表现因基础设施、量化、负载处理和路由默认设置而异。评估需测量延迟、吞吐量、正常运行时间和精度,并将测量结果转化为路由策略。
TL;DR · 2026-07-28
2026-07-28 的小雯 AI 机会导航共收录 36 条 AI 创业机会信号,覆盖模型发布、AI 产品、创业融资、Agent 自动化、论文研究与安全监管六个分类。当日最值得关注的三条是:如何评估不同 LLM 提供商在延迟、吞吐量和正常运行时间上的性能;Anthropic 澄清立场:从未主张全面禁止开源权重模型,支持芯片出口管制与安全测试;OpenAI 称越来越多员工用 ChatGPT 做其他岗位的工作。
| 分类 | 信号数 | 说明 |
|---|---|---|
| 模型发布 | 8 条 | 22.2% |
| AI产品 | 3 条 | 8.3% |
| 创业融资 | 4 条 | 11.1% |
| Agent自动化 | 10 条 | 27.8% |
| 论文研究 | 3 条 | 8.3% |
| 安全监管 | 8 条 | 22.2% |
Signals
OpenRouter:Announcements(RSS): 如何评估不同 LLM 提供商在延迟、吞吐量和正常运行时间上的性能
同一模型在不同提供商端点上的表现因基础设施、量化、负载处理和路由默认设置而异。评估需测量延迟、吞吐量、正常运行时间和精度,并将测量结果转化为路由策略。
Anthropic:Newsroom(网页): Anthropic 澄清立场:从未主张全面禁止开源权重模型,支持芯片出口管制与安全测试
Anthropic CEO Dario Amodei 明确表示公司从未主张禁止开源权重模型,并认为不具备危险能力的开源权重模型是公共产品。他提出三项实际措施:对华芯片出口管制、打击工业级知识蒸馏、对所有足够强大的模型进行强制性安全测试。Amodei 指出,保护主义禁令无法解决其最担忧的国家安全威胁,包括威权政府利用更强大 AI 实现军事优势或深度监控。
The Decoder:AI News(RSS): OpenAI 称越来越多员工用 ChatGPT 做其他岗位的工作
OpenAI 分析超 80 万条与工作相关的 ChatGPT 消息后发现,43.5% 的岗位特定查询涉及另一职业,营销和工程任务交叉最多。用户用 AI 处理合同审查、数据分析、网站故障排查等原由专家负责的工作。OpenAI 认为这是岗位职责正在变化的早期信号,该趋势在缺乏专业团队的小公司尤为明显。
X:Kimi.ai (@Kimi_Moonshot): Kimi 发布视觉感知基准 PerceptionBench
Kimi.ai 发布 PerceptionBench,一个从当前前沿模型在 42 个基准上的失败模式中归纳出的视觉感知基准。该基准将视觉感知拆解为 10 种原子能力,并构建了 3000 道验证题,每道题只考察单一感知能力,无需推理或外部知识。
MarkTechPost(RSS): 用Claude和Python构建技能驱动的金融分析智能体
本教程基于Anthropic的financial-services仓库,用纯Python复现其技能驱动架构。通过解析SKILL.md文件构建可搜索技能注册表,并创建可复用SkillAgent,将金融分析剧本注入Anthropic Messages API,支持迭代工具调用循环。
GitHub Blog: GitHub Copilot 发布"Harness"工作流:用单一工具完成原型、规划、实现与代码审查
GitHub Copilot 推出"Harness"工作流,让开发者通过单一 AI 工具完成从原型设计、规划、实现到代码审查的完整软件开发流程,无需追逐多种新 AI 工具。该工作流强调实用性与集成性,旨在减少工具切换带来的效率损耗。
GitHub Blog: GitHub Copilot app 入门指南:多 Agent 会话工作区与 Canvas 预览
GitHub Copilot app 将 AI 编码工具升级为多 Agent 会话工作区,支持同时管理多个任务线程而不丢失进度。用户可为每个会话绑定项目上下文,通过 `/create-canvas` 命令在浏览器 Canvas 中预览 UI 并直接点选修改,还能启用 Agent Merge 自动处理 PR 审查反馈和合并冲突。
TechCrunch:AI(RSS): Google AI Overviews 搜索结果出现率升至43%
Google AI Overviews 在搜索结果中的出现率一年内从15%升至43%,AI Mode月访问量从1.26亿增至2.79亿。用户搜索长度增加,正从短关键词转向更长的自然对话式查询。
公众号:月之暗面(Kimi): Kimi K3 开放日:模型权重、技术报告和关键 Infra 技术同步开放
月之暗面发布 2.8 万亿参数的混合专家模型 Kimi K3,支持原生视觉理解和 100 万 token 上下文窗口。其规模化效率较 Kimi K2.5 提升 2.5 倍,并同步开源模型权重、技术报告及 MoonEP、FlashKDA、AgentEnv 三项 Infra 技术。
X:Kimi.ai (@Kimi_Moonshot): Kimi K3 开源分布式智能体环境 AgentENV
我们与 kvcache-ai 合作开源了 AgentENV。 AgentENV 是一个用于大规模运行智能体环境的分布式系统。其组件为 Kimi K3 的智能体强化学习训练提供支持,具备快速快照、恢复和分支功能,适用于大规模并行智能体工作流。 在 GitHub 上探索:http://github.com/kvcache-ai/AgentEnv
NVIDIA Blog(RSS): NVIDIA 等多家行业领袖联合成立 Open Secure AI Alliance,推动 AI 安全与防御开源化
NVIDIA、Microsoft、Hugging Face、IBM 等数十家机构联合成立 Open Secure AI Alliance,旨在通过开源模型、工具和框架构建可审查、可定制的 AI 安全防御体系。
X:Vista (@vista8): 用AI Skill自动生成可协作HTML PPT
Vista 基于 bento PPT 改造了一个 Skill,输入内容或主题即可自动生成可编辑、在线演示并支持协作的 HTML PPT。安装指令为 `npx skills add joeseesun/qiaomu-bento-ppt`,推荐使用 Kimi K3 或 Opus 4.8+ 等前端审美好的模型。
公众号:数字生命卡兹克: 浪费20亿Token后,我开源了帮Agent定义目标的Leader.skill
作者开源了Leader.skill,用于将模糊的人类需求转化为Agent可独立执行数小时的目标任务书。该Skill基于"目标七问"方法论,涵盖目的、完成态、反作弊、边界等维度,并推荐用Claude Fable 5或Kimi K3规划目标,再交由GPT-5.6 Sol或GLM-5.2等模型长程执行。项目已开源。
X:Suno (@suno): Suno 推出多项新功能,含MIDI导出等
我们一直在以比以往更快的速度构建!🚀 以下是网页端和移动端的新功能一览: • 高级音轨分离 • 将音轨导出为 MIDI • 歌词合写与自动保存 • 截图生成歌曲 • Apple CarPlay 与 Android Auto 你最期待 Suno 的哪些新功能?
AI HOT日报 / 模型发布/更新: Kimi K3 开源:2.8T MoE 模型与技术报告
Kimi 发布其最强模型 Kimi K3,这是一个 2.8T 参数的 MoE 模型,具备原生视觉理解和 1M token 上下文窗口。新架构实现了每单位计算 2.5 倍的智能提升。除模型权重外,Kimi 还开源了高性能注意力内核、MoE 通信库及大规模智能体运行环境基础设施。
AI HOT日报 / 模型发布/更新: Kimi K3 上线 Modal,支持无损加速推理
很高兴 @modal 成为 Kimi K3 的 Day 0 发布合作伙伴! 他们为 K3 的架构训练了自定义 DFlash 投机器,实现更快推理且无质量损失。
AI HOT日报 / 产品发布/更新: SGLang 和 Miles 为月之暗面 2.8T 参数 Kimi K3 模型提供发布当日支持
SGLang 和 Miles 为月之暗面开源的 2.8T 参数模型 Kimi K3 提供发布当日支持,分别负责推理和 RL 训练。K3 采用 69 层 KDA 线性注意力与 24 层 MLA 交错的混合架构,在 SGLang 上单卡 batch-1 解码速度达约 113 tok/s,结合 DSpark 推测解码可达约 423 tok/s。
AI HOT日报 / 行业动态: Cognizant 与 Anthropic 扩大合作,成为 Claude Partner Network 全球首要合作伙伴
Cognizant 与 Anthropic 扩大合作,成为 Claude Partner Network 中的 Global Premier Partner,并将 Claude 嵌入其 Flowsource 等平台。已有超过 3 万名员工完成 Claude 培训,其为一家生物制药公司构建的智能合约系统将合同审核时间缩短最高 40%,提取准确率超过 88%。
AI HOT日报 / 论文研究: Apple 提出 GH-ESD:面向实例级视觉任务的假设驱动错误切片发现方法
Apple 机器学习研究团队提出 GH-ESD(Grounded Hypothesis-Driven Error Slice Discovery),一种针对目标检测与分割等实例级视觉任务的错误切片发现方法。现有方法主要适用于图像级分类,难以捕捉由上下文关系和空间视觉模式导致的实例级失败。GH-ESD 通过基于假设的驱动方式,系统性地发现模型在语义连贯子集上的系统性失效。
AI HOT日报 / 技巧与观点: OpenRouter 新增图像生成模型专用 API 端点
OpenRouter 通过专用 `/api/v1/images` 端点提供图像生成模型服务,图像理解仍通过 `/chat/completions` 端点完成,两者共用同一 API Key 和计费体系。该平台同时公布了两种任务的完整接口合约,并修复了此前出现的“no endpoints found”错误。
Microsoft launches its first cybersecurity model, plus a new agentic cybersecurity system
Microsoft bolstered its AI cybersecurity offerings this week with the launch of its first AI security model and a new security platform.
VentureBeat AI: Google just redesigned the search box for the first time in 25 years — here’s why it matters more than you think.
For a quarter century, the Google search box has been one of the most recognizable interfaces in computing: a thin white rectangle, a blinking cursor, a few typed words, and a list of blue links. On Tuesday, Google will formally retire that paradigm. At its an...
Railway secures $100 million to challenge AWS with AI-native cloud infrastructure
Railway , a San Francisco-based cloud platform that has quietly amassed two million developers without spending a dollar on marketing, announced Thursday that it raised $100 million in a Series B funding round, as surging demand for artificial intelligence app...
Claude Code costs up to $200 a month. Goose does the same thing for free.
The artificial intelligence coding revolution comes with a catch: it's expensive. Claude Code , Anthropic's terminal-based AI agent that can write, debug, and deploy code autonomously, has captured the imagination of software developers worldwide. Bu...
Listen Labs raises $69M after viral billboard hiring stunt to scale AI customer interviews
Alfred Wahlforss was running out of options. His startup, Listen Labs , needed to hire over 100 engineers, but competing against Mark Zuckerberg's $100 million offers seemed impossible. So he spent $5,000 — a fifth of his marketing budget — on a billboard...
Salesforce rolls out new Slackbot AI agent as it battles Microsoft and Google in workplace AI
Salesforce on Tuesday launched an entirely rebuilt version of Slackbot , the company's workplace assistant, transforming it from a simple notification tool into what executives describe as a fully powered AI agent capable of searching enterprise data, dra...
VentureBeat AI: Anthropic launches Cowork, a Claude Desktop agent that works in your files — no coding required
Anthropic released Cowork on Monday, a new AI agent capability that extends the power of its wildly successful Claude Code tool to non-technical users — and according to company insiders, the team built the entire feature in approximately a week and a half, la...
Nous Research's NousCoder-14B is an open-source coding model landing right in the Claude Code moment
Nous Research , the open-source artificial intelligence startup backed by crypto venture firm Paradigm , released a new competitive programming model on Monday that it says matches or exceeds several larger proprietary systems — trained in just four days using...
Microsoft unveils AI security tools it says outperform competing platforms
Microsoft says tools cost less than competing ones and outperform them, too. Microsoft is introducing new AI tools designed to help customers continuously streamline and automate the process of identifying and reducing their exposure to security risks. The new...
OpenAI called the Hugging Face attack unprecedented. But we’ve been here before.
This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here. Reading OpenAI’s account last week of how some of its models broke their containment and hacked into the computer sys...
Advancing next-gen AI with materials science innovation
The conversation about AI often centers on algorithms, computing power, or huge investments in new semiconductor fabrication plants and hyperscale data centers. But beneath each of these advances is another layer of innovation that makes them possible: advance...
China’s AI models have Trump’s AI world at war with itself
This story originally appeared in The Algorithm, our weekly newsletter on AI. To get stories like this in your inbox first, sign up here. Over the weekend, several current and former advisors to President Donald Trump on AI publicly lobbed insults at the ...
The risk of weather data sabotage is rising
Every morning, airline dispatchers, grid operators, and farmers around the world make decisions based on the same thing: a weather forecast. While these forecasts are something that most people glance at for two seconds, weather predictions influence major str...
Meet GPT-Red: an LLM super-hacker OpenAI built to make its models safer
OpenAI has built an LLM super-hacker called GPT-Red that it uses as a sparring partner to help its other models boost their defenses against cyberattacks. Last week the company released the latest version of its flagship LLM, GPT-5.6. OpenAI says that training...
The Verge AI: Nvidia, Microsoft launch open AI security alliance — without OpenAI, Google, or Anthropic
Nvidia on Monday said it is joining forces with Microsoft, SpaceX, IBM, and other tech companies to build and share open-source AI security tools. The new Open Secure AI Alliance said open tools are required to effectively defend against attacks from frontier ...
Claude’s voice mode is now available for Opus and Sonnet
Until now, voice mode has only been available on Claude Haiku, Anthropic's faster but less powerful model. Now the company is making its Opus and Sonnet models available in voice mode, and extending its reach into apps like Gmail, Slack, and Canva. When Anthro...