夜雨聆风学习资料网

ARTICLE · 1236649

【Coze插件开发】-05 Artificialanalysis.ai AI基准测试与分析

【Coze插件开发】-05 Artificialanalysis.ai AI基准测试与分析
Hi~我是Jike,专注于AI人工智能与自动化的博主一枚。因为Coze本身的能力不能实现业务场景全覆盖,很多功能的实现得依赖插件,所以我会将Coze插件库没有但又需求很大的APP的API封装成Coze插件发布到Coze插件商店,方便大家使用。
插件地址:
https://www.coze.cn/store/plugin/7569906039265640498?from=store_search_suggestion
简介
Artificial Analysis 是一家独立的 AI 基准测试公司。衡量智能体和模型、为其提供服务的云基础设施,以及运行这些智能体和模型的芯片,帮助开发者和企业优化整个 AI 技术栈。
官网:https://artificialanalysis.ai/
核心功能
返回包括头条指数、中位表现, 以及投入产出定价。排除仅Pro字段,如完整的评估集, 代币计数、混合定价、性能百分位、上下文窗口、参数, 治疗方式、执照和提供者详情。
  • 获取语言模型
  • 获取图片模型排名
  • 获取图片编辑模型排名
  • 获取文本转视频模型排名
  • 获取文本转语音模型排名
  • 获取音乐模型排名

适用场景
1. AI 应用 / Agent 产品选型(最常用)
  • 在 Coze、Dify、自研 Agent 平台里,挑选底层大模型:对比 GPT、Claude、Gemini、DeepSeek、GLM 等,看谁更适合你的工作流(文档分析、数据表格、调用 API、多步骤任务)
  • 权衡三角:任务准确率 / 延迟 /token 成本,避免只看厂商宣传,用独立基准数据做决策
  • 细分场景选型:法律文书、财务报表、数据分析、代码工程、医疗摘要等垂直任务,平台有行业专项排行榜
2. 智能体(Agent)能力专项评估
  • 评估多步骤业务 Agent:做 PPT、Excel 分析、查阅文档、调用工具这类长周期知识工作(AA-Briefcase 基准),非常贴合 Coze 工作流场景Artificial...
  • 测试 Agent 使用终端、代码沙箱能力(Terminal-Bench),适合代码节点、自动化脚本类工作流
  • 对比不同模型做 RAG、私有文档问答时的忠实度、幻觉水平
3. AI 工程团队与产品迭代
  • 上线前做模型 POC:缩小候选模型范围,减少大量人工测试成本
  • 持续监控:新模型发布、厂商调价后,评估是否要替换现有模型栈
  • 性能基线管理:建立内部指标,跟踪版本迭代带来的能力变化
4. 企业采购 & 供应商商务谈判
  • 给内部汇报:用中立数据支撑 AI 预算、供应商选型审批
  • 和 API 服务商谈判:拿着跨模型对比数据议价,评估不同服务商性价比
5. AI 研究、行业分析、技术内容创作
  • 科研人员、分析师:获取标准化评测数据集,研究模型能力边界
  • 技术博主 / 行业报告:引用独立排行榜,对比模型演进趋势
  • 学术 / 开源项目:把评测数据接入自己的实验流程(平台提供 API)Artificial...
6. 平台 API 接入(进阶)
把 Artificial Analysis 评测数据接入你的系统:
  • 自动化模型推荐面板
  • 内部 AI 网关动态路由(根据任务类型自动选择最合适模型)
  • 自建模型监控看板,实时拉取各模型基准分数、价格、延迟数据
✅ 适合人群
AI 产品经理、LLM/Agent 开发、算法研究员、企业 AI 采购、Coze/Dify 等 Bot 搭建者、技术分析师
添加插件
1.智能体->技能->插件
2.工作流->添加节点->插件
3.插件商店->添加到智能体
点击“插件工具”可看到需要传入的参数
运行插件
申请API key
复制下面👇的链接到浏览器打开
https://artificialanalysis.ai/orgs/yeah-vnnra2/api-access
插件参数填写
不需要加“Bearer+空格”
工作流代码

不会搭工作流或懒得搭工作流,复制粘贴下方⬇️代码到Coze工作流中即可一键使用。

{"type":"coze-workflow-clipboard-data","source":{"workflowId":"7687926078946410515","flowMode":0,"spaceId":"7566267940615176233","isDouyin":false,"host":"www.coze.cn"},"json":{"nodes":[{"id":"100001","type":"1","meta":{"position":{"x":180,"y":13}},"data":{"nodeMeta":{"description":"工作流的起始节点,用于设定启动工作流需要的信息","icon":"https://lf3-static.bytednsdoc.com/obj/eden-cn/dvsmryvd_avi_dvsm/ljhwZthlaukjlkulzlp/icon/icon-Start-v2.jpg","subTitle":"","title":"开始"},"outputs":[{"type":"string","name":"input","required":false}],"trigger_parameters":[]},"_temp":{"bounds":{"x":0,"y":13,"width":360,"height":86},"externalData":{"icon":"https://lf3-static.bytednsdoc.com/obj/eden-cn/dvsmryvd_avi_dvsm/ljhwZthlaukjlkulzlp/icon/icon-Start-v2.jpg","description":"工作流的起始节点,用于设定启动工作流需要的信息","title":"开始","mainColor":"#5C62FF"}}},{"id":"900001","type":"2","meta":{"position":{"x":1100,"y":0}},"data":{"nodeMeta":{"description":"工作流的最终节点,用于返回工作流运行后的结果信息","icon":"https://lf3-static.bytednsdoc.com/obj/eden-cn/dvsmryvd_avi_dvsm/ljhwZthlaukjlkulzlp/icon/icon-End-v2.jpg","subTitle":"","title":"结束"},"inputs":{"terminatePlan":"returnVariables","inputParameters":[{"name":"output","input":{"type":"list","schema":{"type":"object","schema":[{"type":"string","name":"id","required":false,"description":"唯一标识符(稳定)"},{"type":"float","name":"median_time_to_first_answer_token","required":false,"description":"第一个答案标记的时间(秒,与共享推理标记的推理模型的第一个标记的时间不同)"},{"type":"float","name":"median_time_to_first_token_seconds","required":false,"description":"到第一个标记的时间(秒)"},{"type":"object","name":"model_creator","schema":[{"type":"string","name":"id","required":false,"description":"创建者id"},{"type":"string","name":"name","required":false,"description":"创建者名字"},{"type":"string","name":"slug","required":false,"description":"创建者slug"}],"required":false,"description":"创建者信息(id、name、slug)"},{"type":"object","name":"evaluations","schema":[{"type":"float","name":"livecodebench","required":false},{"type":"float","name":"mmlu_pro","required":false},{"type":"float","name":"aime","required":false},{"type":"float","name":"artificial_analysis_intelligence_index","required":false,"description":"人工分析智能指数"},{"type":"float","name":"artificial_analysis_math_index","required":false,"description":"人工分析数学指数"},{"type":"float","name":"gpqa","required":false},{"type":"float","name":"hle","required":false},{"type":"float","name":"math_500","required":false},{"type":"float","name":"scicode","required":false},{"type":"float","name":"artificial_analysis_coding_index","required":false,"description":"人工分析编码指数"}],"required":false,"description":"基准分数"},{"type":"string","name":"name","required":false,"description":"全名(可能会更改)"},{"type":"object","name":"pricing","schema":[{"type":"float","name":"price_1m_output_tokens","required":false,"description":"每百万输出Token的价格 ($USD)"},{"type":"float","name":"price_1m_blended_3_to_1","required":false,"description":"每百万向量嵌入Token的价格 ($USD)"},{"type":"float","name":"price_1m_input_tokens","required":false,"description":"每百万输入Token的价格 ($USD)"}],"required":false,"description":"每百万Token的价格 ($USD)"},{"type":"string","name":"slug","required":false,"description":"网址友好标识符(不经常更改)"},{"type":"float","name":"median_output_tokens_per_second","required":false,"description":"输出生成速度(每秒令牌数)"}]},"value":{"type":"ref","content":{"source":"block-output","blockID":"159419","name":"data"},"rawMeta":{"type":103}}}}]}},"_temp":{"bounds":{"x":920,"y":0,"width":360,"height":112},"externalData":{"icon":"https://lf3-static.bytednsdoc.com/obj/eden-cn/dvsmryvd_avi_dvsm/ljhwZthlaukjlkulzlp/icon/icon-End-v2.jpg","description":"工作流的最终节点,用于返回工作流运行后的结果信息","title":"结束","mainColor":"#5C62FF"}}},{"id":"159419","type":"4","meta":{"position":{"x":640,"y":0}},"data":{"nodeMeta":{"description":"模型","icon":"https://lf3-static.bytednsdoc.com/obj/eden-cn/dvsmryvd_avi_dvsm/ljhwZthlaukjlkulzlp/icon/icon-Plugin-v2.jpg","subtitle":"Artificialanalysis.ai:LLMS","title":"LLMS"},"inputs":{"apiParam":[{"input":{"type":"string","value":{"content":"7569906662299926537","rawMeta":{"type":1},"type":"literal"}},"name":"apiID"},{"input":{"type":"string","value":{"content":"LLMS","rawMeta":{"type":1},"type":"literal"}},"name":"apiName"},{"input":{"type":"string","value":{"content":"7569906657451606054","rawMeta":{"type":1},"type":"literal"}},"name":"pluginID"},{"input":{"type":"string","value":{"content":"Artificialanalysis.ai","rawMeta":{"type":1},"type":"literal"}},"name":"pluginName"},{"input":{"type":"string","value":{"content":"","rawMeta":{"type":1},"type":"literal"}},"name":"pluginVersion"},{"input":{"type":"string","value":{"content":"","rawMeta":{"type":1},"type":"literal"}},"name":"tips"},{"input":{"type":"string","value":{"content":"","rawMeta":{"type":1},"type":"literal"}},"name":"outDocLink"}],"inputParameters":[{"name":"x-api-key","input":{"type":"string","value":{"type":"literal","content":"your key","rawMeta":{"type":1}}}}],"settingOnError":{"processType":1,"timeoutMs":180000,"retryTimes":0}},"outputs":[{"type":"list","name":"data","schema":{"type":"object","schema":[{"type":"string","name":"id","required":false,"description":"唯一标识符(稳定)"},{"type":"float","name":"median_time_to_first_answer_token","required":false,"description":"第一个答案标记的时间(秒,与共享推理标记的推理模型的第一个标记的时间不同)"},{"type":"float","name":"median_time_to_first_token_seconds","required":false,"description":"到第一个标记的时间(秒)"},{"type":"object","name":"model_creator","schema":[{"type":"string","name":"id","required":false,"description":"创建者id"},{"type":"string","name":"name","required":false,"description":"创建者名字"},{"type":"string","name":"slug","required":false,"description":"创建者slug"}],"required":false,"description":"创建者信息(id、name、slug)"},{"type":"object","name":"evaluations","schema":[{"type":"float","name":"livecodebench","required":false},{"type":"float","name":"mmlu_pro","required":false},{"type":"float","name":"aime","required":false},{"type":"float","name":"artificial_analysis_intelligence_index","required":false,"description":"人工分析智能指数"},{"type":"float","name":"artificial_analysis_math_index","required":false,"description":"人工分析数学指数"},{"type":"float","name":"gpqa","required":false},{"type":"float","name":"hle","required":false},{"type":"float","name":"math_500","required":false},{"type":"float","name":"scicode","required":false},{"type":"float","name":"artificial_analysis_coding_index","required":false,"description":"人工分析编码指数"}],"required":false,"description":"基准分数"},{"type":"string","name":"name","required":false,"description":"全名(可能会更改)"},{"type":"object","name":"pricing","schema":[{"type":"float","name":"price_1m_output_tokens","required":false,"description":"每百万输出Token的价格 ($USD)"},{"type":"float","name":"price_1m_blended_3_to_1","required":false,"description":"每百万向量嵌入Token的价格 ($USD)"},{"type":"float","name":"price_1m_input_tokens","required":false,"description":"每百万输入Token的价格 ($USD)"}],"required":false,"description":"每百万Token的价格 ($USD)"},{"type":"string","name":"slug","required":false,"description":"网址友好标识符(不经常更改)"},{"type":"float","name":"median_output_tokens_per_second","required":false,"description":"输出生成速度(每秒令牌数)"}]},"required":false,"description":"数据"},{"type":"object","name":"prompt_options","schema":[{"type":"integer","name":"parallel_queries","required":false,"description":"平行查询"},{"type":"integer","name":"prompt_length","required":false,"description":"提示词长度"}],"required":false,"description":"提示词选项"},{"type":"integer","name":"status","required":false}]},"_temp":{"bounds":{"x":460,"y":0,"width":360,"height":112},"externalData":{"icon":"https://lf26-appstore-sign.oceancloudapi.com/ocean-cloud-tos/plugin_icon/926244342603076_1762346774934858117_277xdZqxEW.jpg?lk3s=cd508e2b&x-expires=1792576830&x-signature=FmGoaAcsZAvW6y6w9QUogCqPcO0%3D","apiName":"LLMS","pluginID":"7569906657451606054","pluginProductStatus":1,"pluginProductUnlistType":0,"pluginType":1,"spaceID":"7384700033784152098","inputs":[{"description":"请输入你的api key","input":{},"name":"x-api-key","required":true,"type":"string"}],"outputs":[{"input":{},"name":"status","required":false,"type":"integer"},{"description":"数据","input":{},"name":"data","required":false,"schema":{"schema":[{"description":"到第一个标记的时间(秒)","input":{},"name":"median_time_to_first_token_seconds","required":false,"type":"float"},{"description":"创建者信息(id、name、slug)","input":{},"name":"model_creator","required":false,"schema":[{"description":"创建者id","input":{},"name":"id","required":false,"type":"string"},{"description":"创建者名字","input":{},"name":"name","required":false,"type":"string"},{"description":"创建者slug","input":{},"name":"slug","required":false,"type":"string"}],"type":"object"},{"description":"全名(可能会更改)","input":{},"name":"name","required":false,"type":"string"},{"description":"每百万Token的价格 ($USD)","input":{},"name":"pricing","required":false,"schema":[{"description":"每百万输入Token的价格 ($USD)","input":{},"name":"price_1m_input_tokens","required":false,"type":"float"},{"description":"每百万输出Token的价格 ($USD)","input":{},"name":"price_1m_output_tokens","required":false,"type":"float"},{"description":"每百万向量嵌入Token的价格 ($USD)","input":{},"name":"price_1m_blended_3_to_1","required":false,"type":"float"}],"type":"object"},{"description":"输出生成速度(每秒令牌数)","input":{},"name":"median_output_tokens_per_second","required":false,"type":"float"},{"description":"唯一标识符(稳定)","input":{},"name":"id","required":false,"type":"string"},{"description":"第一个答案标记的时间(秒,与共享推理标记的推理模型的第一个标记的时间不同)","input":{},"name":"median_time_to_first_answer_token","required":false,"type":"float"},{"description":"网址友好标识符(不经常更改)","input":{},"name":"slug","required":false,"type":"string"},{"description":"基准分数","input":{},"name":"evaluations","required":false,"schema":[{"input":{},"name":"aime","required":false,"type":"float"},{"description":"人工分析数学指数","input":{},"name":"artificial_analysis_math_index","required":false,"type":"float"},{"input":{},"name":"gpqa","required":false,"type":"float"},{"input":{},"name":"hle","required":false,"type":"float"},{"input":{},"name":"mmlu_pro","required":false,"type":"float"},{"input":{},"name":"scicode","required":false,"type":"float"},{"description":"人工分析编码指数","input":{},"name":"artificial_analysis_coding_index","required":false,"type":"float"},{"description":"人工分析智能指数","input":{},"name":"artificial_analysis_intelligence_index","required":false,"type":"float"},{"input":{},"name":"livecodebench","required":false,"type":"float"},{"input":{},"name":"math_500","required":false,"type":"float"}],"type":"object"}],"type":"object"},"type":"list"},{"description":"提示词选项","input":{},"name":"prompt_options","required":false,"schema":[{"description":"平行查询","input":{},"name":"parallel_queries","required":false,"type":"integer"},{"description":"提示词长度","input":{},"name":"prompt_length","required":false,"type":"integer"}],"type":"object"}],"updateTime":1789959204,"channel_id":2,"commercial_setting":{},"latestVersionTs":"0","latestVersionName":"","versionName":"","description":"模型","title":"LLMS","mainColor":"#CA61FF"}}}],"edges":[{"sourceNodeID":"100001","targetNodeID":"159419"},{"sourceNodeID":"159419","targetNodeID":"900001"}]},"bounds":{"x":0,"y":0,"width":1280,"height":112}}
【关注我】每天分享最新AI资讯
【点赞+转发】让更多人告别重复劳动生活

相关学习资料