windyboy
63add96a09
- Why Guide: remove duplicated 20-case/rubric/test-definition tables, link to authoritative Roadmap/Worksheet instead; 10-min action points to entries - Concept Map / What-Is: cross-link narrative vs quick-reference roles - Worksheet: annotate sections with authoritative sources - 04-Reference 01-04 <-> archive/01: bidirectional resource links - archive/00-Material-List: shrink guidebook listing, now reachable from READMEs - guidebook: compress 06-Yearly-Dives 2025 section (-> 08-2025-Edition §3), add old/new version nav banners to 01-05, reverse links in 08 - README/Start-Here: link Learning Board (was orphaned)
1.1 KiB
1.1 KiB
type, tags, status, created
| type | tags | status | created | |||
|---|---|---|---|---|---|---|
| reference |
|
active | 2026-08-21 |
04 · Agent Safety and Environments
主题：Tool Use、Authorization、Sandbox、Trajectory、Interactive Environment
核心资源
1. Inspect AI Sandbox + AISI
- 重点看如何安全运行不可信 Agent / 代码
- 如何把 sandbox 当成评测基础设施的一部分
- Trace 的完整记录方式
2. BenchFlow
- 代表重要趋势：Static Dataset → Interactive Environment
- 对 Agent 来说，Prompt + Response 已经不够
- 真正要测：State → Action → Tool → Trajectory → Outcome
- "Environment is data" 的思路值得长期关注
- 但这是后期内容，必须先掌握 Task / Trial / Trace / Outcome / Harness
3. AWS Workshop 中的相关模块
- Tool Calling 的 5 种渐进式评测
- Red Teaming 示例
🔗 本页资源的完整链接、来源背景与上手建议见 04-Reference/archive/01-Curated-External-Resources（"国家级与顶级学术机构"的 AISI 一节与"解决环境即数据的下一代框架"一节）。