windyboy
0dac58fb6f
- fix stage-numbering conflict (README vs 05-Progress) and unify stage-1 reading scope - resolve AWS workshop prerequisite contradiction in 04-Reference/01 - convert medium-path wikilinks to vault-root paths (~30 links), fix .pyy typos, annotate ragas fork, unify archive status, add 01-/02- README hubs - compress old-version guidebook notes (01, 05) into pointers; add 2026 reading guidance to 00-Overview - dedupe project templates and remove embedded template copy in 03-Practice/README
1.2 KiB
1.2 KiB
type, tags, status, created
| type | tags | status | created | |||
|---|---|---|---|---|---|---|
| reference |
|
active | 2026-08-21 |
04 · Agent Safety and Environments
主题：Tool Use、Authorization、Sandbox、Trajectory、Interactive Environment
核心资源
1. Inspect AI Sandbox + AISI
- 重点看如何安全运行不可信 Agent / 代码
- 如何把 sandbox 当成评测基础设施的一部分
- Trace 的完整记录方式
2. BenchFlow
- 代表重要趋势：Static Dataset → Interactive Environment
- 对 Agent 来说，Prompt + Response 已经不够
- 真正要测：State → Action → Tool → Trajectory → Outcome
- "Environment is data" 的思路值得长期关注
- 但这是后期内容，必须先掌握 Task / Trial / Trace / Outcome / Harness
3. AWS Workshop 中的相关模块
- Tool Calling 的 5 种渐进式评测
- Red Teaming 示例
🔗 本页资源的完整链接、来源背景与上手建议见 01_Projects/Personal-Tech/LLM_Evaluation/04-Reference/archive/01-Curated-External-Resources（"国家级与顶级学术机构"的 AISI 一节与"解决环境即数据的下一代框架"一节）。