windyboy
63add96a09
- Why Guide: remove duplicated 20-case/rubric/test-definition tables, link to authoritative Roadmap/Worksheet instead; 10-min action points to entries - Concept Map / What-Is: cross-link narrative vs quick-reference roles - Worksheet: annotate sections with authoritative sources - 04-Reference 01-04 <-> archive/01: bidirectional resource links - archive/00-Material-List: shrink guidebook listing, now reachable from READMEs - guidebook: compress 06-Yearly-Dives 2025 section (-> 08-2025-Edition §3), add old/new version nav banners to 01-05, reverse links in 08 - README/Start-Here: link Learning Board (was orphaned)
34 lines
1.1 KiB
Markdown
34 lines
1.1 KiB
Markdown
---
|
||
type: reference
|
||
tags:
|
||
- llm-evaluation
|
||
- agent-evaluation
|
||
- safety
|
||
status: active
|
||
created: 2026-08-21
|
||
---
|
||
|
||
# 04 · Agent Safety and Environments
|
||
|
||
主题：Tool Use、Authorization、Sandbox、Trajectory、Interactive Environment
|
||
|
||
## 核心资源
|
||
|
||
### 1. Inspect AI Sandbox + AISI
|
||
- 重点看如何安全运行不可信 Agent / 代码
|
||
- 如何把 sandbox 当成评测基础设施的一部分
|
||
- Trace 的完整记录方式
|
||
|
||
### 2. BenchFlow
|
||
- 代表重要趋势：Static Dataset → Interactive Environment
|
||
- 对 Agent 来说，Prompt + Response 已经不够
|
||
- 真正要测：State → Action → Tool → Trajectory → Outcome
|
||
- "Environment is data" 的思路值得长期关注
|
||
- 但这是后期内容，必须先掌握 Task / Trial / Trace / Outcome / Harness
|
||
|
||
### 3. AWS Workshop 中的相关模块
|
||
- Tool Calling 的 5 种渐进式评测
|
||
- Red Teaming 示例
|
||
|
||
> 🔗 本页资源的完整链接、来源背景与上手建议见 [[04-Reference/archive/01-Curated-External-Resources|archive/01-Curated-External-Resources]]（"国家级与顶级学术机构"的 AISI 一节与"解决环境即数据的下一代框架"一节）。
|