windyboy
0dac58fb6f
- fix stage-numbering conflict (README vs 05-Progress) and unify stage-1 reading scope - resolve AWS workshop prerequisite contradiction in 04-Reference/01 - convert medium-path wikilinks to vault-root paths (~30 links), fix .pyy typos, annotate ragas fork, unify archive status, add 01-/02- README hubs - compress old-version guidebook notes (01, 05) into pointers; add 2026 reading guidance to 00-Overview - dedupe project templates and remove embedded template copy in 03-Practice/README
34 lines
1.2 KiB
Markdown
34 lines
1.2 KiB
Markdown
---
|
||
type: reference
|
||
tags:
|
||
- llm-evaluation
|
||
- agent-evaluation
|
||
- safety
|
||
status: active
|
||
created: 2026-08-21
|
||
---
|
||
|
||
# 04 · Agent Safety and Environments
|
||
|
||
主题：Tool Use、Authorization、Sandbox、Trajectory、Interactive Environment
|
||
|
||
## 核心资源
|
||
|
||
### 1. Inspect AI Sandbox + AISI
|
||
- 重点看如何安全运行不可信 Agent / 代码
|
||
- 如何把 sandbox 当成评测基础设施的一部分
|
||
- Trace 的完整记录方式
|
||
|
||
### 2. BenchFlow
|
||
- 代表重要趋势：Static Dataset → Interactive Environment
|
||
- 对 Agent 来说，Prompt + Response 已经不够
|
||
- 真正要测：State → Action → Tool → Trajectory → Outcome
|
||
- "Environment is data" 的思路值得长期关注
|
||
- 但这是后期内容，必须先掌握 Task / Trial / Trace / Outcome / Harness
|
||
|
||
### 3. AWS Workshop 中的相关模块
|
||
- Tool Calling 的 5 种渐进式评测
|
||
- Red Teaming 示例
|
||
|
||
> 🔗 本页资源的完整链接、来源背景与上手建议见 [[01_Projects/Personal-Tech/LLM_Evaluation/04-Reference/archive/01-Curated-External-Resources|archive/01-Curated-External-Resources]]（"国家级与顶级学术机构"的 AISI 一节与"解决环境即数据的下一代框架"一节）。
|