Hub documentation

Agent Traces

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Agent Traces

Agent trace preview on a dataset page in light mode.

Claude Code, Codex, Pi, Hermes Agent, Factory Droid์˜ Agent traces๋Š” Hugging Face Hub์—์„œ ๋„ค์ดํ‹ฐ๋ธŒ๋กœ ์ง€์›๋ฉ๋‹ˆ๋‹ค. ์›๋ณธ JSONL ์„ธ์…˜์„ Dataset ๋˜๋Š” Storage Bucket์— ์—…๋กœ๋“œํ•˜๋ฉด ์ „์šฉ trace viewer์—์„œ ์—ด ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. Dataset์€ Data Studio์—์„œ traces๋ฅผ ํ‘œ์‹œํ•˜๊ณ , bucket์€ ๊ฐœ๋ณ„ .jsonl ํŒŒ์ผ์„ ์ง์ ‘ ์—ด ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

OpenRouter๋ฅผ ํ†ตํ•ด ๋ผ์šฐํŒ…๋œ ์š”์ฒญ์€ ๋ฒ„ํ‚ท์œผ๋กœ ๋ฐ”๋กœ ๋‚ด๋ณด๋‚ธ ํ›„ ๋™์ผํ•œ ๋ทฐ์–ด์—์„œ ์—ด ์ˆ˜ ์žˆ์œผ๋ฉฐ, OpenRouter Broadcast traces๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.

๋ฅผ ์ฐพ์•„๋ณด์„ธ์š”

๋Œ€๋ถ€๋ถ„์˜ ์ง€์›๋˜๋Š” ์—์ด์ „ํŠธ๋Š” JSONL ์„ธ์…˜์„ ๋กœ์ปฌ ๋””๋ ‰ํ† ๋ฆฌ์— ๊ธฐ๋กํ•ฉ๋‹ˆ๋‹ค:

์—์ด์ „ํŠธ๋กœ์ปฌ ์„ธ์…˜ ๋””๋ ‰ํ„ฐ๋ฆฌ
Claude Code~/.claude/projects
Codex~/.codex/sessions
Codex ์•„์นด์ด๋ธŒ~/.codex/archived_sessions
Factory/Droid~/.factory/sessions
Pi~/.pi/agent/sessions

์ด๋Ÿฌํ•œ trace ํŒŒ์ผ์€ ๊ธฐ๋ณธ์ ์œผ๋กœ ์ง€์›๋˜๋ฏ€๋กœ, ์ˆ˜์ •ํ•˜๊ฑฐ๋‚˜ ๋ณ€ํ™˜ํ•˜์ง€ ์•Š๊ณ  ๋ฐ”๋กœ ์—…๋กœ๋“œํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Hermes Agent๋Š” ํ˜„์žฌ ์„ธ์…˜์„ ์„ธ์…˜ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค์— ์ €์žฅํ•ฉ๋‹ˆ๋‹ค. ์—…๋กœ๋“œํ•˜๊ธฐ ์ „์— ๊ณต์œ ํ•˜๋ ค๋Š” ์„ธ์…˜์„ JSONL๋กœ ๋‚ด๋ณด๋‚ด์„ธ์š”:

hermes sessions export session.jsonl --session-id <session_id>

์ง์ ‘ harness๋ฅผ ๊ตฌ์ถ•ํ•˜๊ณ  ๊ณ„์‹ ๊ฐ€์š”? ์œ„ ๋ชฉ๋ก์— ์—†๋Š” ์—์ด์ „ํŠธ๋ผ๋ฉด Session Traces Format์„ ์ถœ๋ ฅํ•˜์—ฌ trace viewer์—์„œ ํ•ด๋‹น ์„ธ์…˜์„ ๋ Œ๋”๋งํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Trace ํŒŒ์ผ์—๋Š” ํ”„๋กฌํ”„ํŠธ, ๋„๊ตฌ ์ž…๋ ฅ๊ฐ’, ๋ช…๋ น ์ถœ๋ ฅ, ๋กœ์ปฌ ๊ฒฝ๋กœ, ์Šคํฌ๋ฆฐ์ƒท, ์‹œํฌ๋ฆฟ, ๋น„๊ณต๊ฐœ ์ฝ”๋“œ, ๊ฐœ์ธ ๋ฐ์ดํ„ฐ๊ฐ€ ํฌํ•จ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๊ณต๊ฐœ์ ์œผ๋กœ ๊ฒŒ์‹œํ•˜๊ธฐ ์ „์— trace๋ฅผ ๊ฒ€ํ† ํ•˜๊ณ  ๋ฏผ๊ฐํ•œ ๋ถ€๋ถ„์„ ์‚ญ์ œํ•˜๊ฑฐ๋‚˜, ํŒŒ์ผ์˜ ๋‚ด์šฉ์ด ๋ถˆ๋ถ„๋ช…ํ•œ ๊ฒฝ์šฐ ๋ฐ์ดํ„ฐ์…‹ ๋˜๋Š” ๋ฒ„ํ‚ท์„ ๋น„๊ณต๊ฐœ๋กœ ์œ ์ง€ํ•˜์„ธ์š”.

Pi Agent ์„ธ์…˜์˜ ๊ฒฝ์šฐ, pi-share-hf๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด ํ”„๋กœ์ ํŠธ ์„ธ์…˜์„ ์ˆ˜์ง‘ํ•˜๊ณ  ์•Œ๋ ค์ง„ ์‹œํฌ๋ฆฟ์„ ๋งˆ์Šคํ‚นํ•œ ๋’ค TruffleHog ๋ฐ LLM ๋ฆฌ๋ทฐ๋ฅผ ์‹คํ–‰ํ•˜์—ฌ ๊ฒ€์‚ฌ์— ํ†ต๊ณผํ•œ ์„ธ์…˜๋งŒ ์—…๋กœ๋“œํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

๊ฐ€์žฅ ์‰ฌ์šด ์—…๋กœ๋“œ ๋ฐฉ๋ฒ•์€ ์—์ด์ „ํŠธ ์ž์ฒด์—๊ฒŒ ์š”์ฒญํ•˜๋Š” ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์œ„์—์„œ ์–ธ๊ธ‰ํ•œ ๋””๋ ‰ํ„ฐ๋ฆฌ ๋˜๋Š” ๋‚ด๋ณด๋‚ธ JSONL ํŒŒ์ผ์„ ๊ฐ€๋ฆฌํ‚ค๋ฉฐ .jsonl ํŒŒ์ผ์„ Hub ๋ฐ์ดํ„ฐ์…‹ ๋˜๋Š” ๋ฒ„ํ‚ท์— ์—…๋กœ๋“œํ•˜๋„๋ก ์ง€์‹œํ•˜์„ธ์š”.

์ƒˆ ์„ธ์…˜์ด ๊ณ„์† ๋“ค์–ด์˜ค๋Š” ๋™์•ˆ ํŠธ๋ ˆ์ด์Šค๋ฅผ ์ง€์†์ ์œผ๋กœ ๋™๊ธฐํ™”ํ•˜๋ ค๋ฉด ๋ฒ„ํ‚ท์ด ํŠนํžˆ ์œ ์šฉํ•ฉ๋‹ˆ๋‹ค.

๋ฅผ ์—…๋กœ๋“œํ•˜์„ธ์š”

๋ฐ์ดํ„ฐ์…‹ ๋˜๋Š” ๋ฒ„ํ‚ท์„ ์ƒ์„ฑํ•œ ํ›„, ๊ถŒ์žฅ ์Šคํƒ ๋“œ์–ผ๋ก  ์„ค์น˜ ํ”„๋กœ๊ทธ๋žจ์„ ์‚ฌ์šฉํ•˜์—ฌ hf CLI๋ฅผ ์„ค์น˜ํ•˜๊ณ  ๋กœ๊ทธ์ธํ•˜์„ธ์š”. ์„ค์น˜ ํ”„๋กœ๊ทธ๋žจ์€ Hugging Face CLI Skill๋„ ์„ค์ •ํ•˜๋ฏ€๋กœ, ์ฝ”๋”ฉ ์—์ด์ „ํŠธ๊ฐ€ ๋Œ€์‹  hf ๋ช…๋ น์„ ์‹คํ–‰ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

curl -LsSf https://hf.co/cli/install.sh | bash
hf auth login

hf upload <username>/<dataset-name> ~/.codex/sessions . --repo-type dataset
hf buckets sync ~/.codex/sessions hf://buckets/<username>/<bucket-name>/codex

~/.codex/sessions๋ฅผ ์—์ด์ „ํŠธ์— ํ•ด๋‹นํ•˜๋Š” ์„ธ์…˜ ๋””๋ ‰ํ„ฐ๋ฆฌ๋กœ, ๋˜๋Š” Hermes Agent์—์„œ ๋‚ด๋ณด๋‚ธ JSONL ํŒŒ์ผ์„ ํฌํ•จํ•˜๋Š” ๋””๋ ‰ํ„ฐ๋ฆฌ๋กœ ๊ต์ฒดํ•˜์„ธ์š”. ๋ฐ์ดํ„ฐ์…‹์—๋Š” hf upload๋ฅผ, ์ƒˆ ํŠธ๋ ˆ์ด์Šค๊ฐ€ ๊ธฐ๋ก๋  ๋•Œ๋งˆ๋‹ค ์—…๋ฐ์ดํŠธํ•˜๋ ค๋Š” ๋ฒ„ํ‚ท์—๋Š” hf buckets sync๋ฅผ ์‚ฌ์šฉํ•˜์„ธ์š”. ๋” ์งง์€ hf sync ๋ช…๋ น์€ hf buckets sync์˜ ๋ณ„์นญ์ž…๋‹ˆ๋‹ค.

ํŠธ๋ ˆ์ด์Šค๋ฅผ ํ™•์ธํ•˜์„ธ์š”

๋ฐ์ดํ„ฐ์…‹์— ํŠธ๋ ˆ์ด์Šค๊ฐ€ ์žˆ์œผ๋ฉด Data Studio๋ฅผ ์—ด๊ณ  ํ–‰์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค. Storage Bucket์— ์žˆ๋Š” ํŠธ๋ ˆ์ด์Šค์˜ ๊ฒฝ์šฐ, ๊ฒ€์‚ฌํ•˜๋ ค๋Š” .jsonl ํŒŒ์ผ๋กœ ์ด๋™ํ•˜์—ฌ ํŒŒ์ผ์„ ์—ฝ๋‹ˆ๋‹ค. ํŠธ๋ ˆ์ด์Šค ๋ทฐ์–ด์—๋Š” ์„ธ์…˜ ํƒ€์ž„๋ผ์ธ, ํ”„๋กฌํ”„ํŠธ, ์–ด์‹œ์Šคํ„ดํŠธ ๋ฉ”์‹œ์ง€, ๋„๊ตฌ ํ˜ธ์ถœ, ์…ธ ์ถœ๋ ฅ, ์ถ”๋ก  ๋ธ”๋ก, ๊ฒฐ๊ณผ๊ฐ€ ํ‘œ์‹œ๋ฉ๋‹ˆ๋‹ค.

Agent trace session viewer showing user and assistant turns with expanded tool calls.

๊ณต๊ฐœ ์˜ˆ์‹œ๋กœ TeichAI/DeepSeek-v4-Pro-Agent์„ ์—ด ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋˜ํ•œ traces ํƒœ๊ทธ๊ฐ€ ์ง€์ •๋œ ๋” ๋งŽ์€ ๋ฐ์ดํ„ฐ์…‹์„ ํƒ์ƒ‰ํ•  ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค.

OpenRouter Broadcast ์ถ”์ 

OpenRouter Broadcast๋Š” OpenRouter๋ฅผ ํ†ตํ•ด ๋ผ์šฐํŒ…๋˜๋Š” ์š”์ฒญ์˜ ํŠธ๋ ˆ์ด์Šค๋ฅผ Storage Bucket์œผ๋กœ ์ „์†กํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, Hub๋Š” ํ•ด๋‹น ํŒŒ์ผ์„ ํŠธ๋ ˆ์ด์Šค ๋ทฐ์–ด์—์„œ ์—ด๋žŒํ•ฉ๋‹ˆ๋‹ค. ์•ฑ์ด๋‚˜ ์—์ด์ „ํŠธ์—์„œ ๋ณ€๊ฒฝํ•  ์‚ฌํ•ญ์ด ์—†์œผ๋ฏ€๋กœ OpenRouter๋ฅผ ๊ฒฝ์œ ํ•˜๋Š” ๋ชจ๋“  ํ™˜๊ฒฝ์—์„œ ๋™์ž‘ํ•ฉ๋‹ˆ๋‹ค: OpenRouter๋ฅผ ์ง€์ •ํ•œ Claude Code ๋˜๋Š” Codex, OpenCode, ๋˜๋Š” ์ผ๋ฐ˜์ ์ธ chat-completions ์•ฑ ๋“ฑ์ด ํ•ด๋‹น๋ฉ๋‹ˆ๋‹ค.

์„ค์ •ํ•˜๋ ค๋ฉด ๋ฒ„ํ‚ท์„ ์ƒ์„ฑํ•˜๊ณ , ํ•ด๋‹น ๋ฒ„ํ‚ท์— ์“ฐ๊ธฐ ๊ถŒํ•œ์ด ์žˆ๋Š” ํ† ํฐ์œผ๋กœ S3 ์ž๊ฒฉ ์ฆ๋ช…์„ ์ƒ์„ฑํ•œ ํ›„, OpenRouter์˜ Settings > Observability ์•„๋ž˜์— Hugging Face Storage Buckets๋ฅผ ๋Œ€์ƒ์œผ๋กœ ์ถ”๊ฐ€ํ•ฉ๋‹ˆ๋‹ค. OpenRouter์˜ Hugging Face Storage Buckets ๊ฐ€์ด๋“œ์— ์ „์ฒด ๋‹จ๊ณ„๊ฐ€ ๋‚˜์™€ ์žˆ์Šต๋‹ˆ๋‹ค.

๋ฒ„ํ‚ท์„ ๋น„๊ณต๊ฐœ๋กœ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค:

hf buckets create <username>/openrouter-traces --private

์ด ํŒŒ์ผ์—๋Š” ์ „์ฒด ํ”„๋กฌํ”„ํŠธ, ์‹œ์Šคํ…œ ํ”„๋กฌํ”„ํŠธ, ํŒŒ์ผ ๊ฒฝ๋กœ ๋ฐ ์…ธ ์ถœ๋ ฅ๊ณผ ๊ฐ™์€ ๋„๊ตฌ ์ถœ๋ ฅ, ๊ทธ๋ฆฌ๊ณ  OpenRouter ๊ณ„์ • ๋ฐ ์‚ฌ์šฉ์ž ID, API ํ‚ค ์ด๋ฆ„์ด ํฌํ•จ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. OpenRouter์˜ ๊ฐ€์ด๋“œ์—๋Š” ๋ฒ„ํ‚ท ๊ฐ€์‹œ์„ฑ์— ๋Œ€ํ•œ ๋‚ด์šฉ์ด ์—†์œผ๋ฉฐ, ๊ณต๊ฐœ ๋ฒ„ํ‚ท์€ ๋ˆ„๊ตฌ๋‚˜ ์ฝ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

๊ฐ trace๋Š” {traceId}-{timestamp}.json์ด๋ผ๋Š” ์ด๋ฆ„์˜ ๊ฐœ๋ณ„ JSON ํŒŒ์ผ๋กœ ์ €์žฅ๋ฉ๋‹ˆ๋‹ค. ๊ธฐ๋ณธ ๊ฒฝ๋กœ ํ…œํ”Œ๋ฆฟ์ธ openrouter-traces/{date}์„ ์‚ฌ์šฉํ•˜๋ฉด ๋‚ ์งœ๋ณ„ ํด๋”์— ์ €์žฅ๋ฉ๋‹ˆ๋‹ค:

openrouter-traces/<date>/gen-<unix>-<id>-<timestamp>.json

Trace๋Š” ์„ธ์…˜ ์ „์ฒด๊ฐ€ ์•„๋‹ˆ๋ผ ํ•˜๋‚˜์˜ ๋ชจ๋ธ ์š”์ฒญ์„ ๋‚˜ํƒ€๋ƒ…๋‹ˆ๋‹ค. ์—์ด์ „ํŠธ์˜ ํ•œ ํ„ด(turn)์€ ๋ณดํ†ต ์—ฌ๋Ÿฌ ๋ชจ๋ธ ์š”์ฒญ์„ ์ƒ์„ฑํ•˜๋ฏ€๋กœ, 3ํ„ด ์„ธ์…˜์—์„œ๋Š” ์•ฝ 10๊ฐœ์˜ ํŒŒ์ผ์ด ์ƒ์„ฑ๋  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๊ฐ ํŒŒ์ผ์€ ํ•ด๋‹น ์š”์ฒญ ์‹œ์ ๊นŒ์ง€์˜ ๋Œ€ํ™”๋ฅผ ํฌํ•จํ•˜๋ฏ€๋กœ, ์„ธ์…˜์˜ ๋งˆ์ง€๋ง‰ ํŒŒ์ผ์—๋Š” ์„ธ์…˜ ์ „์ฒด๊ฐ€ ํฌํ•จ๋ฉ๋‹ˆ๋‹ค. ๊ฐ™์€ ์„ธ์…˜์˜ ํŒŒ์ผ๋“ค์€ ๋™์ผํ•œ trace.sessionId๋ฅผ ๊ณต์œ ํ•ฉ๋‹ˆ๋‹ค.

๋ฒ„ํ‚ท์˜ .json ํŒŒ์ผ ์ค‘ ํ•˜๋‚˜๋ฅผ ์—ด๋ฉด OpenRouter trace๋กœ ํ™•์ธํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, trace ๋ณด๊ธฐ์™€ ์›๋ณธ JSON ์‚ฌ์ด๋ฅผ ์ „ํ™˜ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ทฐ์–ด์—์„œ๋Š” ๋ฉ”์‹œ์ง€, ๋„๊ตฌ ํ˜ธ์ถœ ๋ฐ ๊ฒฐ๊ณผ, ๋ชจ๋ธ, ํ† ํฐ ์ˆ˜(์บ์‹œ๋œ ํ† ํฐ ํฌํ•จ), ๋น„์šฉ์„ ํ‘œ์‹œํ•ฉ๋‹ˆ๋‹ค. ํ‘ธํ„ฐ์— ํ‘œ์‹œ๋œ ๋น„์šฉ์€ ์„ธ์…˜ ์ „์ฒด๊ฐ€ ์•„๋‹Œ ํ•ด๋‹น ์š”์ฒญ ํ•˜๋‚˜์— ๋Œ€ํ•œ ๋น„์šฉ์ž…๋‹ˆ๋‹ค.

์ด๋Ÿฌํ•œ ํŠธ๋ ˆ์ด์Šค๋ฅผ ์ฝ์„ ๋•Œ ์•Œ์•„์•ผ ํ•  ๋‘ ๊ฐ€์ง€ ์‚ฌํ•ญ:

  • ์ด๋ฏธ์ง€๋Š” ์ €์žฅ๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. OpenRouter๋Š” ๋‚ด๋ณด๋‚ด๊ธฐ ์ „์— ๋ฉ”์‹œ์ง€๋กœ๋ถ€ํ„ฐ ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ์ฝ˜ํ…์ธ ๋ฅผ ์ œ๊ฑฐํ•˜๋ฉฐ, ๋ทฐ์–ด์—๋Š” ํ•ด๋‹น ์œ„์น˜์— [image]๊ฐ€ ํ‘œ์‹œ๋ฉ๋‹ˆ๋‹ค.
  • ์ผ๋ถ€ ์š”์ฒญ์€ ๋ˆ„๋ฝ๋˜์—ˆ๊ฑฐ๋‚˜ ๋‚ด์šฉ์ด ์—†์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. OpenRouter์˜ ์ƒ˜ํ”Œ๋ง ๋น„์œจ ๋ฐ API ํ‚ค ํ•„ํ„ฐ๋Š” ๋Œ€์ƒ์— ์ „์†ก๋˜๋Š” ์š”์ฒญ์„ ์ œํ•œํ•˜๋ฉฐ, Privacy Mode๋Š” ํ”„๋กฌํ”„ํŠธ ๋ฐ ์™„์„ฑ ์ฝ˜ํ…์ธ ๊ฐ€ ์ œ๊ฑฐ๋ฉ๋‹ˆ๋‹ค.
Update on GitHub