fix(eval): run replay harness in verify

This commit is contained in:
ZacharyZhang-NY committed 2026-04-22 14:47:31 -04:00
1 parent f90fb037f9
commit cb315f308d
7 files changed
+612 -79

No files matched your search

+4 -4
View File
@@ -28,10 +28,10 @@ pnpm eval:record -- \
--system-prompt-preview "$(cat /tmp/current-system-prompt.txt)"
```
The current CLI writes a stub meta + empty assertions. The full recorder
(which drives `pi-agent-core` against a real provider using the
AgentCompany worker's system prompt and tool registry) lands in a
follow-up commit — see `../README.md` for the B5 roadmap.
The current CLI records the provider assistant turn for a scenario prompt and
user message. `pnpm test:eval` runs the fixture through `pi-agent-core` with
recorded tool-result replay and validates the scenario prompt hash before
assertions run.
## Committing fixtures