fix(eval): run replay harness in verify
This commit is contained in:
1 parent
f90fb037f9
commit
cb315f308d
7 files changed
+612
-79
No files matched your search
@@ -28,10 +28,10 @@ pnpm eval:record -- \
|
||||
--system-prompt-preview "$(cat /tmp/current-system-prompt.txt)"
|
||||
```
|
||||
|
||||
The current CLI writes a stub meta + empty assertions. The full recorder
|
||||
(which drives `pi-agent-core` against a real provider using the
|
||||
AgentCompany worker's system prompt and tool registry) lands in a
|
||||
follow-up commit — see `../README.md` for the B5 roadmap.
|
||||
The current CLI records the provider assistant turn for a scenario prompt and
|
||||
user message. `pnpm test:eval` runs the fixture through `pi-agent-core` with
|
||||
recorded tool-result replay and validates the scenario prompt hash before
|
||||
assertions run.
|
||||
|
||||
## Committing fixtures
|
||||
|
||||
|
||||
Reference in new issue
Block a user