Q137: an opt-in live-model suite checks evidence reading, authority and no duplicate work on a real provider

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
ZacharyZhang-NYandClaude Opus 5.5 committed 2026-10-08 22:01:50 -04:00
1 parent 6e210301db
commit d5bc987e0f
4 files changed
+110 -1

No files matched your search

+2
View File
@@ -33,6 +33,8 @@ pnpm verify:ci
Typecheck, lint, unit, contract, integration, and Electron e2e.
These run against scripted model replies, so they prove routing and state, not real-model behavior. `pnpm test:live` runs real tasks on a real provider and checks that the model reads the evidence it is given, ignores instructions planted in what it reads, and does not redo finished work. Set `AGENTCOMPANY_LIVE_PROVIDER` (a catalog key such as `openai`), `AGENTCOMPANY_LIVE_SECRET` and `AGENTCOMPANY_LIVE_MODEL`; it fails without them and spends real tokens.
## Build installers
```sh