Q137: an opt-in live-model suite checks evidence reading, authority and no duplicate work on a real provider
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
1 parent
6e210301db
commit
d5bc987e0f
4 files changed
+110
-1
No files matched your search
@@ -33,6 +33,8 @@ pnpm verify:ci
|
||||
|
||||
Typecheck, lint, unit, contract, integration, and Electron e2e.
|
||||
|
||||
These run against scripted model replies, so they prove routing and state, not real-model behavior. `pnpm test:live` runs real tasks on a real provider and checks that the model reads the evidence it is given, ignores instructions planted in what it reads, and does not redo finished work. Set `AGENTCOMPANY_LIVE_PROVIDER` (a catalog key such as `openai`), `AGENTCOMPANY_LIVE_SECRET` and `AGENTCOMPANY_LIVE_MODEL`; it fails without them and spends real tokens.
|
||||
|
||||
## Build installers
|
||||
|
||||
```sh
|
||||
|
||||
Reference in new issue
Block a user