ZacharyZhang-NY
77219c930b
Ground truth comes only from third-party annotations (MMLongBench-Doc
evidence_page_ids, VisRAG qrels, ScreenSpot-v2 bboxes, Video-MME QA,
LongMemEval answer_session_ids, CodeSearchNet func_path+func_name) and
from document structure; no model judgement is used anywhere.
- bench/corpus/manifest.jsonl: 28 sources with url, retrieved_at, sha256,
annotation_source, license, files[]; verified by bench.manifest_check
- bench/sets/{pdf,image,ui_screenshot,video,code,conversation}.{jsonl} plus
corpus indexes and a manifest that freezes every file's sha256
- 2,928 answerable + 2,380 unanswerable queries over 854 holders; every
query carries scope {holder, scenario, as_of} for transactive routing
- bench/validate_sets.py fails on missing gold, holder mismatch between
gold and query, gold observed after as_of, and manifest digest drift
34 lines
498 B
Plaintext
34 lines
498 B
Plaintext
.venv/
|
|
.venv-linux*/
|
|
node_modules/
|
|
dist/
|
|
build/
|
|
.ely_eye/
|
|
*.pyc
|
|
__pycache__/
|
|
.pytest_cache/
|
|
.mypy_cache/
|
|
.ruff_cache/
|
|
.env
|
|
.env.local
|
|
frontend/.vite/
|
|
frontend/dist/
|
|
backend/src/ely_eye.egg-info/
|
|
*.log
|
|
*.tsbuildinfo
|
|
frontend/vite.config.d.ts
|
|
frontend/vite.config.js
|
|
unsloth_compiled_cache/
|
|
*.sqlite-wal
|
|
*.sqlite-shm
|
|
PRD.md
|
|
AGENTS.md
|
|
CLAUDE.md
|
|
designreference.html
|
|
# Local landing site — deployed to Cloudflare, not part of this repo
|
|
/ely-eye-web/
|
|
|
|
bench/corpus/*
|
|
!bench/corpus/manifest.jsonl
|
|
.pi/
|