ZacharyZhang-NY
fc0698c242
- bench/ingest_baseline.py drives the unmodified product IngestionService over all 50,789 corpus files in sharded SQLite DBs, then merges them. Thread and memory ceilings are set explicitly: ONNX Runtime defaulted to every core (95 threads/worker, load 490) and its CPU arena kept freed pages mapped, which OOM-killed workers. - bench/metrics.py: recall@k, MRR, nDCG@10, Wilson lower bound, chance baseline. No model, no product import, so the scorer cannot grade itself. - bench/systems.py + bench/run.py: the five ablation arms over the merged DB, latency percentiles, scale curve, and a top-10 equivalence check against the live RetrievalService. - bench/counterpart.py + bench/run_external.py: in-repo Mem0-style flat store and Zep-style temporal store as the external reference point. - bench/audit.py: enforces single-attempt scoring, frozen n, a chance row beside every score, and producer != verifier. It already flags the product's retry-until-target loop at backend/src/ely_eye/evals.py:2351. - backend/pyproject.toml: rapidocr-onnxruntime>=1.4.4 was unsatisfiable (PyPI maxes at 1.2.3); the successor is the renamed rapidocr package.
36 lines
524 B
Plaintext
36 lines
524 B
Plaintext
.venv/
|
|
.venv-linux*/
|
|
node_modules/
|
|
dist/
|
|
build/
|
|
.ely_eye/
|
|
*.pyc
|
|
__pycache__/
|
|
.pytest_cache/
|
|
.mypy_cache/
|
|
.ruff_cache/
|
|
.env
|
|
.env.local
|
|
frontend/.vite/
|
|
frontend/dist/
|
|
backend/src/ely_eye.egg-info/
|
|
*.log
|
|
*.tsbuildinfo
|
|
frontend/vite.config.d.ts
|
|
frontend/vite.config.js
|
|
unsloth_compiled_cache/
|
|
*.sqlite-wal
|
|
*.sqlite-shm
|
|
PRD.md
|
|
AGENTS.md
|
|
CLAUDE.md
|
|
designreference.html
|
|
# Local landing site — deployed to Cloudflare, not part of this repo
|
|
/ely-eye-web/
|
|
|
|
bench/corpus/*
|
|
!bench/corpus/manifest.jsonl
|
|
.pi/
|
|
bench/runs/
|
|
bench/models/
|