|
| 1 | +# ProofCore v1.0.3 – Research Benchmark Module Preview |
| 2 | + |
| 3 | +**Release Date**: 2025-11-06 |
| 4 | +**Status**: ✅ Production Ready |
| 5 | +**License**: MIT |
| 6 | + |
| 7 | +--- |
| 8 | + |
| 9 | +## Overview |
| 10 | + |
| 11 | +This release introduces the Research Benchmark Module (RBM) skeleton to ProofCore. RBM standardises step-level dataset ingestion, computer-assisted proof checks, evaluation metrics, and reporting so we can integrate internal corpora and public benchmarks (e.g., IMO-Bench) in a repeatable way. It also kicks off a broader plan to externalise Pyodide assets for security and performance. |
| 12 | + |
| 13 | +--- |
| 14 | + |
| 15 | +## Highlights |
| 16 | + |
| 17 | +### Research Benchmark Module (RBM) |
| 18 | + |
| 19 | +- Added `proofcore/research_benchmark/` with loader/parser helpers, a cascade validator that leverages CA proof hooks, and the first metrics helpers (`balanced_scores`, `omega_rbm`). |
| 20 | +- Delivered `rbm_cli` to run end-to-end evaluations and emit JSON reports; bundled `data_examples/sample_set.json` for smoke testing. |
| 21 | +- Added Python regression suites in `backend/tests_rbm/` covering the CA proof hooks, cascade pipeline, metrics, and CLI execution. |
| 22 | + |
| 23 | +### Pyodide Asset Pipeline |
| 24 | + |
| 25 | +- Repository now ships with an empty `public/pyodide/` plus `pyodide-manifest.json`; assets are fetched on demand. |
| 26 | +- Added `npm run setup:pyodide` (fetch) and `npm run verify:offline-assets` (manifest verification) to manage downloads safely. |
| 27 | +- Hash verification is supported via manifest entries and should be enabled for production deployments. |
| 28 | + |
| 29 | +### Next Steps |
| 30 | + |
| 31 | +- Expand manifest generation to include Subresource Integrity hashes automatically. |
| 32 | +- Integrate dependency scanning (npm audit, pip-audit, OSV) into CI for Pyodide bundles. |
| 33 | +- Introduce Service Worker background caching to improve first-use latency. |
| 34 | + |
| 35 | +### Documentation & Versioning |
| 36 | + |
| 37 | +- CHANGELOG, README, and release notes updated to describe RBM usage and Pyodide asset strategy. |
| 38 | +- Version bumped to **1.0.3** in `pyproject.toml`, `package.json`, and `setup.py`. |
| 39 | + |
| 40 | +--- |
| 41 | + |
| 42 | +## Installation Notes |
| 43 | + |
| 44 | +1. `npm install` (updates lockfile to 1.0.3). |
| 45 | +2. `python -m pytest backend/tests_rbm -q --no-cov` (verifies RBM stack). |
| 46 | +3. `npm run test -- tests/offline/offline_guarantee.test.ts` (ensures offline hardening remains intact). |
| 47 | + |
| 48 | +--- |
| 49 | + |
| 50 | +## Known Issues / Follow Ups |
| 51 | + |
| 52 | +- Manifest entries currently ship without hashes; add SRI/hash values before production deployment. |
| 53 | +- Remaining npm audit warnings require larger upgrades (Vite/Vitest majors). |
| 54 | + |
| 55 | +--- |
| 56 | + |
| 57 | +## Acknowledgements |
| 58 | + |
| 59 | +Thanks to the ProofCore maintainers for laying the groundwork for research dataset integration and tightening our asset security posture.*** |
0 commit comments