Reference implementation for the paper "Versor: Foundational Theory of Structural Intelligence".
Versor is a sequence architecture built on Conformal Geometric Algebra (CGA) that replaces the "vector-space" assumptions of Transformers with the graded manifold structure of
Model/: Core architecture components (VersorLinear,GeometricProductAttention).Physics/: N-Body dynamics experiments, data generation, and OOD benchmarks.Maze/: Topological connectivity tasks.kernel.py: Custom hardware-accelerated Clifford Algebra kernels (Triton/MLX).run_all_experiments.py: Master script to reproduce paper results.
System dependencies: Python 3.9+
# Clone the repository
git clone https://github.com/PotatoInfinity/Versor.git
cd Versor
# Install dependencies
pip install -r requirements.txtNote on Hardware Acceleration:
- Linux (NVIDIA GPUs): The codebase automatically leverages
tritonkernels for geometric products. - macOS (Apple Silicon): Ensure
mlxis installed for accelerated operations (experimental support).
We provide a master script to run the full experimental suite described in the paper.
python3 run_all_experiments.pyThis script will:
- Train standard and Versor models on N-Body Dynamics.
- Run Topological Connectivity benchmarks.
- Execute the OOD Mass Generalization test (Paper Sec 7.2).
- Perform the Ablation Study (Manifold Norm, Recursive Rotor).
- Save all results to
./paper_results/.
1. Verification of Initialization Strategy (Appendix G) Confirm that signal variance is preserved across 20 layers:
python3 verify_initialization.py2. Out-of-Distribution Generalization
Train on standard masses (
python3 Physics/recreate_ood.py3. Ablation Study Compare Full Versor vs. No-Norm vs. Standard Transformer:
python3 Physics/rigorous_ablation.pyAs noted in the paper:
The provided minimal example code uses simplified hyperparameters (Learning Rate =
$10^{-3}$ , constant schedule) for rapid verification and CI/CD compatibility.The State-of-the-Art (SOTA) results reported in the paper (Table 2) were obtained using the tuned schedule described in Appendix L (Cosine annealing, warmup, longer training horizon).
If you use Versor in your research, please cite:
@article{versor2025,
title={Versor: Foundational Theory of Structural Intelligence},
author={Versor Team},
journal={arXiv preprint},
year={2026},
doi={10.5281/zenodo.18320794},
url={https://github.com/PotatoInfinity/Versor}
}Apache License 2.0