NGC-PC-Transformers

Implementation of a Predictive Coding Transformer built on the Neural Generative Coding framework.

Installation

Clone the Repository

git clone https://github.com/iCog-Labs-Dev/NGC-PC-Transformers.git

Navigate to the Project Directory

cd NGC-PC-Transformers

Create a virtual environment (optional but recommended):

python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

Install required packages:

pip install -r requirements.txt

Run the tokenization

python -m data_preprocess.tokenizer

Run the training

python train.py

Run the evaluation

python eval.py

Run the generation

python generation.py