Ademamix

[davidtweedle]

New Submission

Submission Information

Please fill out the following information about your submission within the quotation marks.

submission_name: "ademamix_jax"  # As it will appear on the leaderboard
submission_folder: "ademamix"  # Name of folder within `submissions/external_tuning/` or `submissions/self_tuning/` (lowercase, no spaces)
authors: ""  # List authors separated by commas
affiliations: ""  # List all affiliations of the authors, separated by commas
version: "1.0"  # Optional version number of your submission
ruleset: "self-tuning"  # Either "external" or "self-tuning"
framework: "JAX"  # Either "PyTorch" or "JAX"
description: "Maintain slow- and fast-moving EMAs."  # A short, high-level description of the algorithm

Evidence for the Submission's Performance

Comments

Original Ademamix paper due to Matteo Pagliardini, Pierre Ablin, David Grangier.

[github-actions]

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅