[Submission] Cautious nadamw jit

[priyakasimbeg]

Cautious NAdamW jax

Submission Information

submission_name: "Cautious_NAdamW"
submission_folder: "submissions/self_tuning/cautious_nadamw"
authors: "Kaizhao Liang"
affiliations: "University of Texas at Austin"
version: "1.0"
ruleset: "self-tuning"
framework: "JAX"
description: "Cautious NadamW ([Liang, 2025](https://arxiv.org/abs/2411.16085))."

Evidence for the Submission's Performance

Paper:
https://huggingface.co/papers/2411.16085
Results on RL: https://x.com/KyleLiang5/status/1931344549302927444

Independent verification:
https://huggingface.co/rwightman/timm-optim-caution
https://x.com/_clashluke/status/1935961388553290108

Comments

Finger crossed
Modified by priyakasimbeg@ based on pull/9.

[github-actions]

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅