Search results

<code>RuntimeError: Expected to mark a variable ready only once</code> when training with PEFT

Status: Open.

#4782 In huggingface/trl;

· qgallouedec opened on Jan 7, 2026

SFTTrainer stuck

Status: Open.

#4776 In huggingface/trl;

· weathon opened on Jan 6, 2026

vllm_importance_sampling_correction causes vllm_importance_sampling_ratio explosion

Status: Open.

#4772 In huggingface/trl;

· Aurora-1412 opened on Jan 3, 2026

Qwen3-VL-30B-A3B-Instruct + fsdp: RuntimeError: Expected all tensors to be on the same device, but got index is on cpu, different from other tensors on cuda

Status: Open.

#4771 In huggingface/trl;

· li126com opened on Jan 3, 2026

Can't find completions in wandb and using IS correction causes loss=0.0

Status: Open.

#4767 In huggingface/trl;

· Aurora-1412 opened on Jan 1, 2026

Asynchronous generation and training for GRPO?

Status: Open.

#4766 In huggingface/trl;

· sxndqc opened on Jan 1, 2026

Can support optional dynamic sampling in GRPO ? (as in DAPO)

Status: Open.

#4764 In huggingface/trl;

· ceresOPA opened on Dec 30, 2025

[Feature Discussion] Supervised Reinforcement Learning (SRL) - Step-Level Training for Reasoning

Status: Open.

#4759 In huggingface/trl;

· s23deepak opened on Dec 29, 2025

[Feature Request] Add max_tool_iterations parameter to GRPOTrainer

Status: Open.

#4751 In huggingface/trl;

· austinmw opened on Dec 25, 2025

Addition of Supervised Reinforcement Learning

Status: Open.

#4747 In huggingface/trl;

· kushalgarg101 opened on Dec 24, 2025

examples/notebooks/grpo_qwen3_vl.ipynb fails with TypeError: string indices must be integers, not 'str'

Status: Open.

#4746 In huggingface/trl;

· ympan0508 opened on Dec 24, 2025

NCCL error: /pytorch/torch/csrc/distributed/c10d/NCCLUtils.hpp:268, NCCL version 2.22.3 ncclSystemError: System call (e.g. socket, malloc) or external library call failed or device error. Last error: socketStartConnect: Connect to IP&lt;51423&gt; failed

Status: Open.

#4737 In huggingface/trl;

· guotong1988 opened on Dec 23, 2025