when I config accelerate config to deepspeed nvme path, the path does not pass to deepspeed.py #1256
Closed
mobilejammer
started this conversation in
General
Replies: 1 comment
-
|
mate, see the OPTIONS.md document for offload location setting. for some reason, Accelerate doesn't provide this value. it's likely a bug in Accelerate. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
my accelerate config as follow:


compute_environment: LOCAL_MACHINE
debug: false
deepspeed_config:
deepspeed_moe_layer_cls_names: ''
gradient_accumulation_steps: 1
gradient_clipping: 1.0
offload_optimizer_device: nvme
offload_optimizer_nvme_path: /data/deepspeed_offload
offload_param_device: nvme
offload_param_nvme_path: /data/deepspeed_offload
zero3_init_flag: true
zero3_save_16bit_model: true
zero_stage: 3
distributed_type: DEEPSPEED
downcast_bf16: 'no'
dynamo_config:
dynamo_backend: INDUCTOR
enable_cpu_affinity: false
machine_rank: 0
main_training_function: main
mixed_precision: bf16
num_machines: 1
num_processes: 8
rdzv_backend: static
same_network: true
tpu_env: []
tpu_use_cluster: false
tpu_use_sudo: false
use_cpu: false
Beta Was this translation helpful? Give feedback.
All reactions