Skip to content

Commit 59c0a32

Browse files
authored
fix
1 parent eed9750 commit 59c0a32

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

D2F-train/config/llada.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ denoiser:
1818
wiinit: true
1919
name: 'eagle_rope'
2020
num_blocks: 1
21-
seq_len: &seq_len 512
21+
seq_len: &seq_len 1024
2222
input_dim: 3584
2323
hidden_dim: &dim 3584
2424
vocab_size: 152064
@@ -56,4 +56,4 @@ train:
5656
data:
5757
name: 'bs17k' #['numinamath', 'bs17k']
5858
batch_size: 1
59-
max_length: *seq_len
59+
max_length: *seq_len

0 commit comments

Comments
 (0)