Is model.layers.0.mlp.moe.gate.gate_map.weight provided？

[ITCJ]

Thank you for your wonderful job! But there are some issues while loading MoE++.
It seems that [model.layers.0.mlp.moe.gate.gate_map.weight] is not found while loading with AutoModelForCausalLM and modeling_moe_plus_plus.MoeForCausalLM.
Provided weights only contains 23 gate_map.weight. Is my loading method correct?

[jpthu17]

Your loading is correct. There is no gate_map parameter in layer 0.