报错:
Traceback (most recent call last):
File "/mnt/cpfs/kexin/dlc_code/qwen2/Pai-Megatron-Patch/examples/qwen2/pretrain_qwen.py", line 211, in <module>
(<megatron.core.datasets.gpt_dataset.GPTDataset object at 0x7f491886bf10>, 5862)
len(dataset_and_size[0]), dataset_and_size[1] 12 5862
pretrain(train_valid_test_datasets_provider,
File "/mnt/cpfs/kexin/dlc_code/qwen2/Pai-Megatron-Patch/Megatron-LM-240612/megatron/training/training.py", line 251, in pretrain
= build_train_valid_test_data_iterators(
File "/mnt/cpfs/kexin/dlc_code/qwen2/Pai-Megatron-Patch/Megatron-LM-240612/megatron/training/training.py", line 1461, in build_train_valid_test_data_iterators
build_train_valid_test_data_loaders(
File "/mnt/cpfs/kexin/dlc_code/qwen2/Pai-Megatron-Patch/Megatron-LM-240612/megatron/training/training.py", line 1422, in build_train_valid_test_data_loaders
train_ds, valid_ds, test_