一、memory_efficient
> finished creating GPT datasets ...
[after dataloaders are built] datetime: 2024-01-07 17:48:27
done with setup ...
(min, max) time across ranks (ms):
model-and-optimizer-setup ......................: (850.00, 850.00)
train/valid/test-data-iterators-setup ..........: (144.00, 144.00)
training ...
[before the start of training step] datetime: 2024-01-07 17:48:27
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++&#