InternLM/internlm/data
huangting4201 fd28bcab58
feat(data/utils.py): add new dataset type code for streaming dataset (#225)
2023-08-24 13:46:18 +08:00
..
__init__.py initial commit 2023-07-06 12:55:23 +08:00
batch_sampler.py feat(core/scheduler): support pipeline parallel (#98) 2023-07-24 20:52:09 +08:00
collaters.py initial commit 2023-07-06 12:55:23 +08:00
dataset.py feat(utils/evaluation.py): support evaluate (#154) 2023-08-02 19:03:59 +08:00
dummy_dataset.py initial commit 2023-07-06 12:55:23 +08:00
packed_dataset.py feat(utils/logger.py): support uniscale logger (#152) 2023-08-01 17:37:32 +08:00
single_dataset.py initial commit 2023-07-06 12:55:23 +08:00
utils.py feat(data/utils.py): add new dataset type code for streaming dataset (#225) 2023-08-24 13:46:18 +08:00