InternLM/internlm/data
Yang Gao 6f69bd2087
feat(data): walk folder to get dataset_type_ids_map (#477)
* walk folder to get dataset_type_ids_map

* fix a bug
2023-11-07 19:21:10 +08:00
..
__init__.py initial commit 2023-07-06 12:55:23 +08:00
batch_sampler.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
collaters.py initial commit 2023-07-06 12:55:23 +08:00
dataset.py Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
dummy_dataset.py initial commit 2023-07-06 12:55:23 +08:00
packed_dataset.py feat(data): walk folder to get dataset_type_ids_map (#477) 2023-11-07 19:21:10 +08:00
single_dataset.py initial commit 2023-07-06 12:55:23 +08:00
utils.py feat(data): walk folder to get dataset_type_ids_map (#477) 2023-11-07 19:21:10 +08:00