ytxiong 809ad9ebc8 fix the type_ids when micro_num=1 and use_flash_attn=False (#516)		2023-12-06 14:38:28 +08:00
..
__init__.py	initial commit	2023-07-06 12:55:23 +08:00
batch_sampler.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
collaters.py	initial commit	2023-07-06 12:55:23 +08:00
dataset.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
dummy_dataset.py	initial commit	2023-07-06 12:55:23 +08:00
packed_dataset.py	feat(data): walk folder to get dataset_type_ids_map (#477)	2023-11-07 19:21:10 +08:00
single_dataset.py	initial commit	2023-07-06 12:55:23 +08:00
utils.py	fix the type_ids when micro_num=1 and use_flash_attn=False (#516)	2023-12-06 14:38:28 +08:00