Hongxin Liu 6c0fa7b9a8 [llama] fix dataloader for hybrid parallel (#5358) ... * [plugin] refactor prepare dataloader * [plugin] update train script		2024-02-05 15:14:56 +08:00
..
__init__.py	initial commit: add colossal llama 2 (#4784)	2023-09-24 23:12:26 +08:00
conversation.py	[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878)	2023-12-07 14:02:03 +08:00
loader.py	[llama] fix dataloader for hybrid parallel (#5358)	2024-02-05 15:14:56 +08:00
spliced_and_tokenized_dataset.py	[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (#4878)	2023-12-07 14:02:03 +08:00