ColossalAI/applications/Colossal-LLaMA-2/colossal_llama2
Hongxin Liu 6c0fa7b9a8
[llama] fix dataloader for hybrid parallel (#5358)
* [plugin] refactor prepare dataloader

* [plugin] update train script
2024-02-05 15:14:56 +08:00
..
dataset [llama] fix dataloader for hybrid parallel (#5358) 2024-02-05 15:14:56 +08:00
model initial commit: add colossal llama 2 (#4784) 2023-09-24 23:12:26 +08:00
tokenizer [NFC] polish applications/Colossal-LLaMA-2/colossal_llama2/tokenizer/init_tokenizer.py code style (#5228) 2024-01-25 13:14:48 +08:00
utils fix bug for mefture (#5299) 2024-01-22 22:17:54 +08:00
__init__.py initial commit: add colossal llama 2 (#4784) 2023-09-24 23:12:26 +08:00