ColossalAI/examples/language/llama/requirements.txt

colossalai>=0.3.6
datasets
numpy
tqdm
transformers
flash-attn>=2.0.0
SentencePiece==0.1.99
tensorboard==2.14.0
[exampe] update llama example (#5626) * [plugin] support dp inside for hybriad parallel * [example] update llama benchmark * [example] update llama benchmark * [example] update llama readme * [example] update llama readme 2024-04-23 06:12:20 +00:00			`colossalai>=0.3.6`
[example] add llama2 example (#4527) * [example] transfer llama-1 example * [example] fit llama-2 * [example] refactor scripts folder * [example] fit new gemini plugin * [cli] fix multinode runner * [example] fit gemini optim checkpoint * [example] refactor scripts * [example] update requirements * [example] update requirements * [example] rename llama to llama2 * [example] update readme and pretrain script * [example] refactor scripts 2023-08-28 09:59:11 +00:00			`datasets`
			`numpy`
			`tqdm`
			`transformers`
[exampe] update llama example (#5626) * [plugin] support dp inside for hybriad parallel * [example] update llama benchmark * [example] update llama benchmark * [example] update llama readme * [example] update llama readme 2024-04-23 06:12:20 +00:00			`flash-attn>=2.0.0`
[example] add llama2 example (#4527) * [example] transfer llama-1 example * [example] fit llama-2 * [example] refactor scripts folder * [example] fit new gemini plugin * [cli] fix multinode runner * [example] fit gemini optim checkpoint * [example] refactor scripts * [example] update requirements * [example] update requirements * [example] rename llama to llama2 * [example] update readme and pretrain script * [example] refactor scripts 2023-08-28 09:59:11 +00:00			`SentencePiece==0.1.99`
			`tensorboard==2.14.0`