ColossalAI/applications/Colossal-LLaMA-2/colossal_llama2/utils
Camille Zhong 743e7fad2f
[colossal-llama2] add stream chat examlple for chat version model (#5428)
* add stream chat for chat version

* remove os.system clear

* modify function name
2024-03-07 14:58:56 +08:00
..
__init__.py initial commit: add colossal llama 2 (#4784) 2023-09-24 23:12:26 +08:00
ckpt_io.py initial commit: add colossal llama 2 (#4784) 2023-09-24 23:12:26 +08:00
flash_attention_patch.py [llama] add flash attn patch for npu (#5362) 2024-02-05 16:48:34 +08:00
froze.py initial commit: add colossal llama 2 (#4784) 2023-09-24 23:12:26 +08:00
neftune_patch.py [llama] fix neftune & pbar with start_step (#5364) 2024-02-05 18:04:23 +08:00
stream_chat_patch.py [colossal-llama2] add stream chat examlple for chat version model (#5428) 2024-03-07 14:58:56 +08:00