ColossalAI

Author	SHA1	Message	Date
Hongxin Liu	a4cec1715b	[llama] add flash attn patch for npu (#5362 )	2024-02-05 16:48:34 +08:00
github-actions[bot]	a41cf88e9b	[format] applied code formatting on changed files in pull request 4908 (#4918 ) Co-authored-by: github-actions <github-actions@github.com>	2023-10-17 10:48:24 +08:00
Zian(Andy) Zheng	7768afbad0	Update flash_attention_patch.py To be compatible with the new change in the Transformers library, where a new argument 'padding_mask' was added to forward function of attention layer. https://github.com/huggingface/transformers/pull/25598	2023-10-16 14:00:45 +08:00
Tong Li	74aa7d964a	initial commit: add colossal llama 2 (#4784 )	2023-09-24 23:12:26 +08:00