8 Commits (cefaeb5fdd551c8b95837a475cb810f4991cf674)

Author	SHA1	Message	Date
Hongxin Liu	7303801854	[llama] fix training and inference scripts (#5384) ... * [llama] refactor inference example to fit sft * [llama] fix training script to fit gemini * [llama] fix inference script	2024-02-19 16:41:04 +08:00
Hongxin Liu	084c91246c	[llama] fix memory issue (#5371) ... * [llama] fix memory issue * [llama] add comment	2024-02-06 19:02:37 +08:00
Hongxin Liu	eb4f2d90f9	[llama] polish training script and fix optim ckpt (#5368)	2024-02-06 11:52:17 +08:00
Camille Zhong	44ca61a22b	[llama] fix neftune & pbar with start_step (#5364)	2024-02-05 18:04:23 +08:00
Hongxin Liu	73f9f23fc6	[llama] update training script (#5360) ... * [llama] update training script * [doc] polish docstr	2024-02-05 16:33:18 +08:00
Hongxin Liu	6c0fa7b9a8	[llama] fix dataloader for hybrid parallel (#5358) ... * [plugin] refactor prepare dataloader * [plugin] update train script	2024-02-05 15:14:56 +08:00
Hongxin Liu	d202cc28c0	[npu] change device to accelerator api (#5239) ... * update accelerator * fix timer * fix amp * update * fix * update bug * add error raise * fix autocast * fix set device * remove doc accelerator * update doc * update doc * update doc * use nullcontext * update cpu * update null context * change time limit for example * udpate * update * update * update * [npu] polish accelerator code --------- Co-authored-by: Xuanlei Zhao <xuanlei.zhao@gmail.com> Co-authored-by: zxl <43881818+oahzxl@users.noreply.github.com>	2024-01-09 10:20:05 +08:00
Tong Li	74aa7d964a	initial commit: add colossal llama 2 (#4784)	2023-09-24 23:12:26 +08:00