yingtongxiong 10b5056e1e fix all-gather overlap the model_checkpoint is 0		2023-11-01 12:31:52 +08:00
..
__init__.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
embedding.py	fix(model/embedding.py): ci lint check error (#345)	2023-09-21 14:46:22 +08:00
linear.py	feat(model/overlap_handler.py): move handler to gpc	2023-10-23 12:02:32 +08:00
loss.py	initial commit	2023-07-06 12:55:23 +08:00
metrics.py	support model activation checkpoint	2023-10-24 16:13:52 +08:00
modeling_internlm.py	merge upstream	2023-10-25 14:46:45 +08:00
modeling_moe.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
moe.py	reset moe	2023-10-25 13:47:19 +08:00
multi_head_attention.py	feat(model/overlap_handler.py): refactor overlap hook handle	2023-10-20 21:50:32 +08:00
norm.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
overlap_handler.py	fix all-gather overlap the model_checkpoint is 0	2023-11-01 12:31:52 +08:00
utils.py	fix(optimizer/hybrid_zero_optim.py): add reduce_scatter_overlap switch	2023-10-31 20:40:58 +08:00