InternLM

Author	SHA1	Message	Date
huangting4201	b3def4c162	fix(optimizer/hybrid_zero_optim.py): add reduce_scatter_overlap switch	2023-10-31 20:40:58 +08:00
mwiacx	4c1cd5d49b	fix async reduce scatter	2023-10-31 19:39:24 +08:00
huangting4201	3778c66660	feat(model/overlap_handler.py): fix overlap hander to support pp(non-interleaved)	2023-10-27 20:04:23 +08:00
yingtongxiong	cc20fa271a	reset print memory	2023-10-25 16:48:02 +08:00
yingtongxiong	363275b500	add memory print	2023-10-25 14:31:00 +08:00
huangting4201	41cfa1a10a	feat(model/overlap_handler.py): fix overlap handler None bug	2023-10-24 18:47:27 +08:00
huangting4201	5d8313693b	feat(model/overlap_handler.py): fix head post backward hook when activation	2023-10-24 17:29:09 +08:00
yingtongxiong	97dcefc389	support model activation checkpoint	2023-10-24 16:13:52 +08:00
huangting4201	03cc7f9b80	feat(model/overlap_handler.py): fix lint error	2023-10-23 15:28:34 +08:00
huangting4201	0d693cf3a1	feat(model/overlap_handler.py): fix lint error	2023-10-23 15:22:03 +08:00
yingtongxiong	f6a5086fe4	support bias	2023-10-23 14:51:27 +08:00
huangting4201	e7f9f1d208	feat(model/overlap_handler.py): optimize reduce scatter mem pool	2023-10-23 13:31:23 +08:00
huangting4201	b20f47a1fe	feat(model/overlap_handler.py): move handler to gpc	2023-10-23 12:02:32 +08:00
huangting4201	85ad917ae4	feat(model/overlap_handler.py): refactor overlap hook handle	2023-10-20 21:50:32 +08:00