5 Commits (595bedf7678d1d157e7a8e8230e266ddf21a26d3)

Author	SHA1	Message	Date
Jiarui Fang	595bedf767	revert zero tensors back (#829)	2022-04-22 12:12:35 +08:00
Jiarui Fang	294a6060d0	[tensor] ZeRO use ColoTensor as the base class. (#828) ... * [refactor] moving InsertPostInitMethodToModuleSubClasses to utils. * [tensor] ZeRO use ColoTensor as the base class. * polish	2022-04-22 12:00:48 +08:00
HELSON	22c4b88d56	[zero] refactor ShardedParamV2 for convenience (#742)	2022-04-13 14:54:26 +08:00
Jiarui Fang	f552b11294	[zero] label state for param fp16 and grad (#551)	2022-03-30 15:57:46 +08:00
Jiarui Fang	214da761d4	[zero] add stateful tensor (#549)	2022-03-30 13:51:37 +08:00