4 Commits (294a6060d003b7767da4e382f7b8dea7b83d6b6b)

Author	SHA1	Message	Date
Jiarui Fang	294a6060d0	[tensor] ZeRO use ColoTensor as the base class. (#828) ... * [refactor] moving InsertPostInitMethodToModuleSubClasses to utils. * [tensor] ZeRO use ColoTensor as the base class. * polish	2022-04-22 12:00:48 +08:00
HELSON	22c4b88d56	[zero] refactor ShardedParamV2 for convenience (#742)	2022-04-13 14:54:26 +08:00
Jiarui Fang	f552b11294	[zero] label state for param fp16 and grad (#551)	2022-03-30 15:57:46 +08:00
Jiarui Fang	214da761d4	[zero] add stateful tensor (#549)	2022-03-30 13:51:37 +08:00