ColossalAI

Author	SHA1	Message	Date
ver217	fc8e6db005	[doc] Update docstring for ZeRO (#459 ) * polish sharded model docstr * polish sharded optim docstr * polish zero docstr * polish shard strategy docstr	2022-03-18 16:48:20 +08:00
ver217	a241f61b34	[zero] Update initialize for ZeRO (#458 ) * polish code * shard strategy receive pg in shard() / gather() * update zero engine * polish code	2022-03-18 16:18:31 +08:00
Jiarui Fang	0fcfb1e00d	[test] make zero engine test really work (#447 )	2022-03-17 17:24:25 +08:00
ver217	63469c0f91	polish code	2022-03-14 15:48:55 +08:00
ver217	88804aee49	add bucket tensor shard strategy	2022-03-14 14:48:32 +08:00