ColossalAI

Author	SHA1	Message	Date
Jiarui Fang	0fcfb1e00d	[test] make zero engine test really work (#447 )	2022-03-17 17:24:25 +08:00
HELSON	7c079d9c33	[hotfix] fixed bugs in ShardStrategy and PcieProfiler (#394 )	2022-03-11 18:12:46 +08:00
Jiarui Fang	44e4891f57	[zero] able to place params on cpu after zero init context (#365 ) * place params on cpu after zero init context * polish code	2022-03-11 15:50:28 +08:00
ver217	1388671699	[zero] Update sharded model v2 using sharded param v2 (#323 )	2022-03-11 15:50:28 +08:00
Jiarui Fang	c9e7d9582d	[zero] polish shard strategy (#310 ) * init shard param from shape tuple * add more unitest for shard param * add set_payload method for ShardedParam * [zero] add shareded tensor class * polish code * add shard stratgy * move shard and gather logic to shard strategy from shard tensor. * polish code	2022-03-11 15:50:28 +08:00
Jiarui Fang	74f77e314b	[zero] a shard strategy in granularity of tensor (#307 )	2022-03-11 15:50:28 +08:00