github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero
History
Jiarui Fang c9e7d9582d [zero] polish shard strategy (#310) 
* init shard param from shape tuple

* add more unitest for shard param

* add set_payload method for ShardedParam

* [zero] add shareded tensor class

* polish code

* add shard stratgy

* move shard and gather logic to shard strategy from shard tensor.

* polish code
 		2022-03-11 15:50:28 +08:00
..
shard_utils [zero] polish shard strategy (#310) 2022-03-11 15:50:28 +08:00
sharded_model
…
sharded_optim
…
sharded_param [zero] polish shard strategy (#310) 2022-03-11 15:50:28 +08:00
__init__.py
…