ColossalAI/colossalai/zero
HELSON a7d95b7024
[example] add zero1, zero2 example in GPT examples (#2146)
* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme
2022-12-20 14:30:27 +08:00
..
init_ctx
shard_utils
sharded_model [Gemini] update API of the chunkmemstatscollector. (#2129) 2022-12-14 00:47:06 +08:00
sharded_optim [example] add zero1, zero2 example in GPT examples (#2146) 2022-12-20 14:30:27 +08:00
sharded_param
utils [Gemini] update API of the chunkmemstatscollector. (#2129) 2022-12-14 00:47:06 +08:00
__init__.py [Gemini] add GeminiAdamOptimizer (#1960) 2022-11-16 14:44:28 +08:00