ColossalAI/examples/language
HELSON a7d95b7024
[example] add zero1, zero2 example in GPT examples (#2146)
* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme
2022-12-20 14:30:27 +08:00
..
gpt [example] add zero1, zero2 example in GPT examples (#2146) 2022-12-20 14:30:27 +08:00
opt [Gemini] add GeminiAdamOptimizer (#1960) 2022-11-16 14:44:28 +08:00
roberta add RoBERTa (#1980) 2022-11-18 14:04:49 +08:00