ColossalAI/examples/language
YuliangLiu0306 2731531bc2
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost
2023-01-11 14:03:49 +08:00
..
commons [example] make gpt example directory more clear (#2353) 2023-01-06 11:11:26 +08:00
gpt [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 2023-01-11 14:03:49 +08:00
opt [example] simplify opt example (#2344) 2023-01-06 10:08:41 +08:00
palm [examples] adding tflops to PaLM (#2365) 2023-01-10 16:18:56 +08:00
roberta [NFC] Update roberta/README.md (#2350) 2023-01-06 10:09:14 +08:00