ColossalAI/examples/language/gpt/experiments
Zihao 18dbe76cae
[auto-parallel] add auto-offload feature (#3154)
* add auto-offload feature

* polish code

* fix syn offload runtime pass bug

* add offload example

* fix offload testing bug

* fix example testing bug
2023-03-21 14:17:41 +08:00
..
auto_offload [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
auto_parallel [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 2023-01-11 14:03:49 +08:00
pipeline_parallel [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00