ColossalAI/colossalai/auto_parallel/offload
Zihao 18dbe76cae
[auto-parallel] add auto-offload feature (#3154)
* add auto-offload feature

* polish code

* fix syn offload runtime pass bug

* add offload example

* fix offload testing bug

* fix example testing bug
2023-03-21 14:17:41 +08:00
..
__init__.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
amp_optimizer.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
base_offload_module.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
mem_optimize.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
region.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
region_manager.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
runtime.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
solver.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
training_simulator.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00
util.py [auto-parallel] add auto-offload feature (#3154) 2023-03-21 14:17:41 +08:00