github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/booster/plugin
History
flybird11111 cabc1286ca
[LowLevelZero] low level zero support lora (#5153) 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
 		2023-12-21 17:01:01 +08:00
..
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
dp_plugin_base.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
gemini_plugin.py [lora] add lora APIs for booster, support lora for TorchDDP (#4981) 2023-10-31 15:19:37 +08:00
hybrid_parallel_plugin.py [lora] add lora APIs for booster, support lora for TorchDDP (#4981) 2023-10-31 15:19:37 +08:00
low_level_zero_plugin.py [LowLevelZero] low level zero support lora (#5153) 2023-12-21 17:01:01 +08:00
plugin_base.py [lora] add lora APIs for booster, support lora for TorchDDP (#4981) 2023-10-31 15:19:37 +08:00
pp_plugin_base.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
torch_ddp_plugin.py [lora] add lora APIs for booster, support lora for TorchDDP (#4981) 2023-10-31 15:19:37 +08:00
torch_fsdp_plugin.py [lora] add lora APIs for booster, support lora for TorchDDP (#4981) 2023-10-31 15:19:37 +08:00