Baizhou Zhang 14b0d4c7e5 [lora] add lora APIs for booster, support lora for TorchDDP (#4981) ... * add apis and peft requirement * add liscense and implement apis * add checkpointio apis * add torchddp fwd_bwd test * add support_lora methods * add checkpointio test and debug * delete unneeded codes * remove peft from LICENSE * add concrete methods for enable_lora * simplify enable_lora api * fix requirements		2024-04-28 10:51:27 +08:00
..
__init__.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
dp_plugin_base.py	[llama] fix dataloader for hybrid parallel (#5358)	2024-02-05 15:14:56 +08:00
gemini_plugin.py	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00
hybrid_parallel_plugin.py	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00
low_level_zero_plugin.py	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00
moe_hybrid_parallel_plugin.py	[shardformer] Sequence Parallelism Optimization (#5533)	2024-04-03 17:15:47 +08:00
plugin_base.py	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00
pp_plugin_base.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
torch_ddp_plugin.py	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00
torch_fsdp_plugin.py	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00