ColossalAI/colossalai/booster/plugin
Hongxin Liu 4de4e31818
[exampe] update llama example (#5626)
* [plugin] support dp inside for hybriad parallel

* [example] update llama benchmark

* [example] update llama benchmark

* [example] update llama readme

* [example] update llama readme
2024-04-23 14:12:20 +08:00
..
__init__.py
dp_plugin_base.py
gemini_plugin.py [exampe] update llama example (#5626) 2024-04-23 14:12:20 +08:00
hybrid_parallel_plugin.py [exampe] update llama example (#5626) 2024-04-23 14:12:20 +08:00
low_level_zero_plugin.py
moe_hybrid_parallel_plugin.py
plugin_base.py
pp_plugin_base.py
torch_ddp_plugin.py
torch_fsdp_plugin.py