InternLM/internlm/solver/optimizer
huangting4201 9a731b6e9b
fix(optimizer/fsdp_optimizer.py): fsdp process empty params group (#408)
Co-authored-by: huangting4201 <huangting3@sensetime.com>
2023-10-10 20:06:04 +08:00
..
__init__.py feat(train): add fsdp training option (#293) 2023-10-09 18:59:31 +08:00
base_optimizer.py feat(train): add fsdp training option (#293) 2023-10-09 18:59:31 +08:00
fsdp_optimizer.py fix(optimizer/fsdp_optimizer.py): fsdp process empty params group (#408) 2023-10-10 20:06:04 +08:00
hybrid_zero_optim.py feat(train): add fsdp training option (#293) 2023-10-09 18:59:31 +08:00
store.py feat(moe):support zero for expert local dp (#404) 2023-10-09 17:45:26 +08:00
utils.py feat(moe):support zero for expert local dp (#404) 2023-10-09 17:45:26 +08:00