InternLM/internlm/solver
ytxiong 1d7e2d04ec
fix(*)/all-reduce for norm in sequence parallel (#443)
* fix all-reduce norm grad

* change the order of dp and sp all-reduce

* fix lint
2023-10-25 14:16:32 +08:00
..
optimizer fix(*)/all-reduce for norm in sequence parallel (#443) 2023-10-25 14:16:32 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00
beta2_scheduler.py initial commit 2023-07-06 12:55:23 +08:00
lr_scheduler.py feat(solver): fix code to adapt to torch2.0 and provide docker images (#128) 2023-07-25 19:34:52 +08:00
pipeline_utils.py initial commit 2023-07-06 12:55:23 +08:00