ColossalAI/tests/test_optimizer
flybird11111 0688d92e2d
[shardformer]Fix lm parallel. (#5480)
* fix

* padding vocab_size when using pipeline parallellism

padding vocab_size when using pipeline parallellism

fix

fix

* fix

* fix

fix

fix

* fix gather output

* fix

* fix

* fix

fix resize embedding

fix resize embedding

* fix resize embedding

fix

* revert

* revert

* revert

* fix lm forward distribution

* fix

* test ci

* fix
2024-03-25 17:21:51 +08:00
..
test_adam_kernel.py [feat] refactored extension module (#5298) 2024-01-25 17:01:48 +08:00
test_adam_optim.py [kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921) 2023-10-16 21:56:53 +08:00
test_lr_scheduler.py [lr-scheduler] fix load state dict and add test (#5369) 2024-02-06 14:23:32 +08:00
test_nvme.py [shardformer]Fix lm parallel. (#5480) 2024-03-25 17:21:51 +08:00