Edenzzzz 5f8c0a0ac3 [Feature] auto-cast optimizers to distributed version (#5746) ... * auto-cast optimizers to distributed * fix galore casting * logger --------- Co-authored-by: Edenzzzz <wtan45@wisc.edu>		2024-05-24 17:24:16 +08:00
..
test_hybrid_parallel_grad_clip_norm	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_layer	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_model	[Feature] auto-cast optimizers to distributed version (#5746)	2024-05-24 17:24:16 +08:00
__init__.py	[shardformer] adapted T5 and LLaMa test to use kit (#4049)	2023-07-04 16:05:01 +08:00
test_flash_attention.py	[coloattention]modify coloattention (#5627)	2024-04-25 10:47:14 +08:00
test_shard_utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_with_torch_ddp.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00