ytxiong 1d7e2d04ec fix(*)/all-reduce for norm in sequence parallel (#443) ... * fix all-reduce norm grad * change the order of dp and sp all-reduce * fix lint		2023-10-25 14:16:32 +08:00
..
__init__.py	fix(*)/all-reduce for norm in sequence parallel (#443)	2023-10-25 14:16:32 +08:00
parallel_context.py	fix(*)/all-reduce for norm in sequence parallel (#443)	2023-10-25 14:16:32 +08:00
process_group_initializer.py	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
random.py	initial commit	2023-07-06 12:55:23 +08:00