9 Commits (b6696beb049b29af5d9bf43923d0cfd58511383b)

Author	SHA1	Message	Date
littsk	be82b5d4ca	[hotfix] Fix the bug where process groups were not being properly released. (#4940) ... * Fix the bug where process groups were not being properly released. * test * Revert "test" This reverts commit 479900c139.	2023-10-31 14:47:30 +08:00
Baizhou Zhang	a2db75546d	[doc] polish shardformer doc (#4779) ... * fix example format in docstring * polish shardformer doc	2023-09-26 10:57:47 +08:00
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	2023-09-19 14:20:26 +08:00
LuGY	a78daf6180	[shardformer] support interleaved pipeline (#4448) ... * support interleaved pipeline * fix unit test * remove virtual stage test in stage mgr * add droped type hint and updated bwd	2023-08-16 19:29:03 +08:00
Hongxin Liu	5e1a9d48dd	[cluster] add process group mesh (#4039) ... * [cluster] add process group mesh * [test] add process group mesh test * force sync	2023-08-15 23:25:14 +08:00
digger yu	7f8203af69	fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)	2023-05-24 09:01:50 +08:00
Frank Lee	73d3e4d309	[booster] implemented the torch ddd + resnet example (#3232) ... * [booster] implemented the torch ddd + resnet example * polish code	2023-03-27 10:24:14 +08:00
YuliangLiu0306	4d5d8f98a4	[API] implement device mesh manager (#3221) ... * [API] implement device mesh manager * polish	2023-03-24 13:39:12 +08:00
Frank Lee	e3ad88fb48	[booster] implemented the cluster module (#3191) ... * [booster] implemented the cluster module * polish code	2023-03-22 14:11:54 +08:00