flybird11111 de8a65babc [shardformer] opt fix. (#4514) ... * [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel * fix fix fix fix * [shardformer] jit fused fix * [shardformer] jit fused fix * [shardformer] jit fused fix * [shardformer] jit fused fix * [shardformer] jit fused fix * [shardformer] jit fused fix * [shardformer] jit fused fix * activate checks * [Test] test ci * test ci * test ci * test ci * test ci * test ci * test ci * fix		2023-08-25 19:41:24 +08:00
..
_C	…
_analyzer	…
amp	[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354)	2023-08-15 23:25:14 +08:00
auto_parallel	[NFC] polish runtime_preparation_pass style (#4266)	2023-07-26 14:12:57 +08:00
autochunk	fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)	2023-05-24 09:01:50 +08:00
booster	[shardformer] support tp+zero for shardformer (#4472)	2023-08-21 12:04:52 +08:00
builder	…
checkpoint_io	[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)	2023-07-21 14:39:01 +08:00
cli	fix localhost measurement (#4320)	2023-08-01 10:14:00 +08:00
cluster	[shardformer] support interleaved pipeline (#4448)	2023-08-16 19:29:03 +08:00
communication	[NFC] fix: format (#4270)	2023-07-26 14:12:57 +08:00
context	…
device	[format] applied code formatting on changed files in pull request 4152 (#4157)	2023-07-04 16:07:47 +08:00
engine	[nfc]fix ColossalaiOptimizer is not defined (#4122)	2023-06-30 17:23:22 +08:00
fx	[nfc] fix typo colossalai/cli fx kernel (#3847)	2023-06-02 15:02:45 +08:00
interface	[pipeline] refactor 1f1b schedule (#4115)	2023-08-15 23:25:14 +08:00
kernel	[shardformer] update shardformer to use flash attention 2 (#4392)	2023-08-15 23:25:14 +08:00
lazy	[shardformer] support lazy init (#4202)	2023-08-15 23:25:14 +08:00
logging	…
nn	[doc] add Series A Funding and NeurIPS news (#4377)	2023-08-04 17:42:07 +08:00
pipeline	[shardformer] support interleaved pipeline (#4448)	2023-08-16 19:29:03 +08:00
registry	…
shardformer	[shardformer] opt fix. (#4514)	2023-08-25 19:41:24 +08:00
tensor	[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354)	2023-08-15 23:25:14 +08:00
testing	Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141)	2023-07-07 16:33:06 +08:00
trainer	fix typo with colossalai/trainer utils zero (#3908)	2023-06-07 16:08:37 +08:00
utils	[test] remove useless tests (#4359)	2023-08-01 18:52:14 +08:00
zero	[hotfix] fix unsafe async comm in zero (#4404)	2023-08-11 15:09:24 +08:00
__init__.py	…
constants.py	…
core.py	…
global_variables.py	…
initialize.py	[nfc] fix typo colossalai/zero (#3923)	2023-06-08 00:01:29 +08:00