ColossalAI

History

Jianghai a88e92251d [pipeline] add chatglm (#4363 ) * add pipeline policy and bert forward to be done * add bertmodel pipeline forward and make tests * add Bert_Policy and test for policy * update formatting * update formatting * update the code * fix bugs * fix name confilt * add bloom model and policy ,revise the base class of policy * revise * revision * add bert_for_pretraining * add bert_for_pretraining forward and policy * fix typos * cancel warning * change the imediate output to default dict * change the default output of get_shared_params * add chatglm * add * chatglm * chatglm * finish chatglm * deletes * fix rmsnorm * chatglm * fix chatglm shard * init		1 year ago
..
_C	[setup] support pre-build and jit-build of cuda kernels (#2374 )	2 years ago
_analyzer	[example] add train resnet/vit with booster example (#3694 )	2 years ago
amp	[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354 )	1 year ago
auto_parallel	[NFC] polish runtime_preparation_pass style (#4266 )	1 year ago
autochunk	fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808 )	2 years ago
booster	[shardformer] add util functions for shardformer tests/fix sync_shared_param (#4366 )	1 year ago
builder	[NFC] polish colossalai/builder/__init__.py code style (#1560 )	2 years ago
checkpoint_io	[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302 )	1 year ago
cli	fix localhost measurement (#4320 )	1 year ago
cluster	[cluster] add process group mesh (#4039 )	1 year ago
communication	[NFC] fix: format (#4270 )	1 year ago
context	[CI] fix some spelling errors (#3707 )	2 years ago
device	[format] applied code formatting on changed files in pull request 4152 (#4157 )	1 year ago
engine	[nfc]fix ColossalaiOptimizer is not defined (#4122 )	1 year ago
fx	[nfc] fix typo colossalai/cli fx kernel (#3847 )	2 years ago
interface	[pipeline] refactor 1f1b schedule (#4115 )	1 year ago
kernel	[coloattention] fix import error (#4380 )	1 year ago
lazy	[shardformer] support lazy init (#4202 )	1 year ago
logging	[logger] hotfix, missing _FORMAT (#2231 )	2 years ago
nn	[doc] add Series A Funding and NeurIPS news (#4377 )	1 year ago
pipeline	[pipeline] refactor test pipeline and remove useless utils in pipeline (#4324 )	1 year ago
registry	…
shardformer	[pipeline] add chatglm (#4363 )	1 year ago
tensor	[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354 )	1 year ago
testing	Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141 )	1 year ago
trainer	fix typo with colossalai/trainer utils zero (#3908 )	2 years ago
utils	[test] remove useless tests (#4359 )	1 year ago
zero	[hotfix] fix unsafe async comm in zero (#4404 )	1 year ago
__init__.py	[setup] supported conda-installed torch (#2048 )	2 years ago
constants.py	updated tp layers	2 years ago
core.py	…
global_variables.py	[NFC] polish colossalai/global_variables.py code style (#3259 )	2 years ago
initialize.py	[nfc] fix typo colossalai/zero (#3923 )	2 years ago