ColossalAI

History

Bin Jia c554b7f559 [shardformer/fix overlap bug] fix overlap bug, add overlap as an option in shardco… (#4516 ) * fix overlap bug and support bert, add overlap as an option in shardconfig * support overlap for chatglm and bloom		1 year ago
..
_C	…
_analyzer	…
amp	[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354 )	1 year ago
auto_parallel	[NFC] polish runtime_preparation_pass style (#4266 )	1 year ago
autochunk	…
booster	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506 )	1 year ago
builder	…
checkpoint_io	[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506 )	1 year ago
cli	fix localhost measurement (#4320 )	1 year ago
cluster	[shardformer] support interleaved pipeline (#4448 )	1 year ago
communication	[NFC] fix: format (#4270 )	1 year ago
context	…
device	[format] applied code formatting on changed files in pull request 4152 (#4157 )	1 year ago
engine	…
fx	…
interface	[pipeline] refactor 1f1b schedule (#4115 )	1 year ago
kernel	[shardformer] update shardformer to use flash attention 2 (#4392 )	1 year ago
lazy	[shardformer] support lazy init (#4202 )	1 year ago
logging	…
nn	[doc] add Series A Funding and NeurIPS news (#4377 )	1 year ago
pipeline	[shardformer] zero1+pp and the corresponding tests (#4517 )	1 year ago
registry	…
shardformer	[shardformer/fix overlap bug] fix overlap bug, add overlap as an option in shardco… (#4516 )	1 year ago
tensor	[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354 )	1 year ago
testing	Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141 )	1 year ago
trainer	…
utils	[test] remove useless tests (#4359 )	1 year ago
zero	[shardformer] zero1+pp and the corresponding tests (#4517 )	1 year ago
__init__.py	…
constants.py	…
core.py	…
global_variables.py	…
initialize.py	…