ColossalAI

History

Hongxin Liu b90835bd32 [checkpointio] fix performance issue (#6139 )		1 week ago
..
_C	Clean up	6 months ago
_analyzer	[test] Fix/fix testcase (#5770 )	6 months ago
accelerator	[misc] fit torch api upgradation and remove legecy import (#6093 )	1 month ago
amp	[plugin] support get_grad_norm (#6115 )	3 weeks ago
auto_parallel	[pre-commit.ci] pre-commit autoupdate (#5572 )	5 months ago
autochunk	[hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606 )	7 months ago
booster	[ckpt] Add async ckpt api (#6136 )	1 week ago
checkpoint_io	[checkpointio] fix performance issue (#6139 )	1 week ago
cli	[cli] support run as module option (#6135 )	2 weeks ago
cluster	[FP8] rebase main (#5963 )	4 months ago
context	[Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625 )	7 months ago
device	[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694 )	7 months ago
fx	[test] Fix/fix testcase (#5770 )	6 months ago
inference	[shardformer] fix linear 1d row and support uneven splits for fused qkv linear (#6084 )	2 months ago
interface	[plugin] support get_grad_norm (#6115 )	3 weeks ago
kernel	[misc] fit torch api upgradation and remove legecy import (#6093 )	1 month ago
lazy	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016 )	3 months ago
legacy	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016 )	3 months ago
logging	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016 )	3 months ago
moe	[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048 )	3 months ago
nn	[misc] fix dist logger (#5782 )	6 months ago
pipeline	[misc] fit torch api upgradation and remove legecy import (#6093 )	1 month ago
quantization	[fp8] add fallback and make compile option configurable (#6092 )	1 month ago
shardformer	[hotfix] fix flash attn window_size err (#6132 )	2 weeks ago
tensor	[fp8] support fp8 amp for hybrid parallel plugin (#5975 )	4 months ago
testing	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016 )	3 months ago
utils	[ckpt] Add async ckpt api (#6136 )	1 week ago
zero	[fix] multi-node backward slowdown (#6134 )	2 weeks ago
__init__.py	[devops] remove post commit ci (#5566 )	8 months ago
initialize.py	[fp8] hotfix backward hook (#6053 )	3 months ago