Commit Graph

432 Commits (7db3ccc79b388d40fd93beb5908471e5910650ff)
 

Author SHA1 Message Date
superhao1995 c1bed0d998 [NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu code stype (#628)
3 years ago
Jiang Zhuo 0a96338b13 [NFC] polish <colossalai/context/process_group_initializer/initializer_data.py> code stype (#626)
3 years ago
ziyu huang 701bad439b [NFC] polish colossalai/context/process_group_initializer/process_group_initializer.py code stype (#617)
3 years ago
Shawn-Kong db54419409 fix format (#613)
3 years ago
Yuer867 5ecef13c16 fix format (#611)
3 years ago
xyupeng d3d5bedc65 fix format (#607)
3 years ago
xuqifan897 f2d2a1597a fix format (#608)
3 years ago
doubleHU f2da21a827 fix format (#586)
3 years ago
fanjinfucool ffad81e1d1 fix format (#585)
3 years ago
binmakeswell 6582aedc94 fix format (#583)
3 years ago
DouJS f08fc17f2b block_reduce.h fix format (#581)
3 years ago
Maruyama_Aya d2dc6049b5 fix format (#580)
3 years ago
wky 174b9c1d85 fix format (#574)
3 years ago
BoxiangW dfe423ae42 fix format (#572)
3 years ago
yuxuan-lou cfb41297ff 'fix/format' (#573)
3 years ago
Kai Wang (Victor Kai) b0f708dfc1 fix format (#570)
3 years ago
Xu Kai 2a915a8b62 fix format (#568)
3 years ago
YuliangLiu0306 9420d3ae31 fix format (#567)
3 years ago
Jie Zhu 0f1da44e5e [format]colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp (#566)
3 years ago
coder-chin 5835631218 fix format (#564)
3 years ago
Luxios22 e014144c44 fix format (#565)
3 years ago
Ziyue Jiang 1762ba14ab fix format (#563)
3 years ago
Sze-qq ce8a3eae5b
update GPT-2 experiment result (#666)
3 years ago
HELSON 17e73e62cc
[hotfix] fix bugs for unsharded parameters when restore data (#664)
3 years ago
Jiarui Fang 0aab52301e
[hotfix] fix a bug in model data stats tracing (#655)
3 years ago
YuliangLiu0306 ade05a5d83
[refactor] pipeline, put runtime schedule into engine. (#627)
3 years ago
HELSON e5d615aeee
[hotfix] fix bugs in testing (#659)
3 years ago
Jiarui Fang 036404ca8a
Revert "[zero] polish init context (#645)" (#657)
3 years ago
HELSON b31daed4cf
fix bugs in CPU adam (#633)
3 years ago
LuGY 1e2557e801
[zero] fixed the activation offload (#647)
3 years ago
Liang Bowen 828e465622
[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)
3 years ago
binmakeswell e0f875a8e2
[GitHub] Add prefix and label in issue template (#652)
3 years ago
Jiarui Fang 67b4928244
[zero] polish init context (#645)
3 years ago
ver217 f5d3a9c2b0
polish checkpoint docstring (#637)
3 years ago
HELSON 055fbf5be6
[zero] adapt zero for unsharded paramters (Optimizer part) (#601)
3 years ago
KAIYUAN GAN 229382c844
[NFC] polish colossalai/kernel/cuda_native/csrc/kernels/cuda_util.cu code stype (#625)
3 years ago
アマデウス 354b7954d1
[model checkpoint] added unit tests for checkpoint save/load (#599)
3 years ago
アマデウス 28b515d610
[model checkpoint] updated checkpoint hook (#598)
3 years ago
アマデウス 77ad24bf94
[model checkpoint] updated saving/loading for 3d layers (#597)
3 years ago
アマデウス 93089ed708
[model checkpoint] updated saving/loading for 2.5d layers (#596)
3 years ago
アマデウス 6302069c0e
[model checkpoint] updated communication ops for cpu tensors (#590)
3 years ago
アマデウス c50bfb807b
[model checkpoint] updated saving/loading for 1d layers (#594)
3 years ago
アマデウス 7636d518e1
[model checkpoint] updated saving/loading for 2d layers (#595)
3 years ago
アマデウス cd13b63832
[model checkpoint] reworked unified layers for ease of save/load states (#593)
3 years ago
アマデウス acae68eb04
[model checkpoint] updated checkpoint save/load utils (#592)
3 years ago
Ziyue Jiang 1c40ee8749
[TP] add assert for tp1d (#621)
3 years ago
ver217 369a288bf3
polish utils docstring (#620)
3 years ago
ver217 e619a651fb
polish optimizer docstring (#619)
3 years ago
ver217 8432dc7080
polish moe docsrting (#618)
3 years ago
ver217 c5b488edf8
polish amp docstring (#616)
3 years ago