superhao1995
|
c1bed0d998
|
[NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_lamb.cu code stype (#628)
|
3 years ago |
Jiang Zhuo
|
0a96338b13
|
[NFC] polish <colossalai/context/process_group_initializer/initializer_data.py> code stype (#626)
Co-authored-by: 姜卓 <jiangzhuo@jiangzhuodeMacBook-Pro.local>
|
3 years ago |
ziyu huang
|
701bad439b
|
[NFC] polish colossalai/context/process_group_initializer/process_group_initializer.py code stype (#617)
Co-authored-by: “Arsmart123 <202476410arsmart@gmail.com>
|
3 years ago |
Shawn-Kong
|
db54419409
|
fix format (#613)
Co-authored-by: evin K <evink@evins-MacBook-Air.local>
|
3 years ago |
Yuer867
|
5ecef13c16
|
fix format (#611)
|
3 years ago |
xyupeng
|
d3d5bedc65
|
fix format (#607)
|
3 years ago |
xuqifan897
|
f2d2a1597a
|
fix format (#608)
|
3 years ago |
doubleHU
|
f2da21a827
|
fix format (#586)
|
3 years ago |
fanjinfucool
|
ffad81e1d1
|
fix format (#585)
Co-authored-by: fanjifu <FAN>
|
3 years ago |
binmakeswell
|
6582aedc94
|
fix format (#583)
|
3 years ago |
DouJS
|
f08fc17f2b
|
block_reduce.h fix format (#581)
|
3 years ago |
Maruyama_Aya
|
d2dc6049b5
|
fix format (#580)
|
3 years ago |
wky
|
174b9c1d85
|
fix format (#574)
|
3 years ago |
BoxiangW
|
dfe423ae42
|
fix format (#572)
|
3 years ago |
yuxuan-lou
|
cfb41297ff
|
'fix/format' (#573)
|
3 years ago |
Kai Wang (Victor Kai)
|
b0f708dfc1
|
fix format (#570)
|
3 years ago |
Xu Kai
|
2a915a8b62
|
fix format (#568)
|
3 years ago |
YuliangLiu0306
|
9420d3ae31
|
fix format (#567)
|
3 years ago |
Jie Zhu
|
0f1da44e5e
|
[format]colossalai/kernel/cuda_native/csrc/layer_norm_cuda.cpp (#566)
|
3 years ago |
coder-chin
|
5835631218
|
fix format (#564)
|
3 years ago |
Luxios22
|
e014144c44
|
fix format (#565)
|
3 years ago |
Ziyue Jiang
|
1762ba14ab
|
fix format (#563)
|
3 years ago |
Sze-qq
|
ce8a3eae5b
|
update GPT-2 experiment result (#666)
|
3 years ago |
HELSON
|
17e73e62cc
|
[hotfix] fix bugs for unsharded parameters when restore data (#664)
|
3 years ago |
Jiarui Fang
|
0aab52301e
|
[hotfix] fix a bug in model data stats tracing (#655)
|
3 years ago |
YuliangLiu0306
|
ade05a5d83
|
[refactor] pipeline, put runtime schedule into engine. (#627)
|
3 years ago |
HELSON
|
e5d615aeee
|
[hotfix] fix bugs in testing (#659)
* remove hybrid adam in test_moe_zero_optim
* fix activation checkpointing and its unitest
|
3 years ago |
Jiarui Fang
|
036404ca8a
|
Revert "[zero] polish init context (#645)" (#657)
|
3 years ago |
HELSON
|
b31daed4cf
|
fix bugs in CPU adam (#633)
* add cpu adam counter for all cpu adam
* fixed updating error in adam kernel
|
3 years ago |
LuGY
|
1e2557e801
|
[zero] fixed the activation offload (#647)
* fixed the activation offload
* polish
|
3 years ago |
Liang Bowen
|
828e465622
|
[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)
|
3 years ago |
binmakeswell
|
e0f875a8e2
|
[GitHub] Add prefix and label in issue template (#652)
|
3 years ago |
Jiarui Fang
|
67b4928244
|
[zero] polish init context (#645)
|
3 years ago |
ver217
|
f5d3a9c2b0
|
polish checkpoint docstring (#637)
|
3 years ago |
HELSON
|
055fbf5be6
|
[zero] adapt zero for unsharded paramters (Optimizer part) (#601)
|
3 years ago |
KAIYUAN GAN
|
229382c844
|
[NFC] polish colossalai/kernel/cuda_native/csrc/kernels/cuda_util.cu code stype (#625)
|
3 years ago |
アマデウス
|
354b7954d1
|
[model checkpoint] added unit tests for checkpoint save/load (#599)
|
3 years ago |
アマデウス
|
28b515d610
|
[model checkpoint] updated checkpoint hook (#598)
|
3 years ago |
アマデウス
|
77ad24bf94
|
[model checkpoint] updated saving/loading for 3d layers (#597)
|
3 years ago |
アマデウス
|
93089ed708
|
[model checkpoint] updated saving/loading for 2.5d layers (#596)
|
3 years ago |
アマデウス
|
6302069c0e
|
[model checkpoint] updated communication ops for cpu tensors (#590)
|
3 years ago |
アマデウス
|
c50bfb807b
|
[model checkpoint] updated saving/loading for 1d layers (#594)
|
3 years ago |
アマデウス
|
7636d518e1
|
[model checkpoint] updated saving/loading for 2d layers (#595)
|
3 years ago |
アマデウス
|
cd13b63832
|
[model checkpoint] reworked unified layers for ease of save/load states (#593)
|
3 years ago |
アマデウス
|
acae68eb04
|
[model checkpoint] updated checkpoint save/load utils (#592)
|
3 years ago |
Ziyue Jiang
|
1c40ee8749
|
[TP] add assert for tp1d (#621)
|
3 years ago |
ver217
|
369a288bf3
|
polish utils docstring (#620)
|
3 years ago |
ver217
|
e619a651fb
|
polish optimizer docstring (#619)
|
3 years ago |
ver217
|
8432dc7080
|
polish moe docsrting (#618)
|
3 years ago |
ver217
|
c5b488edf8
|
polish amp docstring (#616)
|
3 years ago |