binmakeswell
753035edd3
add Chinese README
3 years ago
1SAA
82023779bb
Added TPExpert for special situation
3 years ago
HELSON
36b8477228
Fixed parameter initialization in FFNExpert ( #251 )
3 years ago
アマデウス
e13293bb4c
fixed CI dataset directory; fixed import error of 2.5d accuracy ( #255 )
3 years ago
1SAA
219df6e685
Optimized MoE layer and fixed some bugs;
...
Decreased moe tests;
Added FFNExperts and ViTMoE model
3 years ago
zbian
3dba070580
fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial
3 years ago
ver217
24f8583cc4
update setup info ( #233 )
3 years ago
github-actions
b9f8521f8c
Automated submodule synchronization
3 years ago
Frank Lee
f5ca88ec97
fixed apex import ( #227 )
3 years ago
Frank Lee
eb3fda4c28
updated readme and change log ( #224 )
3 years ago
ver217
578ea0583b
update setup and workflow ( #222 )
3 years ago
Frank Lee
3a1a9820b0
fixed mkdir conflict and align yapf config with flake ( #220 )
3 years ago
Frank Lee
65e72983dc
added flake8 config ( #219 )
3 years ago
アマデウス
9ee197d0e9
moved env variables to global variables; ( #215 )
...
added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs
3 years ago
Frank Lee
b82d60be02
updated github action for develop branch ( #214 )
3 years ago
BoxiangW
7d15ec7fe2
Update github actions ( #205 )
3 years ago
github-actions[bot]
5420809f43
Automated submodule synchronization ( #203 )
...
Co-authored-by: github-actions <github-actions@github.com>
3 years ago
Frank Lee
fd570ab285
add changelog and contributing doc ( #202 )
3 years ago
Frank Lee
02f13fa9d1
add code quality badge ( #201 )
3 years ago
Frank Lee
812357d63c
fixed utils docstring and add example to readme ( #200 )
3 years ago
Frank Lee
b9a761b9b8
added github action to synchronize submodule commits automatically ( #193 )
3 years ago
BoxiangW
a2f1565672
Update GitHub action and pre-commit settings ( #196 )
...
* Update GitHub action and pre-commit settings
* Update GitHub action and pre-commit settings (#198 )
3 years ago
Frank Lee
765db512b5
fixed ddp bug on torch 1.8 ( #194 )
3 years ago
Jiarui Fang
569357fea0
add pytorch hooks ( #179 )
...
* add pytorch hooks
fix #175
* remove licenses in src code
* add gpu memory tracer
* replacing print with logger in ophooks.
3 years ago
ver217
708404d5f8
fix pipeline forward return tensors ( #176 )
3 years ago
WANG-CR
6fb550acdb
update logo
3 years ago
HELSON
0f8c7f9804
Fixed docstring in colossalai ( #171 )
3 years ago
Frank Lee
e2089c5c15
adapted for sequence parallel ( #163 )
3 years ago
Frank Lee
a2e649da39
update readme ( #168 )
3 years ago
Frank Lee
9684bdce5c
fixed submodule url ( #167 )
...
* added examples as submodule
* update submodule url
3 years ago
BoxiangW
bd4840f1f1
Update workflow files and README.md ( #166 )
3 years ago
ver217
1949d3a889
update doc requirements and rtd conf ( #165 )
3 years ago
Frank Lee
be85a0f366
removed tutorial markdown and refreshed rst files for consistency
3 years ago
Frank Lee
ca4ae52d6b
Set examples as submodule ( #162 )
...
* remove examples folder
* added examples as submodule
* update .gitmodules
3 years ago
binmakeswell
17ce8569a8
add logo at homepage, add forum in issue template ( #161 )
3 years ago
puck_WCR
9473a1b9c8
AMP docstring/markdown update ( #160 )
3 years ago
Frank Lee
2499faa2db
update benchmark commit id ( #159 )
3 years ago
LuGY_mac
d143396cac
Added rand augment and update the dataloader
3 years ago
Frank Lee
c7b8ece736
set benchmarks as a git submodule ( #156 )
...
* remove benchmark folder
* added benchmark submodule
* update .gitmodules
3 years ago
Frank Lee
f3802d6b06
fixed jit default setting ( #154 )
3 years ago
Frank Lee
a1da3900c8
added docker documentation ( #152 )
3 years ago
ver217
7bf1e98b97
pipeline last stage supports multi output ( #151 )
3 years ago
HELSON
1ff5be36c2
Added moe parallel example ( #140 )
3 years ago
ver217
f68eddfb3d
refactor kernel ( #142 )
3 years ago
BoxiangW
4a3d3446b0
Update layer integration documentations ( #108 )
...
Update the documentations of layer integration
Update _log_hook.py
Update _operation.py
3 years ago
binmakeswell
3a61d785b5
add doc issue template ( #133 )
3 years ago
ver217
9ef05ed1fc
try import deepspeed when using zero ( #130 )
3 years ago
ver217
b7975d2bcd
add workflow for deploying doc ( #129 )
3 years ago
HELSON
dceae85195
Added MoE parallel ( #127 )
3 years ago
Frank Lee
42741dd4a3
added docker image ( #126 )
3 years ago