Super Daniel
2edbef13cc
[fx] add more meta_registry for MetaTensor execution. ( #2000 )
...
* [sc] add examples for auto checkpoint.
* merge upstream
* [fx] add more meta_registry for MetaTensor execution.
2 years ago
Fazzie-Maqianli
b5dbb46172
[example] add diffusion inference ( #1986 )
2 years ago
mandoxzhang
52bd106627
add RoBERTa ( #1980 )
...
* update roberta
* update roberta & readme
* update roberta & readme
* update roberta & readme
2 years ago
Jiarui Fang
f7e276fa71
[Gemini] add GeminiAdamOptimizer ( #1960 )
2 years ago
Jiarui Fang
60abd86d6a
[example] enhance GPT demo ( #1959 )
...
* [example] enhence GPT demo
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2 years ago
Fazzie
a09f88ab07
update model download in README
2 years ago
Fazzie-Maqianli
6bdd0a90ca
update lightning version ( #1954 )
2 years ago
binmakeswell
9183e0dec5
[tutorial] polish all README ( #1946 )
2 years ago
Frank Lee
de56b563b9
[tutorial] added missing dummy dataloader ( #1944 )
2 years ago
Frank Lee
c6ea65011f
[tutorial] fixed pipeline bug for sequence parallel ( #1943 )
2 years ago
Jiarui Fang
cf68cc92ac
[example] add vit ( #1942 )
...
* [ColoTensor] ColoInitContext initialize parameters in shard mode.
* polish
* [example] add vit
2 years ago
YuliangLiu0306
c7925c5d08
[sc demo] add requirements to spmd README ( #1941 )
2 years ago
Boyuan Yao
d5f5e06d82
[SC] remove redundant hands on ( #1939 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
* [sc] modify auto checkpoint benchmark
* [sc] remove imgs
* [sc] remove redundant handson
2 years ago
binmakeswell
41868f7605
[tutorial] polish README and OPT files ( #1930 )
...
* [tutorial] polish README and OPT files
* [tutorial] polish README and OPT files
* [tutorial] polish README and OPT files
2 years ago
ver217
b0b7a786b7
[tutorial] add synthetic dataset for opt ( #1924 )
2 years ago
Frank Lee
0486048453
[tutorial] updated hybrid parallel readme ( #1928 )
...
* [tutorial] updated hybrid parallel readme
* polish code
2 years ago
Frank Lee
807cbdb87d
[tutorial] added synthetic data for sequence parallel ( #1927 )
...
* [tutorial] added synthetic data for sequence parallel
* polish code
2 years ago
Frank Lee
abf4c27f6a
[tutorial] removed huggingface model warning ( #1925 )
2 years ago
Frank Lee
d43a671ad6
Hotfix/tutorial readme index ( #1922 )
...
* [tutorial] removed tutorial index in readme
* [tutorial] removed tutorial index in readme
2 years ago
Boyuan Yao
24cbee0ebe
[tutorial] modify hands-on of auto activation checkpoint ( #1920 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
* [sc] modify auto checkpoint benchmark
* [sc] remove imgs
2 years ago
Frank Lee
ff16773ded
[tutorial] added synthetic data for hybrid parallel ( #1921 )
...
* [tutorial] added synthetic data for hybrid parallel
* polish code
2 years ago
Frank Lee
3c42fdbedc
[tutorial] added synthetic data for hybrid parallel ( #1919 )
2 years ago
Frank Lee
1b0dd05940
[tutorial] added synthetic dataset for auto parallel demo ( #1918 )
2 years ago
Frank Lee
acd9abc5ca
[tutorial] updated auto parallel demo with latest data path ( #1917 )
2 years ago
Frank Lee
d53415bc10
[tutorial] added data script and updated readme ( #1916 )
2 years ago
binmakeswell
155e202318
[example] update auto_parallel img path ( #1910 )
2 years ago
Boyuan Yao
d5c5bc219e
[SC] add GPT example for auto checkpoint ( #1889 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
2 years ago
binmakeswell
11ee8ae478
[tutorial] add cifar10 for diffusion ( #1907 )
2 years ago
Frank Lee
cb7ec714c8
[tutorial] removed duplicated tutorials ( #1904 )
2 years ago
Fazzie-Maqianli
351f0f64e6
[example] add cifar10 dadaset for diffusion ( #1902 )
...
* add cifar10 dadasets
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2 years ago
BoxiangW
ca6e75bc28
[tutorial] edited hands-on practices ( #1899 )
...
* Add handson to ColossalAI.
* Change names of handsons and edit sequence parallel example.
* Edit wrong folder name
* resolve conflict
* delete readme
2 years ago
BoxiangW
d9bf83e084
Add handson to ColossalAI. ( #1896 )
...
Co-authored-by: Boxiang Wang <boxiang.wang1@gmail.com>
2 years ago
Super Daniel
6d559ea614
[sc] add examples for auto checkpoint. ( #1880 )
2 years ago
HELSON
f9e7d179f2
[diffusion] fix package conflicts ( #1875 )
2 years ago
binmakeswell
610dda676c
[example] migrate diffusion and auto_parallel hands-on ( #1871 )
2 years ago
binmakeswell
50c4cb0167
[NFC] remove redundant dependency ( #1869 )
...
* remove redundant config
* remove redundant dependency
2 years ago
binmakeswell
fd8f0ca5a8
[example] initialize tutorial ( #1865 )
2 years ago
binmakeswell
e9635eb493
add explanation specified version
2 years ago
jiaruifang
27211d6267
[example] polish diffusion readme
2 years ago
binmakeswell
4ac7d3ec3b
[doc] polish diffusion README ( #1840 )
2 years ago
Jiarui Fang
f86a703bcf
[NFC] update gitignore remove DS_Store ( #1830 )
2 years ago
Jiarui Fang
a25f755331
[example] add TP to GPT example ( #1828 )
2 years ago
Fazzie-Maqianli
6e9730d7ab
[example] add stable diffuser ( #1825 )
2 years ago
Jiarui Fang
b1263d32ba
[example] simplify the GPT2 huggingface example ( #1826 )
2 years ago
Jiarui Fang
cd5a0d56fa
[Gemini] make gemini usage simple ( #1821 )
2 years ago
Maruyama_Aya
a7e8159da6
add ColoDiffusion codes: /ldm/module/, /ldm/data/, /scripts/test/
2 years ago
Jiarui Fang
350ccc0481
[example] opt does not depend on Titans ( #1811 )
2 years ago
Jiarui Fang
203ca57aed
[example] add GPT
2 years ago
Jiarui Fang
fd2c8d8156
[example] add opt model in lauguage ( #1809 )
2 years ago
Jiarui Fang
f5a92c288c
[example] add diffusion to example ( #1805 )
2 years ago