HELSON
31fe84237b
[example] fix benchmark.sh for gpt example ( #2229 )
2 years ago
Jiarui Fang
2cdecc9f38
[example] make palm + GeminiDPP work ( #2227 )
2 years ago
ZijianYY
63cc77173b
[example] Palm adding gemini, still has bugs ( #2221 )
2 years ago
HELSON
7010e18134
[example] update gpt example ( #2225 )
2 years ago
Jiarui Fang
49c601da21
[example] add benchmark.sh for gpt ( #2226 )
2 years ago
HELSON
3629e611cd
[example] update gpt benchmark ( #2219 )
2 years ago
ZijianYY
92de90dfb3
[examples] replace einsum with matmul ( #2210 )
2 years ago
Jiarui Fang
7675792100
[builder] raise Error when CUDA_HOME is not set ( #2213 )
2 years ago
HELSON
78a89d9b41
[diffusion] update readme ( #2214 )
2 years ago
Jiarui Fang
d96cc37e32
[example] update GPT example benchmark results ( #2212 )
2 years ago
Jiarui Fang
d5e3e3ec01
[example] update gpt example for larger model scale ( #2211 )
2 years ago
Jiarui Fang
29868a9ec1
[example] update gpt readme with performance ( #2206 )
2 years ago
BlueRum
6642cebdbe
[example] Change some training settings for diffusion ( #2195 )
2 years ago
ziyuhuang123
4363ff3e41
'[NFC] fix some typos' ( #2175 )
2 years ago
Fazzie-Maqianli
ce3c4eca7b
[example] support Dreamblooth ( #2188 )
2 years ago
BlueRum
1cf6d92d7c
[exmaple] diffuser, support quant inference for stable diffusion ( #2186 )
2 years ago
Jiarui Fang
65f56f49e8
[example] gpt demo more accuracy tflops ( #2178 )
2 years ago
ziyuhuang123
cf5028363c
'diffusion-typo-change'
2 years ago
Jiarui Fang
27327a4c90
[example] add palm pytorch version ( #2172 )
2 years ago
Jiarui Fang
a4b4bb01d6
[example] update vit readme ( #2155 )
2 years ago
Jiarui Fang
2cfe685b9f
[exmaple] add vit missing functions ( #2154 )
2 years ago
HELSON
a7d95b7024
[example] add zero1, zero2 example in GPT examples ( #2146 )
...
* [example] add zero1 and zero2 for GPT
* update readme in gpt example
* polish code
* change init value
* update readme
2 years ago
Fazzie
cea4292ae5
support stable diffusion v2
2 years ago
ZijianYY
fa9d1aea71
[example] update GPT README ( #2095 )
2 years ago
YuliangLiu0306
edf4cd46c5
[examples] update autoparallel demo ( #2061 )
2 years ago
Super Daniel
2edbef13cc
[fx] add more meta_registry for MetaTensor execution. ( #2000 )
...
* [sc] add examples for auto checkpoint.
* merge upstream
* [fx] add more meta_registry for MetaTensor execution.
2 years ago
Fazzie-Maqianli
b5dbb46172
[example] add diffusion inference ( #1986 )
2 years ago
mandoxzhang
52bd106627
add RoBERTa ( #1980 )
...
* update roberta
* update roberta & readme
* update roberta & readme
* update roberta & readme
2 years ago
Jiarui Fang
f7e276fa71
[Gemini] add GeminiAdamOptimizer ( #1960 )
2 years ago
Jiarui Fang
60abd86d6a
[example] enhance GPT demo ( #1959 )
...
* [example] enhence GPT demo
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2 years ago
Fazzie
a09f88ab07
update model download in README
2 years ago
Fazzie-Maqianli
6bdd0a90ca
update lightning version ( #1954 )
2 years ago
binmakeswell
9183e0dec5
[tutorial] polish all README ( #1946 )
2 years ago
Frank Lee
de56b563b9
[tutorial] added missing dummy dataloader ( #1944 )
2 years ago
Frank Lee
c6ea65011f
[tutorial] fixed pipeline bug for sequence parallel ( #1943 )
2 years ago
Jiarui Fang
cf68cc92ac
[example] add vit ( #1942 )
...
* [ColoTensor] ColoInitContext initialize parameters in shard mode.
* polish
* [example] add vit
2 years ago
YuliangLiu0306
c7925c5d08
[sc demo] add requirements to spmd README ( #1941 )
2 years ago
Boyuan Yao
d5f5e06d82
[SC] remove redundant hands on ( #1939 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
* [sc] modify auto checkpoint benchmark
* [sc] remove imgs
* [sc] remove redundant handson
2 years ago
binmakeswell
41868f7605
[tutorial] polish README and OPT files ( #1930 )
...
* [tutorial] polish README and OPT files
* [tutorial] polish README and OPT files
* [tutorial] polish README and OPT files
2 years ago
ver217
b0b7a786b7
[tutorial] add synthetic dataset for opt ( #1924 )
2 years ago
Frank Lee
0486048453
[tutorial] updated hybrid parallel readme ( #1928 )
...
* [tutorial] updated hybrid parallel readme
* polish code
2 years ago
Frank Lee
807cbdb87d
[tutorial] added synthetic data for sequence parallel ( #1927 )
...
* [tutorial] added synthetic data for sequence parallel
* polish code
2 years ago
Frank Lee
abf4c27f6a
[tutorial] removed huggingface model warning ( #1925 )
2 years ago
Frank Lee
d43a671ad6
Hotfix/tutorial readme index ( #1922 )
...
* [tutorial] removed tutorial index in readme
* [tutorial] removed tutorial index in readme
2 years ago
Boyuan Yao
24cbee0ebe
[tutorial] modify hands-on of auto activation checkpoint ( #1920 )
...
* [sc] SC tutorial for auto checkpoint
* [sc] polish examples
* [sc] polish readme
* [sc] polish readme and help information
* [sc] polish readme and help information
* [sc] modify auto checkpoint benchmark
* [sc] remove imgs
2 years ago
Frank Lee
ff16773ded
[tutorial] added synthetic data for hybrid parallel ( #1921 )
...
* [tutorial] added synthetic data for hybrid parallel
* polish code
2 years ago
Frank Lee
3c42fdbedc
[tutorial] added synthetic data for hybrid parallel ( #1919 )
2 years ago
Frank Lee
1b0dd05940
[tutorial] added synthetic dataset for auto parallel demo ( #1918 )
2 years ago
Frank Lee
acd9abc5ca
[tutorial] updated auto parallel demo with latest data path ( #1917 )
2 years ago
Frank Lee
d53415bc10
[tutorial] added data script and updated readme ( #1916 )
2 years ago