oahzxl
|
d1f0773182
|
rename
|
2 years ago |
oahzxl
|
06a5355d98
|
update test
|
2 years ago |
oahzxl
|
efb1c64c30
|
restruct dir
|
2 years ago |
YuliangLiu0306
|
8b1e0dfd80
|
[example] upload auto parallel gpt2 demo (#2354)
|
2 years ago |
Jiarui Fang
|
00a9c781fd
|
[example] add google doc for benchmark results of GPT (#2355)
|
2 years ago |
Jiarui Fang
|
509a87f3ff
|
[example] make gpt example directory more clear (#2353)
|
2 years ago |
oahzxl
|
27ab524096
|
refactor structure
|
2 years ago |
Arsmart1
|
7027540d3d
|
[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/_utils.py code style (#2352)
|
2 years ago |
Ikko Eltociear Ashimine
|
5e4bced0a3
|
[NFC] Update roberta/README.md (#2350)
|
2 years ago |
Jiarui Fang
|
35e22be2f6
|
[example] simplify opt example (#2344)
|
2 years ago |
ziyuhuang123
|
7080a8edb0
|
[workflow]New version: Create workflow files for examples' auto check (#2298)
* [workflows]bug_repair
* [workflow]new_pr_fixing_bugs
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
|
2 years ago |
binmakeswell
|
d7352bef2c
|
[example] add example requirement (#2345)
|
2 years ago |
LuGY
|
e11a005c02
|
[NFC] polish colossalai/auto_parallel/tensor_shard/utils/factory.py code style (#2349)
|
2 years ago |
Haofan Wang
|
7ce965c7cc
|
Update requirement_colossalai.txt (#2348)
|
2 years ago |
ZijianYY
|
f7fd592bf4
|
[examples]adding tp to PaLM (#2319)
|
2 years ago |
oahzxl
|
71e72c4890
|
last version of benchmark
|
2 years ago |
YuliangLiu0306
|
b5a3a4a65f
|
[device] find best logical mesh
|
2 years ago |
yuxuan-lou
|
28e2d16794
|
[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py code style (#2340)
|
2 years ago |
YuliangLiu0306
|
9c9246c0d9
|
[device] alpha beta profiler (#2311)
* [device] alpha beta profiler
* add usage
* fix variable name
|
2 years ago |
Maruyama_Aya
|
bd12a49e2a
|
[NFC] polish <colossalai/auto_parallel/tensor_shard/deprecated/constants.py> code style (#2339)
|
2 years ago |
Haofan Wang
|
9edd0aa75e
|
Update train_dreambooth_colossalai.py
accelerator.num_processes -> gpc.get_world_size(ParallelMode.DATA)
|
2 years ago |
Frank Lee
|
f1bc2418c4
|
[setup] make cuda extension build optional (#2336)
* [setup] make cuda extension build optional
* polish code
* polish code
* polish code
|
2 years ago |
Frank Lee
|
8711310cda
|
[setup] remove torch dependency (#2333)
|
2 years ago |
Zihao
|
35427bcab4
|
[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py code style (#2326)
|
2 years ago |
oahzxl
|
55cb713f36
|
update min memory stratege, reduce mem usage by 30%
|
2 years ago |
Fazzie-Maqianli
|
89f26331e9
|
[example] diffusion update diffusion,Dreamblooth (#2329)
|
2 years ago |
Frank Lee
|
6e34cc0830
|
[workflow] fixed pypi release workflow error (#2328)
|
2 years ago |
Frank Lee
|
2916eed34a
|
[workflow] fixed pypi release workflow error (#2327)
|
2 years ago |
Frank Lee
|
8d8dec09ba
|
[workflow] added workflow to release to pypi upon version change (#2320)
* [workflow] added workflow to release to pypi upon version change
* polish code
* polish code
* polish code
|
2 years ago |
Frank Lee
|
693ef121a1
|
[workflow] removed unused assign reviewer workflow (#2318)
|
2 years ago |
binmakeswell
|
e512ca9c24
|
[doc] update stable diffusion link (#2322)
* [doc] update link
|
2 years ago |
Frank Lee
|
e8dfa2e2e0
|
[workflow] rebuild cuda kernels when kernel-related files change (#2317)
|
2 years ago |
Jiarui Fang
|
db6eea3583
|
[builder] reconfig op_builder for pypi install (#2314)
|
2 years ago |
Fazzie-Maqianli
|
a9b27b9265
|
[exmaple] fix dreamblooth format (#2315)
|
2 years ago |
Sze-qq
|
da1c47f060
|
update ColossalAI logo (#2316)
Co-authored-by: siqi <siqi@siqis-MacBook-Pro.local>
|
2 years ago |
Junming Wu
|
4a79c10750
|
[NFC] polish colossalai/cli/benchmark/__init__.py code style (#2308)
|
2 years ago |
Ofey Chan
|
87d2defda6
|
[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py code style (#2305)
|
2 years ago |
ver217
|
116e3d0b8f
|
[NFC] polish communication/p2p_v2.py code style (#2303)
|
2 years ago |
xyupeng
|
b965585d05
|
[NFC] polish colossalai/amp/torch_amp/torch_amp.py code style (#2290)
|
2 years ago |
Zangwei Zheng
|
d1e5bafcd4
|
[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/__init__.py code style (#2291)
|
2 years ago |
shenggan
|
950685873f
|
[NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py code style (#2292)
|
2 years ago |
Ziheng Qin
|
3041014089
|
[NFC] polish colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py code style (#2299)
Co-authored-by: henryqin1997 <henryqin1997@gamil.com>
|
2 years ago |
アマデウス
|
49715a78f0
|
[NFC] polish colossalai/cli/benchmark/benchmark.py code style (#2287)
|
2 years ago |
Zirui Zhu
|
1c29b173c9
|
[NFC] polish colossalai/auto_parallel/tensor_shard/node_handler/getitem_handler.py code style (#2289)
|
2 years ago |
Zihao
|
3a02b46447
|
[auto-parallel] refactoring ColoTracer (#2118)
* add meta_data_computing
* add checkpoint_annotation
* rename proxy.data to proxy.meta_data and add bias addition pass
* polish code
* delete meta_prop_pass invoke and rename ori_node to orig_node
* add TracerType
* unify meta data computing
* delete TracerType
* handle setitem operation
* operator.setitem
|
2 years ago |
Jiarui Fang
|
32253315b4
|
[example] update diffusion readme with official lightning (#2304)
|
2 years ago |
HELSON
|
5d3a2be3af
|
[amp] add gradient clipping for unit tests (#2283)
* [amp] add gradient clipping in unit tests
* fix bugs
|
2 years ago |
HELSON
|
e00cedd181
|
[example] update gemini benchmark bash (#2306)
|
2 years ago |
Frank Lee
|
9b765e7a69
|
[setup] removed the build dependency on colossalai (#2307)
|
2 years ago |
Boyuan Yao
|
d45695d94e
|
Merge pull request #2258 from hpcaitech/debug/ckpt-autoparallel
[autockpt] provide option for activation checkpoint search in SPMD solver
|
2 years ago |