YuliangLiu0306
|
e859380bf7
|
[fx] support module with bias addition (#1780)
* [autoparallel] refactor tracer to fix bias addition issue
* [fx] support module with bias addition
* create bias_addition_module
* refactor file structure
* polish code
* fix unit test
|
2 years ago |
Frank Lee
|
f3f19a5c47
|
[autoparallel] added matmul handler (#1763)
* [autoparallel] added matmul handler
* polish code
|
2 years ago |
Ziyue Jiang
|
4df0194976
|
[Pipeline]Adapt to Pipelinable OPT (#1782)
|
2 years ago |
YuliangLiu0306
|
27de252334
|
[autoparallel] fix conv handler numerical test (#1771)
|
2 years ago |
Super Daniel
|
1e88811c7a
|
[autoparallel] move ckpt solvers to autoparallel folder / refactor code (#1764)
* [autoparallel] first move.
* [autoparallel] add solver rotor.
* [autoparallel] add ckpt solvers.
* [autoparallel] modify codegen.
* [fx] fix annotation in test.
* [fx] remove check.
* [autoparallel] polish docstring.
* [fx] refactor MetaTensor.
|
2 years ago |
github-actions[bot]
|
2b859502d5
|
Automated submodule synchronization (#1781)
Co-authored-by: github-actions <github-actions@github.com>
|
2 years ago |
Super Daniel
|
5ea89f6456
|
[CI] downgrade fbgemm. (#1778)
|
2 years ago |
Jiarui Fang
|
f34dab4270
|
[compatibility] ChunkMgr import error (#1772)
|
2 years ago |
YuliangLiu0306
|
a4d1f59c78
|
[autoparallel] add numerical test for handlers (#1769)
|
2 years ago |
YuliangLiu0306
|
b0f7c8bde8
|
[autoparallel] update CommSpec to CommActions (#1768)
* [autoparallel] update CommSpec to CommActions
* polish code
|
2 years ago |
binmakeswell
|
16b0abf94f
|
[doc] add FastFold (#1766)
|
2 years ago |
YuliangLiu0306
|
b4cc59b61e
|
[autoparallel] add numerical test for node strategies (#1760)
* [autoparallel] add numerical test for node strategies
* polish code
* polish code
|
2 years ago |
oahzxl
|
25952b67d7
|
[feat] add flash attention (#1762)
|
2 years ago |
Super Daniel
|
0584654c79
|
[fx] refactor memory utils and extend shard utils. (#1754)
* [fx] change memory.py to memory_utils.py.
* [fx] add shard utils.
* [fx] fix import.
* [fx] check code style.
* [fx] add comment.
* [autoparallel] first move.
* [fx] add time computations.
|
2 years ago |
Ziyue Jiang
|
63f250bbd4
|
fix file name (#1759)
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
|
2 years ago |
YuliangLiu0306
|
314d8c497f
|
[autoparallel] refactor the runtime apply pass and add docstring to passes (#1757)
* [autoparallel] refactor the runtime apply pass and add doc string to passes
* fix unit test
* polish
|
2 years ago |
Frank Lee
|
f9a613d660
|
[autoparallel] added binary elementwise node handler (#1758)
* [autoparallel] added binary elementwise node handler
* polish code
|
2 years ago |
YuliangLiu0306
|
d2fc067231
|
[autoparallel] fix param hook issue in transform pass (#1755)
|
2 years ago |
Frank Lee
|
262652c8bc
|
[autoparallel] added addbmm handler (#1751)
|
2 years ago |
YuliangLiu0306
|
980ed21723
|
[autoparallel] shard param and buffer as expected (#1753)
* [autoparallel] shard param and buffer as expected
* fix unit test issue
|
2 years ago |
YuliangLiu0306
|
cdb7d5e7d2
|
[hotfix] autoparallel unit test (#1752)
|
2 years ago |
YuliangLiu0306
|
a4ce180e85
|
[autoparallel] add sequential order to communication actions (#1735)
|
2 years ago |
Super Daniel
|
b893342f95
|
[fx] test tracer on diffuser modules. (#1750)
* [fx] test tracer on diffuser modules.
* [fx] shorter seq_len.
* Update requirements-test.txt
|
2 years ago |
Frank Lee
|
b80b6eaa88
|
[autoparallel] recovered skipped test cases (#1748)
|
2 years ago |
Frank Lee
|
474111ecb5
|
[autoparallel] fixed wrong sharding strategy in conv handler (#1747)
* [autoparallel] fixed wrong sharding strategy in conv handler
* polish code
|
2 years ago |
Frank Lee
|
8b8937d901
|
[autoparallel] fixed wrong generated strategy for dot op (#1746)
* [autoparallel] fixed wrong generated strategy for dot op
* polish code
|
2 years ago |
Frank Lee
|
993b8875b6
|
[autoparallel] handled illegal sharding strategy in shape consistency (#1744)
* [autoparallel] handled illegal sharding strategy in shape consistency
* polish code
|
2 years ago |
Frank Lee
|
88a79814fb
|
[autoparallel] handled illegal strategy in node handler (#1743)
* [autoparallel] handled illegal strategy in node handler
* polish code
|
2 years ago |
Super Daniel
|
30874f1692
|
[fx/profiler] debug the fx.profiler / add an example test script for fx.profiler (#1730)
* [fx/profiler] add test.
* [fx] fix file names.
* [fx] add docstring and comment.
* [fx] polish profiler.py.
* [fx] fix import errors.
* [fx] fix profiler.
* [fx] fix names.
|
2 years ago |
Frank Lee
|
eee84908d4
|
[autoparallel] handled illegal sharding strategy (#1728)
* [autoparallel] handled illegal sharding strategy
* polish code
|
2 years ago |
Ziheng Qin
|
cbe9a4cb45
|
[NFC] polish tests/test_layers/test_3d/test_3d.py code style (#1740)
|
2 years ago |
lucasliunju
|
912eb58ea0
|
[NFC] polish tests/test_layers/test_3d/checks_3d/common.py code style (#1733)
|
2 years ago |
Sze-qq
|
23703c9dd6
|
[NFC] polish colossalai/nn/metric/_utils.py code style (#1727)
|
2 years ago |
Xue Fuzhao
|
754aa7c81f
|
[NFC] polish tests/test_layers/test_3d/checks_3d/check_layer_3d.py code style (#1731)
|
2 years ago |
xyupeng
|
ff373a11eb
|
[NFC] polish tests/test_layers/test_sequence/checks_seq/check_layer_seq.py code style (#1723)
|
2 years ago |
Ofey Chan
|
7e62af28a0
|
[NFC] polish accuracy_2d.py code style (#1719)
|
2 years ago |
Arsmart1
|
8860d37846
|
[NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style (#1721)
|
2 years ago |
LuGY
|
730f88f8e1
|
[NFC] polish _checkpoint_hook.py code style (#1722)
|
2 years ago |
Kai Wang (Victor Kai)
|
b38efe4e8a
|
[NFC] polish test_2p5d/checks_2p5d/check_operation_2p5d.py code style (#1718)
|
2 years ago |
CsRic
|
ea961d8fd1
|
[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)
Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>
|
2 years ago |
yuxuan-lou
|
2b49ca80a3
|
[NFC] polish colossalai/nn/lr_scheduler/linear.py code style (#1716)
|
2 years ago |
binmakeswell
|
f6389d0813
|
[NFC] polish tests/test_layers/test_2d/checks_2d/check_operation_2d.py code style (#1715)
|
2 years ago |
shenggan
|
e1d780030d
|
[NFC] polish colossalai/nn/metric/accuracy_2p5d.py code style (#1714)
|
2 years ago |
Frank Lee
|
9d0560af9c
|
[workflow] handled the git directory ownership error (#1741)
|
2 years ago |
YuliangLiu0306
|
d373e67b99
|
[hotfix] resharding cost issue (#1742)
|
2 years ago |
Jiarui Fang
|
24e84eba60
|
upgrade version to 0.1.11rc1 (#1739)
|
2 years ago |
Frank Lee
|
d2e0e39c9d
|
[release] update to v0.1.11 (#1736)
|
2 years ago |
binmakeswell
|
0d87c4e20d
|
[doc] update recommendation system catalogue (#1732)
|
2 years ago |
HELSON
|
f69f9bf223
|
[zero] add chunk init function for users (#1729)
* add chunk manager init function
* fix unit tests
* add comment
* add flush=True
|
2 years ago |
HELSON
|
2e1dbfb463
|
[pre-commit] update pre-commit (#1726)
* update pre-commit
* update pre-commit
|
2 years ago |