ColossalAI

Commit Graph

Author	SHA1	Message	Date
Super Daniel	e8a9bebc87	[autoparallel] refactor and add rotorc. (#1789 ) * [autoparallel] refactor and add rotorc. * [autoparallel] refactor and add rotorc.	2 years ago
github-actions[bot]	4d6e1284cb	Automated submodule synchronization (#1785 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
YuliangLiu0306	2c4c7b3618	[autoparallel] add getattr handler (#1767 ) * [autoparallel] add getattr haandler * polish code * add extra processes for Parameters * add unit test for param resharding cost * add docstring and polish test	2 years ago
HELSON	c6a1a62636	[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786 ) * [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 * [zero] add cpu shard init * [zero] add tiny example test * [colo_tensor] fix bugs for torch-1.11	2 years ago
Jiarui Fang	32c1b843a9	skip torchrec unittests if not installed (#1790 )	2 years ago
kurisusnowdeng	0b8161fab8	updated tp layers	2 years ago
Jiarui Fang	cb5a587e9a	[hotfix] polish chunk import (#1787 )	2 years ago
YuliangLiu0306	e859380bf7	[fx] support module with bias addition (#1780 ) * [autoparallel] refactor tracer to fix bias addition issue * [fx] support module with bias addition * create bias_addition_module * refactor file structure * polish code * fix unit test	2 years ago
Frank Lee	f3f19a5c47	[autoparallel] added matmul handler (#1763 ) * [autoparallel] added matmul handler * polish code	2 years ago
Ziyue Jiang	4df0194976	[Pipeline]Adapt to Pipelinable OPT (#1782 )	2 years ago
YuliangLiu0306	27de252334	[autoparallel] fix conv handler numerical test (#1771 )	2 years ago
Super Daniel	1e88811c7a	[autoparallel] move ckpt solvers to autoparallel folder / refactor code (#1764 ) * [autoparallel] first move. * [autoparallel] add solver rotor. * [autoparallel] add ckpt solvers. * [autoparallel] modify codegen. * [fx] fix annotation in test. * [fx] remove check. * [autoparallel] polish docstring. * [fx] refactor MetaTensor.	2 years ago
github-actions[bot]	2b859502d5	Automated submodule synchronization (#1781 ) Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Super Daniel	5ea89f6456	[CI] downgrade fbgemm. (#1778 )	2 years ago
Jiarui Fang	f34dab4270	[compatibility] ChunkMgr import error (#1772 )	2 years ago
YuliangLiu0306	a4d1f59c78	[autoparallel] add numerical test for handlers (#1769 )	2 years ago
YuliangLiu0306	b0f7c8bde8	[autoparallel] update CommSpec to CommActions (#1768 ) * [autoparallel] update CommSpec to CommActions * polish code	2 years ago
binmakeswell	16b0abf94f	[doc] add FastFold (#1766 )	2 years ago
YuliangLiu0306	b4cc59b61e	[autoparallel] add numerical test for node strategies (#1760 ) * [autoparallel] add numerical test for node strategies * polish code * polish code	2 years ago
oahzxl	25952b67d7	[feat] add flash attention (#1762 )	2 years ago
Super Daniel	0584654c79	[fx] refactor memory utils and extend shard utils. (#1754 ) * [fx] change memory.py to memory_utils.py. * [fx] add shard utils. * [fx] fix import. * [fx] check code style. * [fx] add comment. * [autoparallel] first move. * [fx] add time computations.	2 years ago
Ziyue Jiang	63f250bbd4	fix file name (#1759 ) Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2 years ago
YuliangLiu0306	314d8c497f	[autoparallel] refactor the runtime apply pass and add docstring to passes (#1757 ) * [autoparallel] refactor the runtime apply pass and add doc string to passes * fix unit test * polish	2 years ago
Frank Lee	f9a613d660	[autoparallel] added binary elementwise node handler (#1758 ) * [autoparallel] added binary elementwise node handler * polish code	2 years ago
YuliangLiu0306	d2fc067231	[autoparallel] fix param hook issue in transform pass (#1755 )	2 years ago
Frank Lee	262652c8bc	[autoparallel] added addbmm handler (#1751 )	2 years ago
YuliangLiu0306	980ed21723	[autoparallel] shard param and buffer as expected (#1753 ) * [autoparallel] shard param and buffer as expected * fix unit test issue	2 years ago
YuliangLiu0306	cdb7d5e7d2	[hotfix] autoparallel unit test (#1752 )	2 years ago
YuliangLiu0306	a4ce180e85	[autoparallel] add sequential order to communication actions (#1735 )	2 years ago
Super Daniel	b893342f95	[fx] test tracer on diffuser modules. (#1750 ) * [fx] test tracer on diffuser modules. * [fx] shorter seq_len. * Update requirements-test.txt	2 years ago
Frank Lee	b80b6eaa88	[autoparallel] recovered skipped test cases (#1748 )	2 years ago
Frank Lee	474111ecb5	[autoparallel] fixed wrong sharding strategy in conv handler (#1747 ) * [autoparallel] fixed wrong sharding strategy in conv handler * polish code	2 years ago
Frank Lee	8b8937d901	[autoparallel] fixed wrong generated strategy for dot op (#1746 ) * [autoparallel] fixed wrong generated strategy for dot op * polish code	2 years ago
Frank Lee	993b8875b6	[autoparallel] handled illegal sharding strategy in shape consistency (#1744 ) * [autoparallel] handled illegal sharding strategy in shape consistency * polish code	2 years ago
Frank Lee	88a79814fb	[autoparallel] handled illegal strategy in node handler (#1743 ) * [autoparallel] handled illegal strategy in node handler * polish code	2 years ago
Super Daniel	30874f1692	[fx/profiler] debug the fx.profiler / add an example test script for fx.profiler (#1730 ) * [fx/profiler] add test. * [fx] fix file names. * [fx] add docstring and comment. * [fx] polish profiler.py. * [fx] fix import errors. * [fx] fix profiler. * [fx] fix names.	2 years ago
Frank Lee	eee84908d4	[autoparallel] handled illegal sharding strategy (#1728 ) * [autoparallel] handled illegal sharding strategy * polish code	2 years ago
Ziheng Qin	cbe9a4cb45	[NFC] polish tests/test_layers/test_3d/test_3d.py code style (#1740 )	2 years ago
lucasliunju	912eb58ea0	[NFC] polish tests/test_layers/test_3d/checks_3d/common.py code style (#1733 )	2 years ago
Sze-qq	23703c9dd6	[NFC] polish colossalai/nn/metric/_utils.py code style (#1727 )	2 years ago
Xue Fuzhao	754aa7c81f	[NFC] polish tests/test_layers/test_3d/checks_3d/check_layer_3d.py code style (#1731 )	2 years ago
xyupeng	ff373a11eb	[NFC] polish tests/test_layers/test_sequence/checks_seq/check_layer_seq.py code style (#1723 )	2 years ago
Ofey Chan	7e62af28a0	[NFC] polish accuracy_2d.py code style (#1719 )	2 years ago
Arsmart1	8860d37846	[NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style (#1721 )	2 years ago
LuGY	730f88f8e1	[NFC] polish _checkpoint_hook.py code style (#1722 )	2 years ago
Kai Wang (Victor Kai)	b38efe4e8a	[NFC] polish test_2p5d/checks_2p5d/check_operation_2p5d.py code style (#1718 )	2 years ago
CsRic	ea961d8fd1	[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717 ) Co-authored-by: ric <mkkt_bkkt@mail.ustc.edu.cn>	2 years ago
yuxuan-lou	2b49ca80a3	[NFC] polish colossalai/nn/lr_scheduler/linear.py code style (#1716 )	2 years ago
binmakeswell	f6389d0813	[NFC] polish tests/test_layers/test_2d/checks_2d/check_operation_2d.py code style (#1715 )	2 years ago
shenggan	e1d780030d	[NFC] polish colossalai/nn/metric/accuracy_2p5d.py code style (#1714 )	2 years ago

1 2 3 4 5 ...

1235 Commits (e8a9bebc8770b9430f4150a400e6fef43cf02d4f) All Branches Search

1235 Commits (e8a9bebc8770b9430f4150a400e6fef43cf02d4f)

All Branches