527 Commits (9623ec1b02d345b3515ad5b666a9ebfa79dbe69e)

Author	SHA1	Message	Date
Jiarui Fang	3ce4463fe6	[utils] remove lazy_memory_allocate from ColoInitContext (#1844)	2 years ago
YuliangLiu0306	f6032ddb17	[autoparallel] fix bias addition module (#1800)	2 years ago
ver217	99870726b1	[CheckpointIO] a uniform checkpoint I/O module (#1689)	2 years ago
Boyuan Yao	629172b319	[autoparallel] add batch norm metainfo (#1815) ... * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel * [fx] add conv metainfo class * [fx] restore profiler * [fx] restore meta profiler * [autoparallel] modify unit test * [fx] modify unit test * [autoparallel] add batchnorm metainfo class * [autoparallel] fix batchnorm unit test function declaration * [fx] restore profiler	2 years ago
Super Daniel	441d584e4a	[fx] add a symbolic_trace api. (#1812) ... * [fx] add a symbolic_trace api. * [fx] fix import errors.	2 years ago
Jiarui Fang	6fa71d65d3	[fx] skip diffusers unitest if it is not installed (#1799)	2 years ago
oahzxl	9639ea88fc	[kernel] more flexible flashatt interface (#1804)	2 years ago
Boyuan Yao	327d07c44a	[autoparallel] add conv metainfo class for auto parallel (#1796) ... * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel * [fx] add conv metainfo class * [fx] restore profiler * [fx] restore meta profiler * [autoparallel] modify unit test * [fx] modify unit test	2 years ago
oahzxl	501a9e9cd2	[hotfix] polish flash attention (#1802)	2 years ago
Jiarui Fang	c248800359	[kernel] skip tests of flash_attn and triton when they are not available (#1798)	2 years ago
YuliangLiu0306	e34e850a4c	[autoparallel]add essential CommActions for broadcast oprands (#1793)	2 years ago
Boyuan Yao	05ce3d369f	[fx] Add linear metainfo class for auto parallel (#1783) ... * [fx] metainfo class for auto parallel * [fx] add unit test for linear metainfo * [fx] fix bwd param for linear * [fx] modify unit test * [fx] modify unit test * [fx] modify import * [fx] modify import * [fx] modify import * [fx] move meta profiler to auto parallel	2 years ago
YuliangLiu0306	2c4c7b3618	[autoparallel] add getattr handler (#1767) ... * [autoparallel] add getattr haandler * polish code * add extra processes for Parameters * add unit test for param resharding cost * add docstring and polish test	2 years ago
HELSON	c6a1a62636	[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786) ... * [hotfix] fix zero's incompatibility with checkpoint in torch-1.12 * [zero] add cpu shard init * [zero] add tiny example test * [colo_tensor] fix bugs for torch-1.11	2 years ago
Jiarui Fang	32c1b843a9	skip torchrec unittests if not installed (#1790)	2 years ago
kurisusnowdeng	0b8161fab8	updated tp layers	2 years ago
YuliangLiu0306	e859380bf7	[fx] support module with bias addition (#1780) ... * [autoparallel] refactor tracer to fix bias addition issue * [fx] support module with bias addition * create bias_addition_module * refactor file structure * polish code * fix unit test	2 years ago
Frank Lee	f3f19a5c47	[autoparallel] added matmul handler (#1763) ... * [autoparallel] added matmul handler * polish code	2 years ago
YuliangLiu0306	27de252334	[autoparallel] fix conv handler numerical test (#1771)	2 years ago
Super Daniel	1e88811c7a	[autoparallel] move ckpt solvers to autoparallel folder / refactor code (#1764) ... * [autoparallel] first move. * [autoparallel] add solver rotor. * [autoparallel] add ckpt solvers. * [autoparallel] modify codegen. * [fx] fix annotation in test. * [fx] remove check. * [autoparallel] polish docstring. * [fx] refactor MetaTensor.	2 years ago
YuliangLiu0306	a4d1f59c78	[autoparallel] add numerical test for handlers (#1769)	2 years ago
YuliangLiu0306	b0f7c8bde8	[autoparallel] update CommSpec to CommActions (#1768) ... * [autoparallel] update CommSpec to CommActions * polish code	2 years ago
YuliangLiu0306	b4cc59b61e	[autoparallel] add numerical test for node strategies (#1760) ... * [autoparallel] add numerical test for node strategies * polish code * polish code	2 years ago
oahzxl	25952b67d7	[feat] add flash attention (#1762)	2 years ago
Super Daniel	0584654c79	[fx] refactor memory utils and extend shard utils. (#1754) ... * [fx] change memory.py to memory_utils.py. * [fx] add shard utils. * [fx] fix import. * [fx] check code style. * [fx] add comment. * [autoparallel] first move. * [fx] add time computations.	2 years ago
YuliangLiu0306	314d8c497f	[autoparallel] refactor the runtime apply pass and add docstring to passes (#1757) ... * [autoparallel] refactor the runtime apply pass and add doc string to passes * fix unit test * polish	2 years ago
Frank Lee	f9a613d660	[autoparallel] added binary elementwise node handler (#1758) ... * [autoparallel] added binary elementwise node handler * polish code	2 years ago
YuliangLiu0306	d2fc067231	[autoparallel] fix param hook issue in transform pass (#1755)	2 years ago
Frank Lee	262652c8bc	[autoparallel] added addbmm handler (#1751)	2 years ago
YuliangLiu0306	980ed21723	[autoparallel] shard param and buffer as expected (#1753) ... * [autoparallel] shard param and buffer as expected * fix unit test issue	2 years ago
YuliangLiu0306	cdb7d5e7d2	[hotfix] autoparallel unit test (#1752)	2 years ago
YuliangLiu0306	a4ce180e85	[autoparallel] add sequential order to communication actions (#1735)	2 years ago
Super Daniel	b893342f95	[fx] test tracer on diffuser modules. (#1750) ... * [fx] test tracer on diffuser modules. * [fx] shorter seq_len. * Update requirements-test.txt	2 years ago
Frank Lee	b80b6eaa88	[autoparallel] recovered skipped test cases (#1748)	2 years ago
Frank Lee	474111ecb5	[autoparallel] fixed wrong sharding strategy in conv handler (#1747) ... * [autoparallel] fixed wrong sharding strategy in conv handler * polish code	2 years ago
Frank Lee	8b8937d901	[autoparallel] fixed wrong generated strategy for dot op (#1746) ... * [autoparallel] fixed wrong generated strategy for dot op * polish code	2 years ago
Frank Lee	88a79814fb	[autoparallel] handled illegal strategy in node handler (#1743) ... * [autoparallel] handled illegal strategy in node handler * polish code	2 years ago
Super Daniel	30874f1692	[fx/profiler] debug the fx.profiler / add an example test script for fx.profiler (#1730) ... * [fx/profiler] add test. * [fx] fix file names. * [fx] add docstring and comment. * [fx] polish profiler.py. * [fx] fix import errors. * [fx] fix profiler. * [fx] fix names.	2 years ago
Frank Lee	eee84908d4	[autoparallel] handled illegal sharding strategy (#1728) ... * [autoparallel] handled illegal sharding strategy * polish code	2 years ago
Ziheng Qin	cbe9a4cb45	[NFC] polish tests/test_layers/test_3d/test_3d.py code style (#1740)	2 years ago
lucasliunju	912eb58ea0	[NFC] polish tests/test_layers/test_3d/checks_3d/common.py code style (#1733)	2 years ago
Xue Fuzhao	754aa7c81f	[NFC] polish tests/test_layers/test_3d/checks_3d/check_layer_3d.py code style (#1731)	2 years ago
xyupeng	ff373a11eb	[NFC] polish tests/test_layers/test_sequence/checks_seq/check_layer_seq.py code style (#1723)	2 years ago
Kai Wang (Victor Kai)	b38efe4e8a	[NFC] polish test_2p5d/checks_2p5d/check_operation_2p5d.py code style (#1718)	2 years ago
binmakeswell	f6389d0813	[NFC] polish tests/test_layers/test_2d/checks_2d/check_operation_2d.py code style (#1715)	2 years ago
HELSON	f69f9bf223	[zero] add chunk init function for users (#1729) ... * add chunk manager init function * fix unit tests * add comment * add flush=True	2 years ago
Super Daniel	393f594051	[fx/meta/rpc] move _meta_registration.py to fx folder / register fx functions with compatibility checks / remove color debug (#1710) ... * [fx] move meta registration * [fx] fix tests. * [fx] fix test. * [fx] fix. * [meta] refactor meta registration.py. * [fx] add compatibility descriptions. * [fx] polish import. * [fx] add a decorator. * [fx] fix tests. * [fx] remove print. * [fx] edit raise error. * [fx] edit raise error. * [fx] add type hint. * [fx] fix import in experimental. * [rpc] remove color debug. * [meta] fix naming.	2 years ago
Frank Lee	e8d8eda5e7	[autoparallel] moved tests to test_tensor_shard (#1713)	2 years ago
YuliangLiu0306	845ff4a47a	[autoparallel] resnet block runtime apply (#1709) ... * [autoparallel] resnet block runtime apply * seperate buffer and parameter in MemoryCost * polish code * add comments and todos * fix test issue	2 years ago
Frank Lee	22a115406b	[autoparallel] fixed broken node handler tests (#1708)	2 years ago