49 Commits (c1594e4bad5056d5500b7dbf1218241bb7e8eb84)

Author	SHA1	Message	Date
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
digger yu	70c8cdecf4	[nfc] fix typo colossalai/cli fx kernel (#3847) ... * fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/ * fix typo colossalai/ applications/ * fix typo colossalai/cli fx kernel	2 years ago
Michelle	ad285e1656	[NFC] polish colossalai/fx/tracer/_tracer_utils.py (#3323) ... * [NFC] polish colossalai/engine/schedule/_pipeline_schedule.py code style * [NFC] polish colossalai/fx/tracer/_tracer_utils.py code style --------- Co-authored-by: Qianran Ma <qianranm@luchentech.com>	2 years ago
Super Daniel	c41e59e5ad	[fx] allow native ckpt trace and codegen. (#2438)	2 years ago
Zihao	3a02b46447	[auto-parallel] refactoring ColoTracer (#2118) ... * add meta_data_computing * add checkpoint_annotation * rename proxy.data to proxy.meta_data and add bias addition pass * polish code * delete meta_prop_pass invoke and rename ori_node to orig_node * add TracerType * unify meta data computing * delete TracerType * handle setitem operation * operator.setitem	2 years ago
YuliangLiu0306	3b1b91eaf4	[autoparallel] record parameter attribute in colotracer (#2217) ... * [autoparallel] record parameter attribute in collotracer * [autoparallel] fix construct_meta_info bug	2 years ago
YuliangLiu0306	d87baa85d9	[autoparallel] support linear function bias addition (#2104)	2 years ago
YuliangLiu0306	0fecbb9e20	[autoparallel] support addbmm computation (#2102)	2 years ago
YuliangLiu0306	b175e6d58e	[autoparallel] add bias addtion function class (#2098) ... * [autoparallel] add bias addtion function class * polish code * polish	2 years ago
Super Daniel	2bf2d1cd3b	[fx] An experimental version of ColoTracer.' (#2002) ... * [fx] add a symbolic_trace api. * [fx] fix import errors. * [fx] ColoTracer experimental.	2 years ago
Super Daniel	2edbef13cc	[fx] add more meta_registry for MetaTensor execution. (#2000) ... * [sc] add examples for auto checkpoint. * merge upstream * [fx] add more meta_registry for MetaTensor execution.	2 years ago
YuliangLiu0306	fea3cb661c	[autoparallel] support addmm in tracer and solver (#1961) ... * [fx] patch addmm * [autoparallel] support addmm in tracer and solver	2 years ago
YuliangLiu0306	f6032ddb17	[autoparallel] fix bias addition module (#1800)	2 years ago
Super Daniel	441d584e4a	[fx] add a symbolic_trace api. (#1812) ... * [fx] add a symbolic_trace api. * [fx] fix import errors.	2 years ago
YuliangLiu0306	e34e850a4c	[autoparallel]add essential CommActions for broadcast oprands (#1793)	2 years ago
YuliangLiu0306	2c4c7b3618	[autoparallel] add getattr handler (#1767) ... * [autoparallel] add getattr haandler * polish code * add extra processes for Parameters * add unit test for param resharding cost * add docstring and polish test	2 years ago
YuliangLiu0306	e859380bf7	[fx] support module with bias addition (#1780) ... * [autoparallel] refactor tracer to fix bias addition issue * [fx] support module with bias addition * create bias_addition_module * refactor file structure * polish code * fix unit test	2 years ago
Super Daniel	1e88811c7a	[autoparallel] move ckpt solvers to autoparallel folder / refactor code (#1764) ... * [autoparallel] first move. * [autoparallel] add solver rotor. * [autoparallel] add ckpt solvers. * [autoparallel] modify codegen. * [fx] fix annotation in test. * [fx] remove check. * [autoparallel] polish docstring. * [fx] refactor MetaTensor.	2 years ago
Super Daniel	0584654c79	[fx] refactor memory utils and extend shard utils. (#1754) ... * [fx] change memory.py to memory_utils.py. * [fx] add shard utils. * [fx] fix import. * [fx] check code style. * [fx] add comment. * [autoparallel] first move. * [fx] add time computations.	2 years ago
Frank Lee	262652c8bc	[autoparallel] added addbmm handler (#1751)	2 years ago
Super Daniel	d967779a32	[fx/profiler] tuned the calculation of memory estimation (#1619) ... * [fx] tuned the meta info and rotor solver. * [fx] remove import. * [fx] remove import. * [fx] remove import. * [fx] tune the meta calculations. * [fx] polish comments. * [fx] remove assertions. * [fx] modify test cases. * [fx] modify test cases. * [fx] optimize import. * [fx	2 years ago
Xue Fuzhao	e070ca45c6	[NFC] polish colossalai/fx/tracer/meta_patch/patched_module/convolution.py code style (#1563)	2 years ago
Super Daniel	d8a5aded19	[hotfix] change namespace for meta_trace. (#1541)	2 years ago
Super Daniel	70129603aa	[fx] support meta tracing for aten level computation graphs like functorch. (#1536) ... * [fx] support meta tracing for aten level computation graphs like functorch. * [fx] support meta tracing for aten level computation graphs like functorch. * [fx] remove redundant import. * [fx] add docstring.	2 years ago
YuliangLiu0306	4b3d6caeb3	[fx]patch nn.functional convolution (#1528)	2 years ago
YuliangLiu0306	413c053453	[autoparallel] add cost graph class (#1481) ... * [autoparallel] add cost graph class * polish code	2 years ago
Frank Lee	3da68d6b1b	[fx] fixed adapative pooling size concatenation error (#1489)	2 years ago
Frank Lee	7d6293927f	[fx] patched torch.max and data movement operator (#1391) ... * [fx] patched torch.max and data movement operator * polish code	2 years ago
Frank Lee	ad678921db	[fx] patched torch.full for huggingface opt (#1386)	2 years ago
Super Daniel	be229217ce	[fx] add torchaudio test (#1369) ... * [fx]add torchaudio test * [fx]add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test and test patches * Delete ~ * [fx] add patches and patches test * [fx] add patches and patches test * [fx] fix patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] merge upstream * [fx] fix import errors	2 years ago
ver217	d068af81a3	[doc] update rst and docstring (#1351) ... * update rst * add zero docstr * fix docstr * remove fx.tracer.meta_patch * fix docstr * fix docstr * update fx rst * fix fx docstr * remove useless rst	2 years ago
Frank Lee	274c1a3b5f	[fx] fixed apex normalization patch exception (#1352)	2 years ago
Frank Lee	05fae1fd56	[fx] added activation checkpointing annotation (#1349) ... * [fx] added activation checkpointing annotation * polish code * polish code	2 years ago
YuliangLiu0306	942c8cd1fb	[fx] refactor tracer to trace complete graph (#1342) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx] refactor tracer to trace complete graph * add comments and solve conflicts.	2 years ago
YuliangLiu0306	4631fef8a0	[fx]refactor tracer (#1335)	2 years ago
Frank Lee	75abc75c15	[fx] fixed compatiblity issue with torch 1.10 (#1331)	2 years ago
Frank Lee	b2475d8c5c	[fx] fixed unit tests for torch 1.12 (#1327)	2 years ago
Frank Lee	4f4d8c3656	[fx] added apex normalization to patched modules (#1300) ... * [fx] added apex normalization to patched modules * remove unused imports	2 years ago
Frank Lee	4a09fc0947	[fx] fixed tracing with apex-based T5 model (#1252) ... * [fx] fixed tracing with apex-based T5 model * polish code * polish code	2 years ago
Frank Lee	7531c6271f	[fx] refactored the file structure of patched function and module (#1238) ... * [fx] refactored the file structure of patched function and module * polish code	2 years ago
Frank Lee	84f2298a96	[fx] added patches for tracing swin transformer (#1228)	2 years ago
Frank Lee	b6cb5a47ad	[fx] added timm model tracing testing (#1221)	2 years ago
Frank Lee	11973d892d	[fx] added torchvision model tracing testing (#1216) ... * [fx] added torchvision model tracing testing * remove unused imports	2 years ago
Frank Lee	5da87ce35d	[fx] added testing for all albert variants (#1211)	2 years ago
Frank Lee	2d13a45a3b	[fx] added testing for all gpt variants (#1210) ... * [fx] added testing for all gpt variants * polish code * polish code	2 years ago
Frank Lee	f7878f465c	[fx] supported model tracing for huggingface bert (#1201) ... * [fx] supported model tracing for huggingface bert * polish test	2 years ago
Frank Lee	abf6a262dc	[fx] added module patch for pooling layers (#1197)	2 years ago
Frank Lee	2c8c05675d	[fx] patched conv and normalization (#1188)	2 years ago
Frank Lee	6d86f1bc91	[fx] supported data-dependent control flow in model tracing (#1185) ... * [fx] supported data-dependent control flow in model tracing * polish code	2 years ago