306 Commits (bd71e2a88b1cec29aeda10eaf0a1a983fd9014b7)

Author	SHA1	Message	Date
Jiarui Fang	bd71e2a88b	[hotfix] add missing file (#1308)	2 years ago
Frank Lee	4f4d8c3656	[fx] added apex normalization to patched modules (#1300) ... * [fx] added apex normalization to patched modules * remove unused imports	2 years ago
Jiarui Fang	4165eabb1e	[hotfix] remove potiential circle import (#1307) ... * make it faster * [hotfix] remove circle import	2 years ago
YuliangLiu0306	93a75433df	[hotfix] skip some unittest due to CI environment. (#1301)	2 years ago
HELSON	260a55804a	[hotfix] fix shape error in backward when using ColoTensor (#1298)	2 years ago
Frank Lee	7e8114a8dd	[hotfix] skipped unsafe test cases (#1282)	2 years ago
Jiarui Fang	79fe7b027a	[hotfix] test model unittest hotfix (#1281)	2 years ago
Jiarui Fang	e56731e916	[hotfix] test_gpt.py duplicated (#1279) ... * make it faster * [hotfix] torchvison fx tests * [hotfix] rename duplicated named test_gpt.py	2 years ago
HELSON	abba4d84e1	[hotfix] fix bert model test in unitests (#1272)	2 years ago
YuliangLiu0306	01ea68b2e6	[tests] remove T5 test skip decorator (#1271)	2 years ago
Jiarui Fang	ca9d5ee91c	[hotfix] torchvison fx unittests miss import pytest (#1277)	2 years ago
Jiarui Fang	c92f84fcdb	[tensor] distributed checkpointing for parameters (#1240)	2 years ago
Frank Lee	4a09fc0947	[fx] fixed tracing with apex-based T5 model (#1252) ... * [fx] fixed tracing with apex-based T5 model * polish code * polish code	2 years ago
YuliangLiu0306	97d713855a	[fx] methods to get fx graph property. (#1246) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * manipulation * [fx]add graph manipulation methods. * [fx]methods to get fx graph property. * add unit test * add docstring to explain top node and leaf node in this context	2 years ago
YuliangLiu0306	30b4fc0eb0	[fx]add split module pass and unit test from pipeline passes (#1242) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]add split module pass and unit test from pipeline passes * fix MNASNet bug * polish	2 years ago
Jiarui Fang	1aad903c15	[tensor] redistribute among different process groups (#1247) ... * make it faster * [tensor] rename convert_to_dist -> redistribute * [tensor] ShardSpec and ReplicaSpec * [tensor] redistribute among diff pgs * polish code	2 years ago
Jiarui Fang	9bcd2fd4af	[tensor] a shorter shard and replicate spec (#1245)	2 years ago
Jiarui Fang	2699dfbbfd	[rename] convert_to_dist -> redistribute (#1243)	2 years ago
HELSON	f6add9b720	[tensor] redirect .data.__get__ to a tensor instance (#1239)	2 years ago
Jiarui Fang	20da6e48c8	[checkpoint] save sharded optimizer states (#1237)	2 years ago
Jiarui Fang	4a76084dc9	[tensor] add zero_like colo op, important for Optimizer (#1236)	2 years ago
Jiarui Fang	3b500984b1	[tensor] fix some unittests (#1234)	2 years ago
HELSON	0453776def	[tensor] fix a assertion in colo_tensor cross_entropy (#1232)	2 years ago
Jiarui Fang	0e199d71e8	[hotfix] fx get comm size bugs (#1233) ... * init a checkpoint dir * [checkpoint]support resume for cosinewarmuplr * [checkpoint]add unit test * fix some bugs but still not OK * fix bugs * make it faster * [checkpoint]support generalized scheduler * polish * [tensor] torch function return colotensor * polish * fix bugs * remove debug info * polish * polish * [tensor] test_model pass unittests * polish * [hotfix] fx get comm size bug Co-authored-by: ZhaoYi1222 <zhaoyi9499@gmail.com>	2 years ago
HELSON	42ab36b762	[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)	2 years ago
Yi Zhao	04537bf83e	[checkpoint]support generalized scheduler (#1222)	2 years ago
Jiarui Fang	a98319f023	[tensor] torch function return colotensor (#1229)	2 years ago
Frank Lee	5581170890	[fx] fixed huggingface OPT and T5 results misalignment (#1227)	2 years ago
YuliangLiu0306	2b7dca44b5	[fx]get communication size between partitions (#1224) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]get communication size between partitions. * polish	2 years ago
Frank Lee	84f2298a96	[fx] added patches for tracing swin transformer (#1228)	2 years ago
Frank Lee	37fcf96b7f	[fx] fixed timm tracing result misalignment (#1225)	2 years ago
Frank Lee	b6cb5a47ad	[fx] added timm model tracing testing (#1221)	2 years ago
Jiarui Fang	15d988f954	[tensor] sharded global process group (#1219)	2 years ago
Frank Lee	11973d892d	[fx] added torchvision model tracing testing (#1216) ... * [fx] added torchvision model tracing testing * remove unused imports	2 years ago
Jiarui Fang	52736205d9	[checkpoint] make unitest faster (#1217)	2 years ago
Jiarui Fang	f38006ea83	[checkpoint] checkpoint for ColoTensor Model (#1196)	2 years ago
Jiarui Fang	ae7d3f4927	[refactor] move process group from _DistSpec to ColoTensor. (#1203)	2 years ago
Frank Lee	5da87ce35d	[fx] added testing for all albert variants (#1211)	2 years ago
Frank Lee	2d13a45a3b	[fx] added testing for all gpt variants (#1210) ... * [fx] added testing for all gpt variants * polish code * polish code	2 years ago
YuliangLiu0306	189946c5c4	[fx]add uniform policy (#1208) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]add uniform policy	2 years ago
Frank Lee	426a279ce7	[fx] added testing for all bert variants (#1207) ... * [fx] added testing for all bert variants * polish code	2 years ago
Frank Lee	f7878f465c	[fx] supported model tracing for huggingface bert (#1201) ... * [fx] supported model tracing for huggingface bert * polish test	2 years ago
Jiarui Fang	060b917daf	[refactor] remove gpc dependency in colotensor's _ops (#1189)	2 years ago
Frank Lee	abf6a262dc	[fx] added module patch for pooling layers (#1197)	2 years ago
YuliangLiu0306	63d2a93878	[context]support arbitary module materialization. (#1193) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [context]support arbitary module materialization. * [test]add numerical check for lazy init context.	2 years ago
YuliangLiu0306	2053e138a2	[context]use meta tensor to init model lazily. (#1187) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [context]use meta tensor to init model lazily. * polish * make module with device kwargs bypass the normal init. * change unit test to adapt updated context.	2 years ago
Frank Lee	2c8c05675d	[fx] patched conv and normalization (#1188)	2 years ago
Frank Lee	6d86f1bc91	[fx] supported data-dependent control flow in model tracing (#1185) ... * [fx] supported data-dependent control flow in model tracing * polish code	2 years ago
Jiarui Fang	c463f8adf9	[tensor] remove gpc in tensor tests (#1186)	2 years ago
Jiarui Fang	372f791444	[refactor] move chunk and chunkmgr to directory gemini (#1182)	2 years ago