575 Commits (7e8114a8ddbce5cf81f0f78e762854ab07faed45)

Author	SHA1	Message	Date
HELSON	abba4d84e1	[hotfix] fix bert model test in unitests (#1272)	2 years ago
ver217	7aadcbd070	hotfix colotensor _scan_for_pg_from_args (#1276)	2 years ago
oahzxl	0cf8e8e91c	[NFC] polish <colossalai/nn/lr_scheduler/poly.py> code style (#1267)	2 years ago
Jiarui Fang	c92f84fcdb	[tensor] distributed checkpointing for parameters (#1240)	2 years ago
Frank Lee	fb35460595	[fx] added ndim property to proxy (#1253)	2 years ago
Frank Lee	4a09fc0947	[fx] fixed tracing with apex-based T5 model (#1252) ... * [fx] fixed tracing with apex-based T5 model * polish code * polish code	2 years ago
Frank Lee	7531c6271f	[fx] refactored the file structure of patched function and module (#1238) ... * [fx] refactored the file structure of patched function and module * polish code	2 years ago
YuliangLiu0306	17ed33350b	[hotfix] fix an assertion bug in base schedule. (#1250)	2 years ago
YuliangLiu0306	97d713855a	[fx] methods to get fx graph property. (#1246) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * manipulation * [fx]add graph manipulation methods. * [fx]methods to get fx graph property. * add unit test * add docstring to explain top node and leaf node in this context	2 years ago
YuliangLiu0306	30b4fc0eb0	[fx]add split module pass and unit test from pipeline passes (#1242) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]add split module pass and unit test from pipeline passes * fix MNASNet bug * polish	2 years ago
Jiarui Fang	1aad903c15	[tensor] redistribute among different process groups (#1247) ... * make it faster * [tensor] rename convert_to_dist -> redistribute * [tensor] ShardSpec and ReplicaSpec * [tensor] redistribute among diff pgs * polish code	2 years ago
Jiarui Fang	9bcd2fd4af	[tensor] a shorter shard and replicate spec (#1245)	2 years ago
Jiarui Fang	2699dfbbfd	[rename] convert_to_dist -> redistribute (#1243)	2 years ago
HELSON	f6add9b720	[tensor] redirect .data.__get__ to a tensor instance (#1239)	2 years ago
Jiarui Fang	20da6e48c8	[checkpoint] save sharded optimizer states (#1237)	2 years ago
Jiarui Fang	4a76084dc9	[tensor] add zero_like colo op, important for Optimizer (#1236)	2 years ago
Jiarui Fang	3b500984b1	[tensor] fix some unittests (#1234)	2 years ago
ver217	a45ddf2d5f	[hotfix] fix sharded optim step and clip_grad_norm (#1226)	2 years ago
HELSON	f071b500b6	[polish] polish __repr__ for ColoTensor, DistSpec, ProcessGroup (#1235)	2 years ago
HELSON	0453776def	[tensor] fix a assertion in colo_tensor cross_entropy (#1232)	2 years ago
Jiarui Fang	0e199d71e8	[hotfix] fx get comm size bugs (#1233) ... * init a checkpoint dir * [checkpoint]support resume for cosinewarmuplr * [checkpoint]add unit test * fix some bugs but still not OK * fix bugs * make it faster * [checkpoint]support generalized scheduler * polish * [tensor] torch function return colotensor * polish * fix bugs * remove debug info * polish * polish * [tensor] test_model pass unittests * polish * [hotfix] fx get comm size bug Co-authored-by: ZhaoYi1222 <zhaoyi9499@gmail.com>	2 years ago
HELSON	42ab36b762	[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)	2 years ago
Yi Zhao	04537bf83e	[checkpoint]support generalized scheduler (#1222)	2 years ago
Jiarui Fang	a98319f023	[tensor] torch function return colotensor (#1229)	2 years ago
YuliangLiu0306	2b7dca44b5	[fx]get communication size between partitions (#1224) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]get communication size between partitions. * polish	2 years ago
Frank Lee	84f2298a96	[fx] added patches for tracing swin transformer (#1228)	2 years ago
Frank Lee	b6cb5a47ad	[fx] added timm model tracing testing (#1221)	2 years ago
HELSON	280a81243d	[tensor] improve robustness of class 'ProcessGroup' (#1223)	2 years ago
Jiarui Fang	15d988f954	[tensor] sharded global process group (#1219)	2 years ago
Jiarui Fang	db1bef9032	[hotfix] fx shard 1d pass bug fixing (#1220)	2 years ago
Frank Lee	11973d892d	[fx] added torchvision model tracing testing (#1216) ... * [fx] added torchvision model tracing testing * remove unused imports	2 years ago
Jiarui Fang	52736205d9	[checkpoint] make unitest faster (#1217)	2 years ago
Jiarui Fang	f38006ea83	[checkpoint] checkpoint for ColoTensor Model (#1196)	2 years ago
XYE	291e22aac6	[fx] temporarily used (#1215)	2 years ago
Jiarui Fang	ae7d3f4927	[refactor] move process group from _DistSpec to ColoTensor. (#1203)	2 years ago
Frank Lee	5da87ce35d	[fx] added testing for all albert variants (#1211)	2 years ago
Frank Lee	2d13a45a3b	[fx] added testing for all gpt variants (#1210) ... * [fx] added testing for all gpt variants * polish code * polish code	2 years ago
YuliangLiu0306	189946c5c4	[fx]add uniform policy (#1208) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]add uniform policy	2 years ago
Frank Lee	426a279ce7	[fx] added testing for all bert variants (#1207) ... * [fx] added testing for all bert variants * polish code	2 years ago
Jiarui Fang	b5f25eb32a	[Tensor] add cpu group to ddp (#1200)	2 years ago
Frank Lee	f7878f465c	[fx] supported model tracing for huggingface bert (#1201) ... * [fx] supported model tracing for huggingface bert * polish test	2 years ago
Jiarui Fang	060b917daf	[refactor] remove gpc dependency in colotensor's _ops (#1189)	2 years ago
Frank Lee	abf6a262dc	[fx] added module patch for pooling layers (#1197)	2 years ago
YuliangLiu0306	63d2a93878	[context]support arbitary module materialization. (#1193) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [context]support arbitary module materialization. * [test]add numerical check for lazy init context.	2 years ago
Jiarui Fang	a444633d13	warmup ratio configration (#1192)	2 years ago
ver217	dba7e0cfb4	make AutoPlacementPolicy configurable (#1191)	2 years ago
YuliangLiu0306	2053e138a2	[context]use meta tensor to init model lazily. (#1187) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [context]use meta tensor to init model lazily. * polish * make module with device kwargs bypass the normal init. * change unit test to adapt updated context.	2 years ago
Frank Lee	2c8c05675d	[fx] patched conv and normalization (#1188)	2 years ago
Frank Lee	6d86f1bc91	[fx] supported data-dependent control flow in model tracing (#1185) ... * [fx] supported data-dependent control flow in model tracing * polish code	2 years ago
Jiarui Fang	c463f8adf9	[tensor] remove gpc in tensor tests (#1186)	2 years ago