1312 Commits (ca6e75bc2864dbd72b3d370d5046a8eda9cc414c)

 

All Branches   

Search

Author	SHA1	Message	Date
Jiarui Fang	e56731e916	[hotfix] test_gpt.py duplicated (#1279) ... * make it faster * [hotfix] torchvison fx tests * [hotfix] rename duplicated named test_gpt.py	2 years ago
HELSON	abba4d84e1	[hotfix] fix bert model test in unitests (#1272)	2 years ago
YuliangLiu0306	01ea68b2e6	[tests] remove T5 test skip decorator (#1271)	2 years ago
Frank Lee	de498255b5	[release] v0.1.8 (#1278)	2 years ago
Jiarui Fang	ca9d5ee91c	[hotfix] torchvison fx unittests miss import pytest (#1277)	2 years ago
ver217	7aadcbd070	hotfix colotensor _scan_for_pg_from_args (#1276)	2 years ago
oahzxl	0cf8e8e91c	[NFC] polish <colossalai/nn/lr_scheduler/poly.py> code style (#1267)	2 years ago
Jiarui Fang	c92f84fcdb	[tensor] distributed checkpointing for parameters (#1240)	2 years ago
Sze-qq	49114d8df0	update GPT-3 visualisation	2 years ago
Frank Lee	fb35460595	[fx] added ndim property to proxy (#1253)	2 years ago
Frank Lee	4a09fc0947	[fx] fixed tracing with apex-based T5 model (#1252) ... * [fx] fixed tracing with apex-based T5 model * polish code * polish code	2 years ago
Frank Lee	7531c6271f	[fx] refactored the file structure of patched function and module (#1238) ... * [fx] refactored the file structure of patched function and module * polish code	2 years ago
YuliangLiu0306	17ed33350b	[hotfix] fix an assertion bug in base schedule. (#1250)	2 years ago
YuliangLiu0306	97d713855a	[fx] methods to get fx graph property. (#1246) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * manipulation * [fx]add graph manipulation methods. * [fx]methods to get fx graph property. * add unit test * add docstring to explain top node and leaf node in this context	2 years ago
YuliangLiu0306	30b4fc0eb0	[fx]add split module pass and unit test from pipeline passes (#1242) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]add split module pass and unit test from pipeline passes * fix MNASNet bug * polish	2 years ago
github-actions[bot]	762905da68	Automated submodule synchronization (#1241) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Jiarui Fang	1aad903c15	[tensor] redistribute among different process groups (#1247) ... * make it faster * [tensor] rename convert_to_dist -> redistribute * [tensor] ShardSpec and ReplicaSpec * [tensor] redistribute among diff pgs * polish code	2 years ago
Jiarui Fang	9bcd2fd4af	[tensor] a shorter shard and replicate spec (#1245)	2 years ago
Jiarui Fang	2699dfbbfd	[rename] convert_to_dist -> redistribute (#1243)	2 years ago
HELSON	f6add9b720	[tensor] redirect .data.__get__ to a tensor instance (#1239)	2 years ago
Jiarui Fang	20da6e48c8	[checkpoint] save sharded optimizer states (#1237)	2 years ago
Jiarui Fang	4a76084dc9	[tensor] add zero_like colo op, important for Optimizer (#1236)	2 years ago
Jiarui Fang	3b500984b1	[tensor] fix some unittests (#1234)	2 years ago
ver217	a45ddf2d5f	[hotfix] fix sharded optim step and clip_grad_norm (#1226)	2 years ago
HELSON	f071b500b6	[polish] polish __repr__ for ColoTensor, DistSpec, ProcessGroup (#1235)	2 years ago
HELSON	0453776def	[tensor] fix a assertion in colo_tensor cross_entropy (#1232)	2 years ago
Jiarui Fang	0e199d71e8	[hotfix] fx get comm size bugs (#1233) ... * init a checkpoint dir * [checkpoint]support resume for cosinewarmuplr * [checkpoint]add unit test * fix some bugs but still not OK * fix bugs * make it faster * [checkpoint]support generalized scheduler * polish * [tensor] torch function return colotensor * polish * fix bugs * remove debug info * polish * polish * [tensor] test_model pass unittests * polish * [hotfix] fx get comm size bug Co-authored-by: ZhaoYi1222 <zhaoyi9499@gmail.com>	2 years ago
HELSON	42ab36b762	[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)	2 years ago
Yi Zhao	04537bf83e	[checkpoint]support generalized scheduler (#1222)	2 years ago
Jiarui Fang	a98319f023	[tensor] torch function return colotensor (#1229)	2 years ago
Frank Lee	5581170890	[fx] fixed huggingface OPT and T5 results misalignment (#1227)	2 years ago
YuliangLiu0306	2b7dca44b5	[fx]get communication size between partitions (#1224) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]get communication size between partitions. * polish	2 years ago
github-actions[bot]	4951f7d80c	Automated submodule synchronization (#1204) ... Co-authored-by: github-actions <github-actions@github.com>	2 years ago
Frank Lee	84f2298a96	[fx] added patches for tracing swin transformer (#1228)	2 years ago
Frank Lee	37fcf96b7f	[fx] fixed timm tracing result misalignment (#1225)	2 years ago
Frank Lee	b6cb5a47ad	[fx] added timm model tracing testing (#1221)	2 years ago
HELSON	280a81243d	[tensor] improve robustness of class 'ProcessGroup' (#1223)	2 years ago
Jiarui Fang	15d988f954	[tensor] sharded global process group (#1219)	2 years ago
Jiarui Fang	db1bef9032	[hotfix] fx shard 1d pass bug fixing (#1220)	2 years ago
Frank Lee	11973d892d	[fx] added torchvision model tracing testing (#1216) ... * [fx] added torchvision model tracing testing * remove unused imports	2 years ago
Jiarui Fang	52736205d9	[checkpoint] make unitest faster (#1217)	2 years ago
Jiarui Fang	f38006ea83	[checkpoint] checkpoint for ColoTensor Model (#1196)	2 years ago
XYE	291e22aac6	[fx] temporarily used (#1215)	2 years ago
Jiarui Fang	ae7d3f4927	[refactor] move process group from _DistSpec to ColoTensor. (#1203)	2 years ago
Frank Lee	5da87ce35d	[fx] added testing for all albert variants (#1211)	2 years ago
Frank Lee	2d13a45a3b	[fx] added testing for all gpt variants (#1210) ... * [fx] added testing for all gpt variants * polish code * polish code	2 years ago
YuliangLiu0306	189946c5c4	[fx]add uniform policy (#1208) ... * [CLI] add CLI launcher * Revert "[CLI] add CLI launcher" This reverts commit df7e6506d4. * [fx]add uniform policy	2 years ago
Frank Lee	426a279ce7	[fx] added testing for all bert variants (#1207) ... * [fx] added testing for all bert variants * polish code	2 years ago
Jiarui Fang	b5f25eb32a	[Tensor] add cpu group to ddp (#1200)	2 years ago
Frank Lee	f7878f465c	[fx] supported model tracing for huggingface bert (#1201) ... * [fx] supported model tracing for huggingface bert * polish test	2 years ago