Commit Graph

864 Commits (b2475d8c5ce1ecfe50c70ba5dc40fb4287d16939)
 

Author SHA1 Message Date
Frank Lee 7e8114a8dd
[hotfix] skipped unsafe test cases (#1282)
2 years ago
Jiarui Fang 79fe7b027a
[hotfix] test model unittest hotfix (#1281)
2 years ago
Jiarui Fang e56731e916 [hotfix] test_gpt.py duplicated (#1279)
2 years ago
HELSON abba4d84e1
[hotfix] fix bert model test in unitests (#1272)
2 years ago
YuliangLiu0306 01ea68b2e6
[tests] remove T5 test skip decorator (#1271)
2 years ago
Frank Lee de498255b5
[release] v0.1.8 (#1278)
2 years ago
Jiarui Fang ca9d5ee91c
[hotfix] torchvison fx unittests miss import pytest (#1277)
2 years ago
ver217 7aadcbd070
hotfix colotensor _scan_for_pg_from_args (#1276)
2 years ago
oahzxl 0cf8e8e91c
[NFC] polish <colossalai/nn/lr_scheduler/poly.py> code style (#1267)
2 years ago
Jiarui Fang c92f84fcdb
[tensor] distributed checkpointing for parameters (#1240)
2 years ago
Sze-qq 49114d8df0 update GPT-3 visualisation
2 years ago
Frank Lee fb35460595
[fx] added ndim property to proxy (#1253)
2 years ago
Frank Lee 4a09fc0947
[fx] fixed tracing with apex-based T5 model (#1252)
2 years ago
Frank Lee 7531c6271f
[fx] refactored the file structure of patched function and module (#1238)
2 years ago
YuliangLiu0306 17ed33350b
[hotfix] fix an assertion bug in base schedule. (#1250)
2 years ago
YuliangLiu0306 97d713855a
[fx] methods to get fx graph property. (#1246)
2 years ago
YuliangLiu0306 30b4fc0eb0
[fx]add split module pass and unit test from pipeline passes (#1242)
2 years ago
github-actions[bot] 762905da68
Automated submodule synchronization (#1241)
2 years ago
Jiarui Fang 1aad903c15
[tensor] redistribute among different process groups (#1247)
2 years ago
Jiarui Fang 9bcd2fd4af
[tensor] a shorter shard and replicate spec (#1245)
2 years ago
Jiarui Fang 2699dfbbfd
[rename] convert_to_dist -> redistribute (#1243)
2 years ago
HELSON f6add9b720
[tensor] redirect .data.__get__ to a tensor instance (#1239)
2 years ago
Jiarui Fang 20da6e48c8
[checkpoint] save sharded optimizer states (#1237)
2 years ago
Jiarui Fang 4a76084dc9
[tensor] add zero_like colo op, important for Optimizer (#1236)
2 years ago
Jiarui Fang 3b500984b1
[tensor] fix some unittests (#1234)
2 years ago
ver217 a45ddf2d5f
[hotfix] fix sharded optim step and clip_grad_norm (#1226)
2 years ago
HELSON f071b500b6
[polish] polish __repr__ for ColoTensor, DistSpec, ProcessGroup (#1235)
2 years ago
HELSON 0453776def
[tensor] fix a assertion in colo_tensor cross_entropy (#1232)
2 years ago
Jiarui Fang 0e199d71e8
[hotfix] fx get comm size bugs (#1233)
2 years ago
HELSON 42ab36b762
[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)
2 years ago
Yi Zhao 04537bf83e
[checkpoint]support generalized scheduler (#1222)
2 years ago
Jiarui Fang a98319f023
[tensor] torch function return colotensor (#1229)
2 years ago
Frank Lee 5581170890
[fx] fixed huggingface OPT and T5 results misalignment (#1227)
2 years ago
YuliangLiu0306 2b7dca44b5
[fx]get communication size between partitions (#1224)
2 years ago
github-actions[bot] 4951f7d80c
Automated submodule synchronization (#1204)
2 years ago
Frank Lee 84f2298a96
[fx] added patches for tracing swin transformer (#1228)
2 years ago
Frank Lee 37fcf96b7f
[fx] fixed timm tracing result misalignment (#1225)
2 years ago
Frank Lee b6cb5a47ad
[fx] added timm model tracing testing (#1221)
2 years ago
HELSON 280a81243d
[tensor] improve robustness of class 'ProcessGroup' (#1223)
2 years ago
Jiarui Fang 15d988f954
[tensor] sharded global process group (#1219)
2 years ago
Jiarui Fang db1bef9032
[hotfix] fx shard 1d pass bug fixing (#1220)
2 years ago
Frank Lee 11973d892d
[fx] added torchvision model tracing testing (#1216)
2 years ago
Jiarui Fang 52736205d9
[checkpoint] make unitest faster (#1217)
2 years ago
Jiarui Fang f38006ea83
[checkpoint] checkpoint for ColoTensor Model (#1196)
2 years ago
XYE 291e22aac6
[fx] temporarily used (#1215)
2 years ago
Jiarui Fang ae7d3f4927
[refactor] move process group from _DistSpec to ColoTensor. (#1203)
2 years ago
Frank Lee 5da87ce35d
[fx] added testing for all albert variants (#1211)
2 years ago
Frank Lee 2d13a45a3b
[fx] added testing for all gpt variants (#1210)
2 years ago
YuliangLiu0306 189946c5c4
[fx]add uniform policy (#1208)
2 years ago
Frank Lee 426a279ce7
[fx] added testing for all bert variants (#1207)
2 years ago