Commit Graph

762 Commits (060b917daf80b2d2f45d7f90d8ef3e3f22b76792)
 

Author SHA1 Message Date
Jiarui Fang 060b917daf
[refactor] remove gpc dependency in colotensor's _ops (#1189)
2 years ago
Frank Lee abf6a262dc
[fx] added module patch for pooling layers (#1197)
2 years ago
github-actions[bot] 23442a5bc1
Automated submodule synchronization (#1194)
2 years ago
YuliangLiu0306 63d2a93878
[context]support arbitary module materialization. (#1193)
2 years ago
Jiarui Fang a444633d13
warmup ratio configration (#1192)
2 years ago
ver217 dba7e0cfb4
make AutoPlacementPolicy configurable (#1191)
2 years ago
YuliangLiu0306 2053e138a2
[context]use meta tensor to init model lazily. (#1187)
2 years ago
Frank Lee 2c8c05675d
[fx] patched conv and normalization (#1188)
2 years ago
github-actions[bot] 6f0733a1ef
Automated submodule synchronization (#1159)
2 years ago
Frank Lee 6d86f1bc91
[fx] supported data-dependent control flow in model tracing (#1185)
2 years ago
Jiarui Fang c463f8adf9
[tensor] remove gpc in tensor tests (#1186)
2 years ago
Jiarui Fang 372f791444
[refactor] move chunk and chunkmgr to directory gemini (#1182)
2 years ago
ver217 6b2f2ab9bb
[ddp] ColoDDP uses bucket all-reduce (#1177)
2 years ago
Jiarui Fang 7487215b95
[ColoTensor] add independent process group (#1179)
2 years ago
YuliangLiu0306 26ba87272d
[hotfix]fixed p2p process send stuck (#1181)
2 years ago
Jiarui Fang 1b657f9ce1
[tensor] revert local view back (#1178)
2 years ago
Jiarui Fang 0dd4e2bbfb
[Tensor] rename some APIs in TensorSpec and Polish view unittest (#1176)
2 years ago
Ziyue Jiang dd0420909f
[Tensor] rename parallel_action (#1174)
2 years ago
YuliangLiu0306 e27645376d
[hotfix]different overflow status lead to communication stuck. (#1175)
2 years ago
Jiarui Fang aa7bef73d4
[Tensor] distributed view supports inter-process hybrid parallel (#1169)
2 years ago
ver217 9e1daa63d2
[zero] sharded optim supports loading local state dict (#1170)
2 years ago
ver217 561e90493f
[zero] zero optim supports loading local state dict (#1171)
2 years ago
Jiarui Fang 4b9bba8116
[ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168)
2 years ago
Jiarui Fang f4ef224358
[Tensor] remove ParallelAction, use ComputeSpec instread (#1166)
2 years ago
Jiarui Fang 177c374401
remove gather out in parallel action (#1163)
2 years ago
Frank Lee 51f1ec96b0
[workflow] polish readme and dockerfile (#1165)
2 years ago
Frank Lee ca73028a3a
[workflow] auto-publish docker image upon release (#1164)
2 years ago
ver217 634eecb98e
mark sanity_check of dist_spec_mgr as staticmethod (#1161)
2 years ago
Ziyue Jiang 955ac912de
remove log (#1160)
2 years ago
ver217 4e67b2a890
fix chunk move device (#1158)
2 years ago
Jiarui Fang 07f9c781f9
[graph] improve the graph building. (#1157)
2 years ago
ver217 22717a856f
[tensor] add embedding bag op (#1156)
2 years ago
ver217 ae86151968
[tensor] add more element-wise ops (#1155)
2 years ago
github-actions[bot] e8c34eedfd
Automated submodule synchronization (#1129)
2 years ago
Frank Lee d415d73286
[workflow] fixed release post workflow (#1154)
2 years ago
ver217 54aabb8da4
[gemini] refactor gemini mgr (#1151)
2 years ago
Frank Lee f8eec98ff5
[tensor] fixed non-serializable colo parameter during model checkpointing (#1153)
2 years ago
ver217 ffa025e120
[tensor] dist spec s2s uses all-to-all (#1136)
2 years ago
Frank Lee c77da0dc81
[workflow] fixed format error in yaml file (#1145)
2 years ago
Jiarui Fang ff644ee5e4
polish unitest test with titans (#1152)
2 years ago
YuliangLiu0306 f1f51990b9
[hotfix]fix some bugs caused by refactored schedule. (#1148)
2 years ago
Jiarui Fang 8cdce0399c
[ColoTensor] improves init functions. (#1150)
2 years ago
ver217 8106d7b8c7
[ddp] refactor ColoDDP and ZeroDDP (#1146)
2 years ago
Frank Lee 0e4e62d30d
[tensor] added __repr__ to spec (#1147)
2 years ago
YuliangLiu0306 70dd88e2ee
[pipeline]add customized policy (#1139)
2 years ago
Frank Lee d1918304bb
[workflow] added workflow to auto draft the release post (#1144)
2 years ago
YuliangLiu0306 18091581c0
[pipeline]support more flexible pipeline (#1138)
2 years ago
ver217 ccf3c58c89
embedding op use gather_out (#1143)
2 years ago
Frank Lee e61dc31b05
[ci] added scripts to auto-generate release post text (#1142)
2 years ago
ver217 6690a61b4d
[hotfix] prevent nested ZeRO (#1140)
2 years ago