68 Commits (39f2582e987871c198f2f2526cd4435cbd569741)

Author SHA1 Message Date
Jiarui Fang 372f791444
[refactor] move chunk and chunkmgr to directory gemini (#1182) 2 years ago
ver217 9e1daa63d2
[zero] sharded optim supports loading local state dict (#1170) 2 years ago
ver217 561e90493f
[zero] zero optim supports loading local state dict (#1171) 2 years ago
Frank Lee 65ee6dcc20
[test] ignore 8 gpu test (#1080) 2 years ago
HELSON e5ea3fdeef
[gemini] add GeminiMemoryManger (#832) 3 years ago
Jiarui Fang e761ad2cd7
Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) 3 years ago
HELSON 88759e289e
[zero] add ZeroTensorShardStrategy (#793) 3 years ago
Jiarui Fang 4d9332b4c5
[refactor] moving memtracer to gemini (#801) 3 years ago
HELSON 4c4388c46e
[hotfix] fix memory leak in zero (#781) 3 years ago
Frank Lee 5a1a095b92
[test] refactored with the new rerun decorator (#763) 3 years ago
Jiarui Fang 10ef8afdd2
[gemini] init genimi individual directory (#754) 3 years ago
ver217 dcca614eee
[hotfix] fix test_stateful_tensor_mgr (#762) 3 years ago
ver217 a93a7d7364
[hotfix] fix reuse_fp16_shard of sharded model (#756) 3 years ago
HELSON 84c6700b2a
[zero] refactor memstats_collector (#746) 3 years ago
ver217 e396bb71f2
[zero] add tensor placement policies (#743) 3 years ago
HELSON 22c4b88d56
[zero] refactor ShardedParamV2 for convenience (#742) 3 years ago
Frank Lee f4f42d4c3c
[bug] fixed DDP compatibility with torch 1.8 (#739) 3 years ago
Jiarui Fang 53cb584808
[utils] correct cpu memory used and capacity in the context of multi-process (#726) 3 years ago