You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/zero/low_level/bookkeeping
LuGY 839847b7d7
[zero]support zero2 with gradient accumulation (#4511)
1 year ago
..
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2 years ago
base_store.py [zero] reorganize zero/gemini folder structure (#3424) 2 years ago
bucket_store.py [hotfix] fix unsafe async comm in zero (#4404) 1 year ago
gradient_store.py [zero]support zero2 with gradient accumulation (#4511) 1 year ago
parameter_store.py [zero] refactor low level zero for shard evenly (#4030) 1 year ago
tensor_bucket.py [zero] reorganize zero/gemini folder structure (#3424) 2 years ago