You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/zero
botbw 8e718a1421
[gemini] fixes for benchmarking (#5847)
5 months ago
..
gemini [gemini] fixes for benchmarking (#5847) 5 months ago
low_level [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
__init__.py [shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088) 1 year ago
wrapper.py [misc] update pre-commit and run all files (#4752) 1 year ago