github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai
History
Hongxin Liu 50793b35f4
[gemini] accelerate inference (#3641) 
* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test
 		2023-04-26 16:32:40 +08:00
..
_C
…
_analyzer [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
amp [NFC] polish colossalai/amp/__init__.py code style (#3272) 2023-03-29 15:22:21 +08:00
auto_parallel [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
autochunk [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
booster [booster] add low level zero plugin (#3594) 2023-04-26 14:37:25 +08:00
builder
…
checkpoint_io [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
cli [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
cluster [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
communication [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
context [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
device
…
engine [format] Run lint on colossalai.engine (#3367) 2023-04-05 23:24:43 +08:00
fx [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
interface [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
kernel [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
logging
…
nn [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
pipeline [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
registry
…
tensor [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
testing [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
trainer
…
utils [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
zero [gemini] accelerate inference (#3641) 2023-04-26 16:32:40 +08:00
__init__.py
…
constants.py
…
core.py
…
global_variables.py [NFC] polish colossalai/global_variables.py code style (#3259) 2023-03-29 15:22:21 +08:00
initialize.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00