ColossalAI/colossalai
Hongxin Liu 50793b35f4
[gemini] accelerate inference (#3641)
* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test
2023-04-26 16:32:40 +08:00
..
_C
_analyzer [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
amp
auto_parallel [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
autochunk [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
booster [booster] add low level zero plugin (#3594) 2023-04-26 14:37:25 +08:00
builder
checkpoint_io [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
cli [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
cluster
communication [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
context [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
device
engine
fx [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
interface
kernel [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
logging
nn [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
pipeline
registry
tensor [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
testing [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
trainer
utils [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
zero [gemini] accelerate inference (#3641) 2023-04-26 16:32:40 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py