ColossalAI/colossalai
Hongxin Liu 50793b35f4
[gemini] accelerate inference (#3641)
* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test
2023-04-26 16:32:40 +08:00
..
_C
_analyzer
amp
auto_parallel
autochunk
booster
builder
checkpoint_io
cli
cluster
communication
context
device
engine
fx
interface
kernel
logging
nn
pipeline
registry
tensor
testing
trainer
utils
zero [gemini] accelerate inference (#3641) 2023-04-26 16:32:40 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py