ColossalAI/colossalai/nn
HELSON e5ea3fdeef
[gemini] add GeminiMemoryManger (#832)
* refactor StatefulTensor, tensor utilities

* add unitest for GeminiMemoryManager
2022-04-24 13:08:48 +08:00
..
layer [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
loss [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
lr_scheduler Refactored docstring to google style 2022-03-29 17:17:47 +08:00
metric [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
model
optimizer [zero] improve adaptability for not-shard parameters (#708) 2022-04-11 13:38:51 +08:00
__init__.py Layer integration (#83) 2021-12-27 15:04:32 +08:00
init.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00