You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai
Jiarui Fang 214da761d4
[zero] add stateful tensor (#549)
3 years ago
..
amp Refactored docstring to google style 3 years ago
builder Refactored docstring to google style 3 years ago
communication Refactored docstring to google style 3 years ago
context Refactored docstring to google style 3 years ago
engine [zero] add stateful tensor (#549) 3 years ago
kernel [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 3 years ago
logging Refactored docstring to google style 3 years ago
nn [TP] Add gather_out arg to Linear (#541) 3 years ago
registry Refactored docstring to google style 3 years ago
testing [test] fixed rerun_on_exception and adapted test cases (#487) 3 years ago
trainer Refactored docstring to google style 3 years ago
utils [zero] dump memory stats for sharded model (#548) 3 years ago
zero [zero] add stateful tensor (#549) 3 years ago
__init__.py Develop/experiments (#59) 3 years ago
constants.py fix format constants.py (#358) 3 years ago
core.py [polish] polish singleton and global context (#500) 3 years ago
global_variables.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 3 years ago
initialize.py Refactored docstring to google style 3 years ago