ColossalAI/colossalai
Jiarui Fang 7ef3507ace
[zero] show model data cuda memory usage after zero context init. (#515)
2022-03-25 11:23:35 +08:00
..
amp [hotfix] fix initialize bug with zero (#442) 2022-03-17 13:16:22 +08:00
builder add pytorch hooks (#179) 2022-01-25 22:20:54 +08:00
communication fix format (#332) 2022-03-11 15:50:28 +08:00
context [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
engine [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
kernel [formart] format fixed for kernel\cuda_native codes (#335) 2022-03-11 15:50:28 +08:00
logging [install] run with out rich (#513) 2022-03-24 17:39:50 +08:00
nn [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
registry add pytorch hooks (#179) 2022-01-25 22:20:54 +08:00
testing [test] added rerun on exception for testing (#475) 2022-03-21 15:51:57 +08:00
trainer Added profiler communication operations 2022-03-11 15:50:28 +08:00
utils [zero] show model data cuda memory usage after zero context init. (#515) 2022-03-25 11:23:35 +08:00
zero [zero] show model data cuda memory usage after zero context init. (#515) 2022-03-25 11:23:35 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
constants.py fix format constants.py (#358) 2022-03-11 15:50:28 +08:00
core.py [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
global_variables.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 2022-03-21 13:35:04 +08:00
initialize.py [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00