| .. |
|
amp
|
[fp16] refactored fp16 optimizer (#392)
|
2022-03-15 10:05:38 +08:00 |
|
builder
|
add pytorch hooks (#179)
|
2022-01-25 22:20:54 +08:00 |
|
communication
|
fix format (#332)
|
2022-03-11 15:50:28 +08:00 |
|
context
|
fixed bug in activation checkpointing test (#387)
|
2022-03-11 15:50:28 +08:00 |
|
engine
|
[polish] use GLOBAL_MODEL_DATA_TRACER (#417)
|
2022-03-15 11:29:46 +08:00 |
|
kernel
|
[formart] format fixed for kernel\cuda_native codes (#335)
|
2022-03-11 15:50:28 +08:00 |
|
logging
|
fixed mkdir conflict and align yapf config with flake (#220)
|
2022-02-15 11:31:13 +08:00 |
|
nn
|
removed noisy function during evaluation of MoE router (#419)
|
2022-03-15 12:06:09 +08:00 |
|
registry
|
add pytorch hooks (#179)
|
2022-01-25 22:20:54 +08:00 |
|
trainer
|
Added profiler communication operations
|
2022-03-11 15:50:28 +08:00 |
|
utils
|
[zero] cuda margin space for OS (#418)
|
2022-03-15 12:02:19 +08:00 |
|
zero
|
[zero] cuda margin space for OS (#418)
|
2022-03-15 12:02:19 +08:00 |
|
__init__.py
|
Develop/experiments (#59)
|
2021-12-09 15:08:29 +08:00 |
|
constants.py
|
fix format constants.py (#358)
|
2022-03-11 15:50:28 +08:00 |
|
core.py
|
Develop/experiments (#59)
|
2021-12-09 15:08:29 +08:00 |
|
global_variables.py
|
Optimized MoE layer and fixed some bugs;
|
2022-03-11 15:50:28 +08:00 |
|
initialize.py
|
[fp16] refactored fp16 optimizer (#392)
|
2022-03-15 10:05:38 +08:00 |
3f70a2b12f