ColossalAI/colossalai/zero
Hanks cc40fe0e6f
[fix] multi-node backward slowdown (#6134)
* remove redundant memcpy during backward

* get back record_stream
2024-11-14 17:45:49 +08:00
..
gemini [plugin] support get_grad_norm (#6115) 2024-11-05 18:12:47 +08:00
low_level [fix] multi-node backward slowdown (#6134) 2024-11-14 17:45:49 +08:00
__init__.py [shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088) 2023-11-28 16:54:42 +08:00
wrapper.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00