ColossalAI/colossalai/pipeline/schedule
duanjunwen 26783776f1 [fix] fix input_tensors buffer append input_obj(dict) --> Tuple (microbatch, input_obj) , and all bwd b related cal logic; 2024-09-20 06:41:19 +00:00
..
__init__.py [feat] add zerobubble pp (just a frame now); add POC test for dx_dw; add test for zerobubble; 2024-08-22 10:25:34 +00:00
_utils.py [fix] fix require_grad & deallocate call; 2024-09-19 05:53:03 +00:00
base.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
generate.py [hotfix] fix typo s/keywrods/keywords etc. (#5429) 2024-03-12 11:25:16 +08:00
interleaved_pp.py [Feature] Zigzag Ring attention (#5905) 2024-08-16 13:56:38 +08:00
one_f_one_b.py [Feature] Zigzag Ring attention (#5905) 2024-08-16 13:56:38 +08:00
v_schedule.py [fix] fix optim bwd; add license for v_schedule; remove redundant attributes; fix schedule loop "while"--> "for"; add communication dict; 2024-08-30 05:42:43 +00:00
zero_bubble_pp.py [fix] fix input_tensors buffer append input_obj(dict) --> Tuple (microbatch, input_obj) , and all bwd b related cal logic; 2024-09-20 06:41:19 +00:00