duanjunwen fe209164f1 [feat] add apply v_schedule graph; p & p.grad assert err exist;		2024-08-27 10:29:39 +00:00
..
__init__.py	[feat] add zerobubble pp (just a frame now); add POC test for dx_dw; add test for zerobubble;	2024-08-22 10:25:34 +00:00
_utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
base.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
generate.py	[hotfix] fix typo s/keywrods/keywords etc. (#5429)	2024-03-12 11:25:16 +08:00
interleaved_pp.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
one_f_one_b.py	[Feature] Zigzag Ring attention (#5905)	2024-08-16 13:56:38 +08:00
v_schedule.py	[feat] add apply v_schedule graph; p & p.grad assert err exist;	2024-08-27 10:29:39 +00:00
zero_bubble_pp.py	[feat] add run_fwd_bwd_with_microbatch (replace input) & test; add p&p.grad assert close test & all pass;	2024-08-27 09:31:38 +00:00