16 Commits (48ba22dbfd81d9b5bc1d294645024bbc0f89cff2)

Author	SHA1	Message	Date
duanjunwen	48ba22dbfd	[feat] fix optimizer bwd b & w; support return accum loss & output	2024-08-29 08:54:45 +00:00
duanjunwen	4c4b01b859	[feat] add optim backward_b_by_grad	2024-08-29 03:16:59 +00:00
duanjunwen	b1419ef76a	[fix] fix poc test; add comments in poc;	2024-08-28 05:47:53 +00:00
duanjunwen	582ba0d6ff	[feat] fix func name & ci; add comments;	2024-08-28 03:40:50 +00:00
duanjunwen	d6e3d7d2a3	[feat] fix ci; add assert;	2024-08-28 02:41:05 +00:00
duanjunwen	29383b2de0	[fix] update	2024-08-28 02:33:42 +00:00
duanjunwen	fe209164f1	[feat] add apply v_schedule graph; p & p.grad assert err exist;	2024-08-27 10:29:39 +00:00
duanjunwen	8b37323f16	[feat] add run_fwd_bwd_with_microbatch (replace input) & test; add p&p.grad assert close test & all pass;	2024-08-27 09:31:38 +00:00
duanjunwen	9e0bd1af00	[fix] fix ci test; add pytest;	2024-08-27 08:00:23 +00:00
duanjunwen	283c9ff5d2	[fix] rm useless assign and comments;	2024-08-27 07:31:58 +00:00
duanjunwen	f1c1a87246	[feat] add test for p & p grad;	2024-08-27 06:37:26 +00:00
duanjunwen	5e09c8b4e1	[feat] split communication and calculation; fix pop empty send_bwd_buffer error;	2024-08-27 06:29:13 +00:00
duanjunwen	1d75045c37	[feat] add test run_fwd_bwd automatic scheduling;	2024-08-26 11:21:56 +00:00
duanjunwen	203033ea16	[fix] fix weight not close;	2024-08-23 08:57:27 +00:00
duanjunwen	c18ef060cf	[feat] add dw test;	2024-08-23 06:04:12 +00:00
duanjunwen	ee9baedadf	[feat] add zerobubble pp (just a frame now); add POC test for dx_dw; add test for zerobubble;	2024-08-22 10:25:34 +00:00