17 Commits (89f048a88a3cef7b87b77f89cd32daaa517d8ae5)

Author	SHA1	Message	Date
Jiarui Fang	db4cbdc7fb	[builder] builder for scaled_upper_triang_masked_softmax (#2234)	2022-12-30 09:58:00 +08:00
HELSON	31fe84237b	[example] fix benchmark.sh for gpt example (#2229)	2022-12-29 23:00:14 +08:00
HELSON	7010e18134	[example] update gpt example (#2225)	2022-12-29 12:01:45 +08:00
Jiarui Fang	49c601da21	[example] add benchmark.sh for gpt (#2226)	2022-12-29 12:00:00 +08:00
HELSON	3629e611cd	[example] update gpt benchmark (#2219)	2022-12-29 10:51:42 +08:00
Jiarui Fang	7675792100	[builder] raise Error when CUDA_HOME is not set (#2213)	2022-12-28 16:07:08 +08:00
Jiarui Fang	d96cc37e32	[example] update GPT example benchmark results (#2212)	2022-12-28 14:28:12 +08:00
Jiarui Fang	d5e3e3ec01	[example] update gpt example for larger model scale (#2211)	2022-12-28 13:54:08 +08:00
Jiarui Fang	29868a9ec1	[example] update gpt readme with performance (#2206)	2022-12-27 17:39:53 +08:00
Jiarui Fang	65f56f49e8	[example] gpt demo more accuracy tflops (#2178)	2022-12-22 20:51:35 +08:00
HELSON	a7d95b7024	[example] add zero1, zero2 example in GPT examples (#2146) ... * [example] add zero1 and zero2 for GPT * update readme in gpt example * polish code * change init value * update readme	2022-12-20 14:30:27 +08:00
ZijianYY	fa9d1aea71	[example] update GPT README (#2095)	2022-12-07 15:47:37 +08:00
Jiarui Fang	f7e276fa71	[Gemini] add GeminiAdamOptimizer (#1960)	2022-11-16 14:44:28 +08:00
Jiarui Fang	60abd86d6a	[example] enhance GPT demo (#1959) ... * [example] enhence GPT demo * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2022-11-16 11:36:27 +08:00
Jiarui Fang	a25f755331	[example] add TP to GPT example (#1828)	2022-11-08 17:17:19 +08:00
Jiarui Fang	b1263d32ba	[example] simplify the GPT2 huggingface example (#1826)	2022-11-08 16:14:07 +08:00
Jiarui Fang	203ca57aed	[example] add GPT	2022-11-08 10:58:17 +08:00