16 Commits (da1c47f0603c51d1aeabd64f52b14d2c8b84b2b0)

Author	SHA1	Message	Date
HELSON	e00cedd181	[example] update gemini benchmark bash (#2306)	2023-01-04 11:59:26 +08:00
Ziyue Jiang	ac863a01d6	[example] add benchmark (#2276) ... * add benchmark * merge common func * add total and avg tflops Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>	2023-01-03 17:20:59 +08:00
HELSON	09c0102fe6	[example] fix gpt example with 0.1.10 (#2265)	2023-01-03 13:38:14 +08:00
Jiarui Fang	db4cbdc7fb	[builder] builder for scaled_upper_triang_masked_softmax (#2234)	2022-12-30 09:58:00 +08:00
HELSON	7010e18134	[example] update gpt example (#2225)	2022-12-29 12:01:45 +08:00
Jiarui Fang	49c601da21	[example] add benchmark.sh for gpt (#2226)	2022-12-29 12:00:00 +08:00
HELSON	3629e611cd	[example] update gpt benchmark (#2219)	2022-12-29 10:51:42 +08:00
Jiarui Fang	7675792100	[builder] raise Error when CUDA_HOME is not set (#2213)	2022-12-28 16:07:08 +08:00
Jiarui Fang	d5e3e3ec01	[example] update gpt example for larger model scale (#2211)	2022-12-28 13:54:08 +08:00
Jiarui Fang	29868a9ec1	[example] update gpt readme with performance (#2206)	2022-12-27 17:39:53 +08:00
Jiarui Fang	65f56f49e8	[example] gpt demo more accuracy tflops (#2178)	2022-12-22 20:51:35 +08:00
HELSON	a7d95b7024	[example] add zero1, zero2 example in GPT examples (#2146) ... * [example] add zero1 and zero2 for GPT * update readme in gpt example * polish code * change init value * update readme	2022-12-20 14:30:27 +08:00
Jiarui Fang	f7e276fa71	[Gemini] add GeminiAdamOptimizer (#1960)	2022-11-16 14:44:28 +08:00
Jiarui Fang	60abd86d6a	[example] enhance GPT demo (#1959) ... * [example] enhence GPT demo * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2022-11-16 11:36:27 +08:00
Jiarui Fang	a25f755331	[example] add TP to GPT example (#1828)	2022-11-08 17:17:19 +08:00
Jiarui Fang	b1263d32ba	[example] simplify the GPT2 huggingface example (#1826)	2022-11-08 16:14:07 +08:00