ColossalAI

Author	SHA1	Message	Date
Jiarui Fang	db4cbdc7fb	[builder] builder for scaled_upper_triang_masked_softmax (#2234 )	2022-12-30 09:58:00 +08:00
HELSON	7010e18134	[example] update gpt example (#2225 )	2022-12-29 12:01:45 +08:00
Jiarui Fang	49c601da21	[example] add benchmark.sh for gpt (#2226 )	2022-12-29 12:00:00 +08:00
HELSON	3629e611cd	[example] update gpt benchmark (#2219 )	2022-12-29 10:51:42 +08:00
Jiarui Fang	7675792100	[builder] raise Error when CUDA_HOME is not set (#2213 )	2022-12-28 16:07:08 +08:00
Jiarui Fang	d5e3e3ec01	[example] update gpt example for larger model scale (#2211 )	2022-12-28 13:54:08 +08:00
Jiarui Fang	29868a9ec1	[example] update gpt readme with performance (#2206 )	2022-12-27 17:39:53 +08:00
Jiarui Fang	65f56f49e8	[example] gpt demo more accuracy tflops (#2178 )	2022-12-22 20:51:35 +08:00
HELSON	a7d95b7024	[example] add zero1, zero2 example in GPT examples (#2146 ) * [example] add zero1 and zero2 for GPT * update readme in gpt example * polish code * change init value * update readme	2022-12-20 14:30:27 +08:00
Jiarui Fang	f7e276fa71	[Gemini] add GeminiAdamOptimizer (#1960 )	2022-11-16 14:44:28 +08:00
Jiarui Fang	60abd86d6a	[example] enhance GPT demo (#1959 ) * [example] enhence GPT demo * Update README.md Co-authored-by: binmakeswell <binmakeswell@gmail.com>	2022-11-16 11:36:27 +08:00
Jiarui Fang	a25f755331	[example] add TP to GPT example (#1828 )	2022-11-08 17:17:19 +08:00
Jiarui Fang	b1263d32ba	[example] simplify the GPT2 huggingface example (#1826 )	2022-11-08 16:14:07 +08:00