Edenzzzz 8795bb2e80 Support 4d parallel + flash attention (#5789) ... * support tp + sp + pp * remove comments --------- Co-authored-by: Edenzzzz <wtan45@wisc.edu>		2024-06-17 17:40:47 +08:00
..
bert	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
commons	[example] make gpt example directory more clear (#2353)	2023-01-06 11:11:26 +08:00
gpt	[chore] refactor profiler utils	2024-05-28 12:41:42 +00:00
grok-1	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
llama	Support 4d parallel + flash attention (#5789)	2024-06-17 17:40:47 +08:00
openmoe	[hotfix] fix OpenMOE example import path (#5697)	2024-05-08 15:48:47 +08:00
opt	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
palm	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
__init__.py	[example]add gpt2 benchmark example script. (#5295)	2024-03-04 16:18:13 +08:00
data_utils.py	[devops] remove post commit ci (#5566)	2024-04-08 15:09:40 +08:00
model_utils.py	[example]add gpt2 benchmark example script. (#5295)	2024-03-04 16:18:13 +08:00
performance_evaluator.py	[chore] refactor profiler utils	2024-05-28 12:41:42 +00:00