mirror of https://github.com/hpcaitech/ColossalAI
b3f5d7a3ba
* Feature/vit support (#4182) * [shardformer] added tests * [shardformer] vit test finish and support * fix attention dropout * support base vit pipeline * support vit downstream model * fix vit shard test * modify hidden states return type --------- Co-authored-by: Kun Lin <81014421+klhhhhh@users.noreply.github.com> |
||
---|---|---|
.. | ||
__init__.py | ||
_utils.py | ||
test_pure_pipeline.py | ||
test_shard_bert.py | ||
test_shard_bert_pipeline.py | ||
test_shard_bloom.py | ||
test_shard_bloom_pipeline.py | ||
test_shard_gpt2.py | ||
test_shard_gpt2_pipeline.py | ||
test_shard_llama.py | ||
test_shard_llama_pipeline.py | ||
test_shard_opt.py | ||
test_shard_opt_pipeline.py | ||
test_shard_t5.py | ||
test_shard_t5_pipeline.py | ||
test_shard_vit.py | ||
test_shard_vit_pipeline.py |