mirror of https://github.com/hpcaitech/ColossalAI
b3f5d7a3ba
* Feature/vit support (#4182) * [shardformer] added tests * [shardformer] vit test finish and support * fix attention dropout * support base vit pipeline * support vit downstream model * fix vit shard test * modify hidden states return type --------- Co-authored-by: Kun Lin <81014421+klhhhhh@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| diffusers | ||
| timm | ||
| torchaudio | ||
| torchrec | ||
| torchvision | ||
| transformers | ||
| __init__.py | ||
| registry.py | ||