ColossalAI/colossalai/pipeline
Jianghai d0807122e2 [pipeline] test pure pipeline process using llama (#4218)
* bloom policy

* llama pipeline forward and tests

* fix the output and attention_mask

* fix name

* bind argument to policy

* Revert "bloom policy"

This reverts commit 8dee68a0a2.

This policy should be revert and copied to feature/bloom

* revert the bloom changes

* cancel unneeded inputs

* gpt

* finish llama

* causal lm and sequence classification

* revision

* add pure pipeline test

* fixed version

* fixed version

* pure pipeline
2023-08-15 23:25:14 +08:00
..
middleware [Pipeline Middleware] Adapt scheduler for Topo (#2066) 2022-12-05 20:23:41 +08:00
policy [pipeline] move bert related pipeline components to shardformer (#4187) 2023-08-15 23:25:14 +08:00
rpc [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
schedule [pipeline] All bert models (#4233) 2023-08-15 23:25:14 +08:00
__init__.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
layer_spec.py fix file name (#1759) 2022-10-25 16:48:48 +08:00
p2p.py [pipeline] test pure pipeline process using llama (#4218) 2023-08-15 23:25:14 +08:00
pipelinable.py [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
pipeline_process_group.py [pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684) 2022-10-10 16:01:02 +08:00
stage_manager.py [pipeline] add stage manager (#4093) 2023-08-15 23:25:14 +08:00
utils.py [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00