mirror of https://github.com/hpcaitech/ColossalAI
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Frank Lee
63be79d505
|
2 years ago | |
---|---|---|
.. | ||
images | ||
language | 2 years ago | |
tutorial | 2 years ago | |
README.md |
README.md
Examples folder document
Table of Contents
Example folder description
This folder provides several examples using colossalai. The images folder includes model like diffusion, dreambooth and vit. The language folder includes gpt, opt, palm and roberta. The tutorial folder is for concept illustration, such as auto-parallel, hybrid-parallel and so on.
Integrate Your Example With System Testing
For example code contributor, to meet the expectation and test your code automatically using github workflow function, here are several steps:
-
(must) Have a test_ci.sh file in the folder like shown below in 'File Structure Chart'
-
The dataset should be located in the company's machine and can be announced using environment variable and thus no need for a separate terminal command.
-
The model parameters should be small to allow fast testing.
-
File Structure Chart
└─examples └─images └─vit └─requirements.txt └─test_ci.sh