Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
HELSON d84e747975
[hotfix] add DISTPAN argument for benchmark (#2412)
2 years ago
..
images [doc] hotfix #2377 2 years ago
language [hotfix] add DISTPAN argument for benchmark (#2412) 2 years ago
tutorial [workflow] refactored the example check workflow (#2411) 2 years ago
README.md [workflow]New version: Create workflow files for examples' auto check (#2298) 2 years ago

README.md

Examples folder document

Table of Contents

Example folder description

This folder provides several examples using colossalai. The images folder includes model like diffusion, dreambooth and vit. The language folder includes gpt, opt, palm and roberta. The tutorial folder is for concept illustration, such as auto-parallel, hybrid-parallel and so on.

Integrate Your Example With System Testing

For example code contributor, to meet the expectation and test your code automatically using github workflow function, here are several steps:

  • (must) Have a test_ci.sh file in the folder like shown below in 'File Structure Chart'

  • The dataset should be located in the company's machine and can be announced using environment variable and thus no need for a separate terminal command.

  • The model parameters should be small to allow fast testing.

  • File Structure Chart

     └─examples
        └─images
            └─vit
              └─requirements.txt
              └─test_ci.sh