github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'a77d73f22b'
${ noResults }
ColossalAI/tests/test_layers/test_2p5d/checks_2p5d/common.py

14 lines
220 B
Raw Normal View History Unescape

Migrated project
3 years ago
import torch
TESSERACT_DIM = 2
TESSERACT_DEP = 2
BATCH_SIZE = 8
SEQ_LENGTH = 8
HIDDEN_SIZE = 8
moved env variables to global variables; (#215) added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs
3 years ago
NUM_CLASSES = 8
VOCAB_SIZE = 16
IMG_SIZE = 16
Migrated project
3 years ago
def check_equal(A, B):
moved env variables to global variables; (#215) added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs
3 years ago
assert torch.allclose(A, B, rtol=1e-5, atol=1e-2)