github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/examples/tutorial/fp8/mnist
History
Kirthi Shankar Sivamani 65a4dbda6c
[NVIDIA] Add FP8 example using TE (#3080) 
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
 		2023-03-10 16:24:08 +08:00
..
README.md [NVIDIA] Add FP8 example using TE (#3080) 2023-03-10 16:24:08 +08:00
main.py [NVIDIA] Add FP8 example using TE (#3080) 2023-03-10 16:24:08 +08:00

README.md

Basic MNIST Example with optional FP8

python main.py
python main.py --use-te   # Linear layers from TransformerEngine
python main.py --use-fp8  # FP8 + TransformerEngine for Linear layers