mirror of https://github.com/hpcaitech/ColossalAI
[doc] fix op_builder/README.md (#3597)
Optimization Code change "requries" to "requires"pull/3603/head
parent
12eff9eb4c
commit
7570d9ae3d
|
@ -16,7 +16,7 @@ Method 2 is good because it allows the user to only build the kernel they actual
|
|||
## PyTorch Extensions in Colossal-AI
|
||||
|
||||
The project [DeepSpeed](https://github.com/microsoft/DeepSpeed) has proposed a [solution](https://github.com/microsoft/DeepSpeed/tree/master/op_builder) to support kernel-build during either installation or runtime.
|
||||
We have adapted from DeepSpeed's solution to build extensions. The extension build requries two main functions from PyTorch:
|
||||
We have adapted from DeepSpeed's solution to build extensions. The extension build requires two main functions from PyTorch:
|
||||
|
||||
1. `torch.utils.cpp_extension.CUDAExtension`: used to build extensions in `setup.py` during `pip install`.
|
||||
2. `torch.utils.cpp_extension.load`: used to build and load extension during runtime
|
||||
|
|
Loading…
Reference in New Issue