github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/fx/tracer/meta_patch/patched_module/activation_function.py

14 lines
428 B
Python
Raw Normal View History

[fx] refactored the file structure of patched function and module (#1238) * [fx] refactored the file structure of patched function and module * polish code
2022-07-12 07:01:58 +00:00
import torch
[fx] support module with bias addition (#1780) * [autoparallel] refactor tracer to fix bias addition issue * [fx] support module with bias addition * create bias_addition_module * refactor file structure * polish code * fix unit test
2022-11-01 14:53:51 +00:00
from ...registry import meta_patched_module
[fx] refactored the file structure of patched function and module (#1238) * [fx] refactored the file structure of patched function and module * polish code
2022-07-12 07:01:58 +00:00
@meta_patched_module.register(torch.nn.ReLU)
@meta_patched_module.register(torch.nn.Sigmoid)
@meta_patched_module.register(torch.nn.GELU)
@meta_patched_module.register(torch.nn.Tanh)
@meta_patched_module.register(torch.nn.ReLU6)
[fx] add torchaudio test (#1369) * [fx]add torchaudio test * [fx]add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test * [fx] add torchaudio test and test patches * Delete ~ * [fx] add patches and patches test * [fx] add patches and patches test * [fx] fix patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] fix rnn patches * [fx] merge upstream * [fx] fix import errors
2022-07-27 03:03:14 +00:00
@meta_patched_module.register(torch.nn.PReLU)
[fx] refactored the file structure of patched function and module (#1238) * [fx] refactored the file structure of patched function and module * polish code
2022-07-12 07:01:58 +00:00
def torch_nn_non_linear_act(self, input):
return torch.empty(input.shape, device='meta')