github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Browse Source

[fx] fixed apex normalization patch exception (#1352)

pull/1353/head
Frank Lee 2 years ago committed by GitHub
parent
ce470ba37e
commit
274c1a3b5f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Whitespace
Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL
Split View
Diff Options
Show Stats Download Patch File Download Diff File
  1. 2
      colossalai/fx/tracer/meta_patch/patched_module/normalization.py

2
colossalai/fx/tracer/meta_patch/patched_module/normalization.py
Unescape View File

@ -26,5 +26,5 @@ try:
meta_patched_module.register(apex.normalization.FusedRMSNorm)(torch_nn_normalize)
meta_patched_module.register(apex.normalization.MixedFusedLayerNorm)(torch_nn_normalize)
meta_patched_module.register(apex.normalization.MixedFusedRMSNorm)(torch_nn_normalize)
except ImportError:
except (ImportError, AttributeError):
pass

Write Preview
Loading…
Cancel
Save