github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

[hotfix] pass a parameter. (#2288) 

* [autockpt] make it work.

* [autockpt] linearize / merge shape-consistency nodes.

* [autockpt] considering parameter and optimizer weights.

* [hotfix] pass a parameter.
pull/2258/head
Super Daniel 2023-01-03 18:05:06 +08:00 committed by GitHub
parent 22e947f982
commit 8ea50d999e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/auto_parallel/checkpoint/ckpt_solver_rotor.py
View File

@ -50,7 +50,7 @@ class CheckpointSolverRotor(CheckpointSolverBase):
optim_multiplier (float, optional): The multiplier of extra weight storage for the optim_multiplier (float, optional): The multiplier of extra weight storage for the
``torch.optim.Optimizer``. Default to 1.0. ``torch.optim.Optimizer``. Default to 1.0.
""" """
super().__init__(graph, free_memory, True, cnode) super().__init__(graph, free_memory, True, cnode, optim_multiplier)
self.memory_slots = memory_slots self.memory_slots = memory_slots
# construct chain # construct chain