HELSON 1468e4bcfc [zero] add constant placement policy (#1705) ... * fixes memory leak when paramter is in fp16 in ZeroDDP init. * bans chunk releasement in CUDA. Only when a chunk is about to offload, it is allowed to release. * adds a constant placement policy. With it, users can allocate a reserved caching memory space for parameters.		2022-10-14 17:53:16 +08:00
..
update	[zero] add constant placement policy (#1705)	2022-10-14 17:53:16 +08:00
test_gemini_manager.py	[gemini] add GeminiMemoryManger (#832)	2022-04-24 13:08:48 +08:00
test_param_op.py	[hotfix] add missing file (#1308)	2022-07-14 14:43:15 +08:00
test_stateful_tensor_mgr.py	[gemini] accelerate adjust_layout() (#878)	2022-04-26 18:08:31 +08:00