You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

ver217 ad536e308e [tensor] refactor colo-tensor (#992) ... * refactor colo-tensor and update linear op * polish code * polish code * update ops and unit tests * update unit tests * polish code * rename dist_spec module * polish code * polish code * remove unneeded import * fix pipelinable		3 years ago
..
components_to_test	[Tensor] add 1d vocab loss (#918)	3 years ago
test_amp	[test] refactored with the new rerun decorator (#763)	3 years ago
test_comm	[test] refactored with the new rerun decorator (#763)	3 years ago
test_config	[test] removed trivial outdated test	3 years ago
test_context	[test] refactored with the new rerun decorator (#763)	3 years ago
test_data	[unittest] refactored unit tests for change in dependency (#838)	3 years ago
test_data_pipeline_tensor_parallel	[refactor] moving grad acc logic to engine (#804)	3 years ago
test_engine	[refactor] moving grad acc logic to engine (#804)	3 years ago
test_gemini	[gemini] accelerate adjust_layout() (#878)	3 years ago
test_layers	[test] refactored with the new rerun decorator (#763)	3 years ago
test_moe	[test] refactored with the new rerun decorator (#763)	3 years ago
test_optimizer	[zero]added hybrid adam, removed loss scale in adam (#527)	3 years ago
test_tensor	[tensor] refactor colo-tensor (#992)	3 years ago
test_trainer	[test] refactored with the new rerun decorator (#763)	3 years ago
test_utils	[gemini] add GeminiMemoryManger (#832)	3 years ago
test_zero	[gemini] add GeminiMemoryManger (#832)	3 years ago
__init__.py	[zero] Update sharded model v2 using sharded param v2 (#323)	3 years ago