github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/legacy/trainer/hooks/__init__.py

27 lines
648 B
Python
Raw Normal View History

Migrated project
2021-10-28 16:21:23 +00:00
from ._base_hook import BaseHook
[model checkpoint] updated checkpoint hook (#598)
2022-04-01 08:53:03 +00:00
from ._checkpoint_hook import SaveCheckpointHook
[legacy] move trainer to legacy (#4545) * [legacy] move trainer to legacy * [doc] update docs related to trainer * [test] ignore legacy test
2023-08-31 05:51:28 +00:00
from ._log_hook import (
LogMemoryByEpochHook,
LogMetricByEpochHook,
LogMetricByStepHook,
LogTimingByEpochHook,
TensorboardHook,
)
Support TP-compatible Torch AMP and Update trainer API (#27) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit 2e0b0b76990e8d4e337add483d878c0f61cf5097. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>
2021-11-18 11:45:06 +00:00
from ._lr_scheduler_hook import LRSchedulerHook
Layer integration (#83) * integrated parallel layers for ease of building models * integrated 2.5d layers * cleaned codes and unit tests * added log metric by step hook; updated imagenet benchmark; fixed some bugs * reworked initialization; cleaned codes Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-27 07:04:32 +00:00
from ._metric_hook import AccuracyHook, LossHook, MetricHook, ThroughputHook
Migrated project
2021-10-28 16:21:23 +00:00
__all__ = [
[misc] update pre-commit and run all files (#4752) * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format
2023-09-19 06:20:26 +00:00
"BaseHook",
"MetricHook",
"LossHook",
"AccuracyHook",
"LogMetricByEpochHook",
"TensorboardHook",
"LogTimingByEpochHook",
"LogMemoryByEpochHook",
"LRSchedulerHook",
"ThroughputHook",
"LogMetricByStepHook",
"SaveCheckpointHook",
Migrated project
2021-10-28 16:21:23 +00:00
]