modalities.training.activation_checkpointing package

Submodules

modalities.training.activation_checkpointing.activation_checkpointing module

modalities.training.activation_checkpointing.activation_checkpointing_variants module

class modalities.training.activation_checkpointing.activation_checkpointing_variants.ActivationCheckpointingVariants(value)[source]

Bases: Enum

Enum for the different activation checkpointing variants.

FULL_ACTIVATION_CHECKPOINTING = 'full_activation_checkpointing'

SELECTIVE_LAYER_ACTIVATION_CHECKPOINTING = 'selective_layer_activation_checkpointing'

SELECTIVE_OP_ACTIVATION_CHECKPOINTING = 'selective_op_activation_checkpointing'

Module contents