layerwise_offload ¶

Classes¶

LayerwiseOffloadHook(state: LayerwiseOffloadState)

A hook that enables layerwise CPU offloading during forward pass.

Source code in fastvideo/hooks/layerwise_offload.py

def __init__(self, state: LayerwiseOffloadState) -> None:
    self.state = state