Skip to content

ray_distributed_executor

Classes

fastvideo.worker.ray_distributed_executor.RayDistributedExecutor 

RayDistributedExecutor(fastvideo_args: FastVideoArgs, *, log_queue=None)

Bases: Executor

Ray-based distributed executor

Source code in fastvideo/worker/executor.py 
18
19
20
21
22
23
24
25
26
27
def __init__(
    self,
    fastvideo_args: FastVideoArgs,
    *,
    log_queue=None,
):
    self.fastvideo_args = fastvideo_args
    self._log_queue = log_queue

    self._init_executor()

fastvideo.worker.ray_distributed_executor.RayWorkerMetaData dataclass 

RayWorkerMetaData(worker: ActorHandle, created_rank: int, adjusted_rank: int = -1, ip: str = '')

Metadata for a Ray worker. The order of ray worker creation can be random, and we need to reset the rank after creating all workers.

Functions