Skip to content

eval

fastvideo eval CLI: list registered eval metrics and run them against a set of videos.

This is a thin wrapper around :mod:fastvideo.eval. Heavy lifting (metric loading, GPU handling, batching) lives in :func:fastvideo.eval.create_evaluator.

Examples::

fastvideo eval list
fastvideo eval list --group vbench
fastvideo eval run --videos path/to/videos/*.mp4 \
    --metrics common.ssim --reference path/to/refs/
fastvideo eval run --videos clip.mp4 --metrics vbench.aesthetic_quality \
    --output scores.json

Classes

fastvideo.entrypoints.cli.eval.EvalSubcommand

EvalSubcommand()

Bases: CLISubcommand

The eval subcommand — entry point for the eval suite.

Source code in fastvideo/entrypoints/cli/eval.py
def __init__(self) -> None:
    self.name = "eval"
    super().__init__()

Functions