---
title: vbench
---

<div class="python-reference">

<a id="fastvideo.eval.metrics.vbench"></a>
<p>VBench metrics. Bootstraps upstream submodule on sys.path and
installs runtime compat shims for modern torch/transformers/numpy/timm.</p>
<p>The upstream vbench source lives as a git submodule at
<code>fastvideo/third_party/eval/vbench</code> (pinned to a specific
Vchitect/VBench SHA). We do not pip-install it — we only need its
Python modules importable. Its runtime deps (clip, transformers, etc.)
are already in FastVideo's main env.</p>
<p>Compat with modern dependency versions is achieved at import time, in
this file, instead of via on-disk patches to upstream files. Each shim
below corresponds to a specific drift between vbench's pinned-2023 deps
and FastVideo's current pins. Adding a new shim is preferable to editing
the submodule.</p>
</div>

<h2>Submodules</h2>
<ul>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/aesthetic_quality">aesthetic_quality</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/appearance_style">appearance_style</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/background_consistency">background_consistency</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/color">color</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/dynamic_degree">dynamic_degree</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/human_action">human_action</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/imaging_quality">imaging_quality</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/motion_smoothness">motion_smoothness</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/multiple_objects">multiple_objects</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/object_class">object_class</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/overall_consistency">overall_consistency</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/scene">scene</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/spatial_relationship">spatial_relationship</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/subject_consistency">subject_consistency</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/temporal_flickering">temporal_flickering</a></li>
<li><a href="/FastVideo/api/fastvideo/eval/metrics/vbench/temporal_style">temporal_style</a></li>
</ul>