Latency

Module: benchmarks.performance.latency

Source: benchmarks/performance/latency.py

Overview

Latency benchmark for generative models.

This module provides benchmarks for measuring inference latency of generative models. It supports both sampling-based and prediction-based inference.

Classes

LatencyBenchmark

class LatencyBenchmark

Functions

init

def __init__()

measure_inference_latency

def measure_inference_latency()

run

def run()

Module Statistics

• Classes: 1
• Functions: 3
• Imports: 7