Module livekit.agents.ipc.inference_executor

Classes

class InferenceExecutor (*args, **kwargs)

Expand source code

class InferenceExecutor(Protocol):
    async def do_inference(self, method: str, data: bytes) -> bytes | None: ...

Base class for protocol classes.

Protocol classes are defined as::

class Proto(Protocol):
    def meth(self) -> int:
        ...

Such classes are primarily used with static type checkers that recognize structural subtyping (static duck-typing).

For example::

class C:
    def meth(self) -> int:
        return 0

def func(x: Proto) -> int:
    return x.meth()

func(C())  # Passes static type check

See PEP 544 for details. Protocol classes decorated with @typing.runtime_checkable act as simple-minded runtime protocols that check only the presence of given attributes, ignoring their type signatures. Protocol classes can be generic, they are defined as::

class GenProto[T](Protocol):
    def meth(self) -> T:
        ...

Ancestors

• typing.Protocol
• typing.Generic

Subclasses

• livekit.agents.ipc.job_proc_lazy_main._InfClient

Methods

async def do_inference(self, method: str, data: bytes) ‑> bytes | None

Expand source code

async def do_inference(self, method: str, data: bytes) -> bytes | None: ...