API Reference

This section includes reference material you may need to consult when working with LEIP Optimize.

forge: Target and Environment functions for working with Forge.

forge.frontend: Functions for loading models from a variety of frameworks.

forge.IRModule: A class for calibration, optimization, quantization, and graph-based manipulation of models using the Relay Intermediate Representation.

forge.GraphExecutor: Load and run a compiled model for quick and easy testing, debugging, and approximate benchmarking.

forge.relay: Two classes designed to aid navigating and referencing the TVM codebase.

forge.relay.graph.enums: All of the enumerations in the Forge codebase.

forge.relay.graph.graph: The Forge Graph class wraps around the igraph.Graph object that is initialized by the graphical encoding provided by the graph-core API.

forge.relay.graph.node: The Forge Node class wraps around the igraph.Vertex object that is initialized by the graphical encoding provided by the graph-core API.

forge.relay.graph.graph_core: Core components that enable Forge's graphical support of Relay.

forge.onnx.irmodule.ONNXModule: Class for quantizing and exporting ONNX models for use with LEIP Deploy.

forge.onnx.inference: Functions for ONNX runtime inferences.