Rspress

# #PTQ Conversion Tool Overview

This section introduces you to the tools in the PTQ toolkit provided by the Algorithmic Toolchain and assists you in quickly understanding the use of the tools in the PTQ conversion process and their basic functionality.

The following is a brief description of PTQ conversion tools, you can read the corresponding tools as needed.

Tools | Tools Introduction
The hb_compile Tool | The `hb_compile` is a tool provided by Horizon, which maps floating-point models to quantized models and provides the model checking function as well as the model modification function. It supports following usage scenarios: model checking, model quantized compilation and model modification.
The hb_model_info Tool | The `hb_model_info` is a tool provided by Horizon, which is used to parse the dependencies and parameters of the *.hbm and the *.bc in compilation, and support the checking of *.bc deletable nodes.
The hb_verifier Tool | The `hb_verifier` tool is a consistency verification tool that supports performing cosine similarity comparisons between onnx models, between onnx model and hbir model, cosine similarity comparison between hbir model and hbir model, and output consistency comparisons between hbir model and hbm model.
The hb_eval_preprocess Tool | The `hb_eval_preprocess` is a tool provided by Horizon for preprocessing image data on x86 system (certain image data operations before being fed into the model, e.g., image resizing, image cropping, image padding, etc.) when you evaluate model accuracy.
The hb_config_generator Tool | The `hb_config_generator` is a tool provided by Horizon for obtaining simplest yaml configuration files and yaml configuration files with all parameter defaults.
The HBRuntime Inference | The HBRuntime is a x86-side model inference library provided by Horizon, which supports inference on the original ONNX models directly exported by commonly used training frameworks, the ONNX models at various stages generated during the PTQ conversion process of the Horizon toolchain, and the HBIR(*.bc) models and HBM(*.hbm) models generated during the Horizon toolchain conversion process.
Accuracy Debug Tool | The `Accuracy Debug Tool` is a tool provided by Horizon for helping you to locate accuracy problems in the model quantization process on your own. It can help you to analyze the node-granularity quantization error of the calibration model, and finally quickly locate the nodes with accuracy anomalies.

On This Page