Rspress

# #Model Modification and HBIR Model Compilation

To pursue ultimate performance in those scenarios with enormous input size, the quantization and conversion of some inputs and outputs can be fused into data pre-processing. At this point you can choose to remove these nodes by using the `hb_compile` tool, the tool supports also the compilation of HBIR models at the same time.

## #Support Range

It supports the modification and compilation of the HBIR model.

## #Usage

`Usage: hb_compile [OPTIONS] A tool that maps floating-point models to quantized models and provides some additional validation features Options: -h, --help Show this message and exit. -c, --config PATH Model convert config file -m, --model PATH Model to be compiled or modified`

## #Parameters Introduction

Parameter Name | Parameter Description
`-h, --help` | Show help information and exit.
`-c, --config` | Configuration file for the model compilation, in YAML format. For removing nodes, the `march`, `remove_node_type` or `remove_node_name` parameters need to be specified correctly in the config file. For compiling the HBIR model, the `march` parameter needs to be specified correctly in the config file. The configuration of the parameters in the yaml file can be found in section Specific Parameter Information.
`-m, --model` | The model to be modified, which suffix needs to be `.bc` .

## #Usage Example

When using `hb_compile` to modify the model and compile the HBIR model, you can refer to the following command:

`hb_compile --config ${config_file} \ --model ${model.bc}`
On This Page