#Overview

By reading this section, you can learn how to use API interfaces to load, infer, and process the results of LLM model. The basic flowchart of interface calls is shown below:

Regarding the API interfaces for LLM model inference, they include content such as basic type definition, structure and enumeration types, callback function type, and main interface functions. For details, please refer to the Interface Details section.