How to handle int32 input in C-API inference app for Transformer?
Created by: wojtuss
In the Transformer model's config, there is a new input named init_idx
, which is of int32
type. In order to run C-API inference for this model all the inputs have to be either of PaddleDType::FLOAT32
or PaddleDType::INT64
. How should we define the init_idx
input in C-API?