[LatencyPredictor] Add new op and speed up prediction (#1014)
* add new op type and support fp16 model
* preload predictors' model and speed up prediction
* preload predictors' model
* preload predictors' model
* Modified the save path of TMP files
Co-authored-by: NminghaoBD <79566150+minghaoBD@users.noreply.github.com>
Showing
想要评论请 注册 或 登录