As model fails when enable int8 quant, so disable allocate memory in cpu
for small variable.