* remove set_value numpy

* optimize code

* optimize to_tensor

* use common function
Co-authored-by: Nroot <root@yq01-sys-hic-k8s-v100-box-a225-0186.yq01.baidu.com>