faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11 (#22164)