[cherry-pick] faster build by reduce by-product, reduce linking library and fix compile warning of std=c++11(#22230)