Created by: jerrywgz
The dimension of input 'scores' is [N,M,2] which M is the number of anchors. And the dimension of output 'predicted_scores' is [K,2] which K is the total number of labelled anchors and each of them contains 2-D classification scores. So scores should be reshaped to [K,2].