====================op compute time====================
optype_name                          compute_time(ms, per-step)    called_times(per-step)    percent
---------------------------------  ----------------------------  ------------------------  ---------
UnsortedSegmentSum                                    44.6078                           2      35.28
GatherV2                                              43.1554                           2      34.13
Slice                                                 20.3763                          16      16.12
Concat                                                 5.80845                          4       4.59
Split                                                  2.71428                          2       2.15
MatMul                                                 1.93668                         15       1.53
Mul                                                    1.90295                         32       1.51
StridedSliceGrad                                       1.50683                          2       1.19
TransData                                              1.11516                         30       0.88
ReluGrad                                               0.854069                         5       0.68
Cast                                                   0.484685                        15       0.38
ReLU                                                   0.483282                         5       0.38
RealDiv                                                0.422807                        15       0.33
StridedSlice                                           0.345569                         2       0.27
Adam                                                   0.285936                        11       0.23
BiasAdd                                                0.189663                         5       0.15
BiasAddGrad                                            0.071681                         5       0.06
Tile                                                   0.044158                         4       0.03
ReduceSum                                              0.030765                         5       0.02
ApplyFtrl                                              0.025454                         2       0.02
AtomicAddrClean                                        0.019369                         8       0.02
AddN                                                   0.012836                         1       0.01
Square                                                 0.009799                         1       0.01
SigmoidCrossEntropyWithLogitsGrad                      0.009582                         2       0.01
TensorAdd                                              0.009218                         3       0.01
SigmoidCrossEntropyWithLogits                          0.004809                         1       0
ReduceMean                                             0.004535                         1       0
Assign                                                 0.002477                         2       0
AssignAdd                                              0.001688                         1       0

Detail:
op_name                                  op_type                              avg_execution_time  subgraph
---------------------------------------  ---------------------------------  --------------------  ----------
UnsortedSegmentSum-op199                 UnsortedSegmentSum                          37.2522      Gradients
UnsortedSegmentSum-op123                 UnsortedSegmentSum                           7.35559     Gradients
GatherV2-op55                            GatherV2                                    42.2202      Default
GatherV2-op33                            GatherV2                                     0.935229    Default
Slice-op192                              Slice                                        1.56074     Gradients
Slice-op191                              Slice                                        1.55147     Gradients
Slice-op188                              Slice                                        1.5461      Gradients
Slice-op190                              Slice                                        1.54024     Gradients
Slice-op193                              Slice                                        1.53854     Gradients
Slice-op194                              Slice                                        1.53768     Gradients
Slice-op195                              Slice                                        1.53429     Gradients
Slice-op189                              Slice                                        1.53405     Gradients
Slice-op64                               Slice                                        1.12941     Gradients
Slice-op59                               Slice                                        1.06433     Gradients
Slice-op65                               Slice                                        1.00912     Gradients
Slice-op62                               Slice                                        1.00751     Gradients
Slice-op60                               Slice                                        0.967576    Gradients
Slice-op61                               Slice                                        0.967544    Gradients
Slice-op58                               Slice                                        0.962666    Gradients
Slice-op63                               Slice                                        0.92504     Gradients
Concat-op68                              Concat                                       3.08483     Default
Concat-op196                             Concat                                       2.58418     Gradients
Concat-op40                              Concat                                       0.0884167   Default
Concat-op66                              Concat                                       0.0510307   Gradients
Split-op67                               Split                                        2.61707     Default
Split-op39                               Split                                        0.0972053   Default
MatMul-op178                             MatMul                                       0.535181    Gradients
MatMul-op74                              MatMul                                       0.452185    Default
MatMul-op177                             MatMul                                       0.421444    Gradients
MatMul-op165                             MatMul                                       0.116006    Gradients
MatMul-op164                             MatMul                                       0.106089    Gradients
MatMul-op81                              MatMul                                       0.0983221   Default
MatMul-op151                             MatMul                                       0.053485    Gradients
MatMul-op152                             MatMul                                       0.0365136   Gradients
MatMul-op88                              MatMul                                       0.03152     Default
MatMul-op138                             MatMul                                       0.0295893   Gradients
MatMul-op139                             MatMul                                       0.016685    Gradients
MatMul-op95                              MatMul                                       0.01319     Default
MatMul-op120                             MatMul                                       0.00954643  Gradients
MatMul-op119                             MatMul                                       0.00929929  Gradients
MatMul-op102                             MatMul                                       0.007625    Default
Mul-op186                                Mul                                          0.385978    Gradients
Mul-op70                                 Mul                                          0.374378    Default
Mul-op72                                 Mul                                          0.331515    Default
Mul-op182                                Mul                                          0.317914    Gradients
Mul-op79                                 Mul                                          0.109431    Default
Mul-op169                                Mul                                          0.100926    Gradients
Mul-op86                                 Mul                                          0.039065    Default
Mul-op156                                Mul                                          0.03713     Gradients
Mul-op116                                Mul                                          0.0331357   Gradients
Mul-op93                                 Mul                                          0.0210179   Default
Mul-op121                                Mul                                          0.0209471   Gradients
Mul-op143                                Mul                                          0.0205921   Gradients
Mul-op197                                Mul                                          0.0166779   Default
Mul-op128                                Mul                                          0.0122129   Gradients
Mul-op100                                Mul                                          0.01205     Default
Mul-op201                                Mul                                          0.0108971   Default
Mul-op35                                 Mul                                          0.0102227   Default
Mul-op117                                Mul                                          0.0101321   Gradients
Mul-op176                                Mul                                          0.007605    Default
Mul-op163                                Mul                                          0.00625286  Default
Mul-op130                                Mul                                          0.00571571  Gradients
Mul-op150                                Mul                                          0.004635    Default
Mul-op183                                Mul                                          0.00165571  Default
Mul-op137                                Mul                                          0.00160786  Default
Mul-op129                                Mul                                          0.00159643  Gradients
Mul-op170                                Mul                                          0.00159571  Default
Mul-op157                                Mul                                          0.00153143  Default
Mul-op144                                Mul                                          0.00147357  Default
Mul-op28                                 Mul                                          0.001468    Default
Mul-op122                                Mul                                          0.00122071  Default
Mul-op29                                 Mul                                          0.001202    Default
Mul-op31                                 Mul                                          0.001166    Default
StridedSliceGrad-op187                   StridedSliceGrad                             1.3544      Gradients
StridedSliceGrad-op57                    StridedSliceGrad                             0.152437    Gradients
TransData-op284                          TransData                                    0.325711    Default
TransData-op271                          TransData                                    0.149802    Default
TransData-op229                          TransData                                    0.0921293   Default
TransData-op240                          TransData                                    0.0918471   Default
TransData-op257                          TransData                                    0.0662064   Default
TransData-op274                          TransData                                    0.0373564   Default
TransData-op245                          TransData                                    0.0371764   Default
TransData-op237                          TransData                                    0.0368179   Default
TransData-op231                          TransData                                    0.0327657   Default
TransData-op206                          TransData                                    0.0277764   Default
TransData-op250                          TransData                                    0.020935    Default
TransData-op233                          TransData                                    0.0204121   Default
TransData-op277                          TransData                                    0.01939     Default
TransData-op242                          TransData                                    0.0191893   Default
TransData-op204                          TransData                                    0.0162743   Default
TransData-op255                          TransData                                    0.0145864   Default
TransData-op235                          TransData                                    0.0144157   Default
TransData-op247                          TransData                                    0.012455    Default
TransData-op280                          TransData                                    0.0124257   Default
TransData-op272                          TransData                                    0.00974933  Default
TransData-op215                          TransData                                    0.00940429  Default
TransData-op252                          TransData                                    0.00857286  Default
TransData-op208                          TransData                                    0.00839571  Default
TransData-op216                          TransData                                    0.00669733  Default
TransData-op210                          TransData                                    0.00627071  Default
TransData-op275                          TransData                                    0.00546133  Default
TransData-op278                          TransData                                    0.00440333  Default
TransData-op212                          TransData                                    0.00333286  Default
TransData-op281                          TransData                                    0.00277333  Default
TransData-op214                          TransData                                    0.00242357  Default
ReluGrad-op184                           ReluGrad                                     0.514471    Gradients
ReluGrad-op171                           ReluGrad                                     0.187441    Gradients
ReluGrad-op158                           ReluGrad                                     0.090505    Gradients
ReluGrad-op145                           ReluGrad                                     0.0393679   Gradients
ReluGrad-op131                           ReluGrad                                     0.0222843   Gradients
Cast-op73                                Cast                                         0.251821    Default
Cast-op80                                Cast                                         0.0472729   Default
Cast-op175                               Cast                                         0.0464929   Gradients
Cast-op87                                Cast                                         0.0258764   Default
Cast-op162                               Cast                                         0.0248979   Gradients
Cast-op52                                Cast                                         0.023116    Default
Cast-op94                                Cast                                         0.01493     Default
Cast-op149                               Cast                                         0.0125914   Gradients
Cast-op101                               Cast                                         0.00926143  Default
Cast-op136                               Cast                                         0.00819714  Gradients
Cast-op45                                Cast                                         0.00711     Default
Cast-op46                                Cast                                         0.0046      Default
Cast-op47                                Cast                                         0.00445933  Default
Cast-op115                               Cast                                         0.00266143  Gradients
Cast-op34                                Cast                                         0.00139667  Default
ReLU-op71                                ReLU                                         0.327769    Default
ReLU-op78                                ReLU                                         0.100851    Default
ReLU-op85                                ReLU                                         0.0279364   Default
ReLU-op92                                ReLU                                         0.0167179   Default
ReLU-op99                                ReLU                                         0.0100079   Default
RealDiv-op174                            RealDiv                                      0.137046    Gradients
RealDiv-op76                             RealDiv                                      0.103911    Default
RealDiv-op161                            RealDiv                                      0.0425664   Gradients
RealDiv-op83                             RealDiv                                      0.0367986   Default
RealDiv-op90                             RealDiv                                      0.0254871   Default
RealDiv-op148                            RealDiv                                      0.0215086   Gradients
RealDiv-op97                             RealDiv                                      0.0157514   Default
RealDiv-op135                            RealDiv                                      0.0134129   Gradients
RealDiv-op104                            RealDiv                                      0.00482857  Default
RealDiv-op54                             RealDiv                                      0.00482467  Gradients
RealDiv-op50                             RealDiv                                      0.00455643  Gradients
RealDiv-op113                            RealDiv                                      0.00454714  Gradients
RealDiv-op51                             RealDiv                                      0.00451643  Gradients
RealDiv-op118                            RealDiv                                      0.00161786  Default
RealDiv-op44                             RealDiv                                      0.00143467  Default
StridedSlice-op69                        StridedSlice                                 0.333141    Default
StridedSlice-op41                        StridedSlice                                 0.0124273   Default
Adam-op198                               Adam                                         0.133745    Default
Adam-op202                               Adam                                         0.0842707   Default
Adam-op179                               Adam                                         0.0332157   Default
Adam-op166                               Adam                                         0.010665    Default
Adam-op153                               Adam                                         0.00629286  Default
Adam-op185                               Adam                                         0.00368857  Default
Adam-op172                               Adam                                         0.00317571  Default
Adam-op159                               Adam                                         0.00294786  Default
Adam-op146                               Adam                                         0.00289     Default
Adam-op140                               Adam                                         0.00281857  Default
Adam-op127                               Adam                                         0.00222571  Default
BiasAdd-op77                             BiasAdd                                      0.110156    Default
BiasAdd-op84                             BiasAdd                                      0.0401686   Default
BiasAdd-op91                             BiasAdd                                      0.0217207   Default
BiasAdd-op98                             BiasAdd                                      0.013145    Default
BiasAdd-op105                            BiasAdd                                      0.00447286  Default
BiasAddGrad-op173                        BiasAddGrad                                  0.03003     Gradients
BiasAddGrad-op160                        BiasAddGrad                                  0.0174807   Gradients
BiasAddGrad-op147                        BiasAddGrad                                  0.0123257   Gradients
BiasAddGrad-op134                        BiasAddGrad                                  0.00878357  Gradients
BiasAddGrad-op112                        BiasAddGrad                                  0.00306143  Gradients
Tile-op114                               Tile                                         0.0274664   Gradients
Tile-op56                                Tile                                         0.00871357  Gradients
Tile-op53                                Tile                                         0.00424333  Gradients
Tile-op49                                Tile                                         0.003735    Gradients
ReduceSum-op36                           ReduceSum                                    0.0150733   Default
ReduceSum-op42                           ReduceSum                                    0.00983267  Default
ReduceSum-op111                          ReduceSum                                    0.00314286  Gradients
ReduceSum-op48                           ReduceSum                                    0.00140067  Gradients
ReduceSum-op43                           ReduceSum                                    0.00131533  Gradients
ApplyFtrl-op133                          ApplyFtrl                                    0.0231964   Default
ApplyFtrl-op132                          ApplyFtrl                                    0.00225714  Default
AtomicAddrClean-op434                    AtomicAddrClean                              0.00771929  Default
AtomicAddrClean-op427                    AtomicAddrClean                              0.00293714  Default
AtomicAddrClean-op425                    AtomicAddrClean                              0.001515    Default
AtomicAddrClean-op430                    AtomicAddrClean                              0.00149714  Default
AtomicAddrClean-op431                    AtomicAddrClean                              0.00146     Default
AtomicAddrClean-op429                    AtomicAddrClean                              0.00145714  Default
AtomicAddrClean-op428                    AtomicAddrClean                              0.00140429  Default
AtomicAddrClean-op418                    AtomicAddrClean                              0.00137867  Default
AddN-op200                               AddN                                         0.0128364   Default
Square-op38                              Square                                       0.00979933  Default
SigmoidCrossEntropyWithLogitsGrad-op109  SigmoidCrossEntropyWithLogitsGrad            0.00495071  Gradients
SigmoidCrossEntropyWithLogitsGrad-op108  SigmoidCrossEntropyWithLogitsGrad            0.00463143  Gradients
TensorAdd-op106                          TensorAdd                                    0.00392571  Default
TensorAdd-op37                           TensorAdd                                    0.00383267  Default
TensorAdd-op124                          TensorAdd                                    0.00146     Default
SigmoidCrossEntropyWithLogits-op107      SigmoidCrossEntropyWithLogits                0.00480857  Default
ReduceMean-op110                         ReduceMean                                   0.004535    Default
Assign-op30                              Assign                                       0.00136067  Default
Assign-op32                              Assign                                       0.001116    Default
AssignAdd-op414                          AssignAdd                                    0.001688    Default
====================op compute time====================
optype_name                          compute_time(ms, per-step)    called_times(per-step)    percent
---------------------------------  ----------------------------  ------------------------  ---------
UnsortedSegmentSum                                    44.6078                           2      35.28
GatherV2                                              43.1554                           2      34.13
Slice                                                 20.3763                          16      16.12
Concat                                                 5.80845                          4       4.59
Split                                                  2.71428                          2       2.15
MatMul                                                 1.93668                         15       1.53
Mul                                                    1.90295                         32       1.51
StridedSliceGrad                                       1.50683                          2       1.19
TransData                                              1.11516                         30       0.88
ReluGrad                                               0.854069                         5       0.68
Cast                                                   0.484685                        15       0.38
ReLU                                                   0.483282                         5       0.38
RealDiv                                                0.422807                        15       0.33
StridedSlice                                           0.345569                         2       0.27
Adam                                                   0.285936                        11       0.23
BiasAdd                                                0.189663                         5       0.15
BiasAddGrad                                            0.071681                         5       0.06
Tile                                                   0.044158                         4       0.03
ReduceSum                                              0.030765                         5       0.02
ApplyFtrl                                              0.025454                         2       0.02
AtomicAddrClean                                        0.019369                         8       0.02
AddN                                                   0.012836                         1       0.01
Square                                                 0.009799                         1       0.01
SigmoidCrossEntropyWithLogitsGrad                      0.009582                         2       0.01
TensorAdd                                              0.009218                         3       0.01
SigmoidCrossEntropyWithLogits                          0.004809                         1       0
ReduceMean                                             0.004535                         1       0
Assign                                                 0.002477                         2       0
AssignAdd                                              0.001688                         1       0

Detail:
op_name                                  op_type                              avg_execution_time  subgraph
---------------------------------------  ---------------------------------  --------------------  ----------
UnsortedSegmentSum-op199                 UnsortedSegmentSum                          37.2522      Gradients
UnsortedSegmentSum-op123                 UnsortedSegmentSum                           7.35559     Gradients
GatherV2-op55                            GatherV2                                    42.2202      Default
GatherV2-op33                            GatherV2                                     0.935229    Default
Slice-op192                              Slice                                        1.56074     Gradients
Slice-op191                              Slice                                        1.55147     Gradients
Slice-op188                              Slice                                        1.5461      Gradients
Slice-op190                              Slice                                        1.54024     Gradients
Slice-op193                              Slice                                        1.53854     Gradients
Slice-op194                              Slice                                        1.53768     Gradients
Slice-op195                              Slice                                        1.53429     Gradients
Slice-op189                              Slice                                        1.53405     Gradients
Slice-op64                               Slice                                        1.12941     Gradients
Slice-op59                               Slice                                        1.06433     Gradients
Slice-op65                               Slice                                        1.00912     Gradients
Slice-op62                               Slice                                        1.00751     Gradients
Slice-op60                               Slice                                        0.967576    Gradients
Slice-op61                               Slice                                        0.967544    Gradients
Slice-op58                               Slice                                        0.962666    Gradients
Slice-op63                               Slice                                        0.92504     Gradients
Concat-op68                              Concat                                       3.08483     Default
Concat-op196                             Concat                                       2.58418     Gradients
Concat-op40                              Concat                                       0.0884167   Default
Concat-op66                              Concat                                       0.0510307   Gradients
Split-op67                               Split                                        2.61707     Default
Split-op39                               Split                                        0.0972053   Default
MatMul-op178                             MatMul                                       0.535181    Gradients
MatMul-op74                              MatMul                                       0.452185    Default
MatMul-op177                             MatMul                                       0.421444    Gradients
MatMul-op165                             MatMul                                       0.116006    Gradients
MatMul-op164                             MatMul                                       0.106089    Gradients
MatMul-op81                              MatMul                                       0.0983221   Default
MatMul-op151                             MatMul                                       0.053485    Gradients
MatMul-op152                             MatMul                                       0.0365136   Gradients
MatMul-op88                              MatMul                                       0.03152     Default
MatMul-op138                             MatMul                                       0.0295893   Gradients
MatMul-op139                             MatMul                                       0.016685    Gradients
MatMul-op95                              MatMul                                       0.01319     Default
MatMul-op120                             MatMul                                       0.00954643  Gradients
MatMul-op119                             MatMul                                       0.00929929  Gradients
MatMul-op102                             MatMul                                       0.007625    Default
Mul-op186                                Mul                                          0.385978    Gradients
Mul-op70                                 Mul                                          0.374378    Default
Mul-op72                                 Mul                                          0.331515    Default
Mul-op182                                Mul                                          0.317914    Gradients
Mul-op79                                 Mul                                          0.109431    Default
Mul-op169                                Mul                                          0.100926    Gradients
Mul-op86                                 Mul                                          0.039065    Default
Mul-op156                                Mul                                          0.03713     Gradients
Mul-op116                                Mul                                          0.0331357   Gradients
Mul-op93                                 Mul                                          0.0210179   Default
Mul-op121                                Mul                                          0.0209471   Gradients
Mul-op143                                Mul                                          0.0205921   Gradients
Mul-op197                                Mul                                          0.0166779   Default
Mul-op128                                Mul                                          0.0122129   Gradients
Mul-op100                                Mul                                          0.01205     Default
Mul-op201                                Mul                                          0.0108971   Default
Mul-op35                                 Mul                                          0.0102227   Default
Mul-op117                                Mul                                          0.0101321   Gradients
Mul-op176                                Mul                                          0.007605    Default
Mul-op163                                Mul                                          0.00625286  Default
Mul-op130                                Mul                                          0.00571571  Gradients
Mul-op150                                Mul                                          0.004635    Default
Mul-op183                                Mul                                          0.00165571  Default
Mul-op137                                Mul                                          0.00160786  Default
Mul-op129                                Mul                                          0.00159643  Gradients
Mul-op170                                Mul                                          0.00159571  Default
Mul-op157                                Mul                                          0.00153143  Default
Mul-op144                                Mul                                          0.00147357  Default
Mul-op28                                 Mul                                          0.001468    Default
Mul-op122                                Mul                                          0.00122071  Default
Mul-op29                                 Mul                                          0.001202    Default
Mul-op31                                 Mul                                          0.001166    Default
StridedSliceGrad-op187                   StridedSliceGrad                             1.3544      Gradients
StridedSliceGrad-op57                    StridedSliceGrad                             0.152437    Gradients
TransData-op284                          TransData                                    0.325711    Default
TransData-op271                          TransData                                    0.149802    Default
TransData-op229                          TransData                                    0.0921293   Default
TransData-op240                          TransData                                    0.0918471   Default
TransData-op257                          TransData                                    0.0662064   Default
TransData-op274                          TransData                                    0.0373564   Default
TransData-op245                          TransData                                    0.0371764   Default
TransData-op237                          TransData                                    0.0368179   Default
TransData-op231                          TransData                                    0.0327657   Default
TransData-op206                          TransData                                    0.0277764   Default
TransData-op250                          TransData                                    0.020935    Default
TransData-op233                          TransData                                    0.0204121   Default
TransData-op277                          TransData                                    0.01939     Default
TransData-op242                          TransData                                    0.0191893   Default
TransData-op204                          TransData                                    0.0162743   Default
TransData-op255                          TransData                                    0.0145864   Default
TransData-op235                          TransData                                    0.0144157   Default
TransData-op247                          TransData                                    0.012455    Default
TransData-op280                          TransData                                    0.0124257   Default
TransData-op272                          TransData                                    0.00974933  Default
TransData-op215                          TransData                                    0.00940429  Default
TransData-op252                          TransData                                    0.00857286  Default
TransData-op208                          TransData                                    0.00839571  Default
TransData-op216                          TransData                                    0.00669733  Default
TransData-op210                          TransData                                    0.00627071  Default
TransData-op275                          TransData                                    0.00546133  Default
TransData-op278                          TransData                                    0.00440333  Default
TransData-op212                          TransData                                    0.00333286  Default
TransData-op281                          TransData                                    0.00277333  Default
TransData-op214                          TransData                                    0.00242357  Default
ReluGrad-op184                           ReluGrad                                     0.514471    Gradients
ReluGrad-op171                           ReluGrad                                     0.187441    Gradients
ReluGrad-op158                           ReluGrad                                     0.090505    Gradients
ReluGrad-op145                           ReluGrad                                     0.0393679   Gradients
ReluGrad-op131                           ReluGrad                                     0.0222843   Gradients
Cast-op73                                Cast                                         0.251821    Default
Cast-op80                                Cast                                         0.0472729   Default
Cast-op175                               Cast                                         0.0464929   Gradients
Cast-op87                                Cast                                         0.0258764   Default
Cast-op162                               Cast                                         0.0248979   Gradients
Cast-op52                                Cast                                         0.023116    Default
Cast-op94                                Cast                                         0.01493     Default
Cast-op149                               Cast                                         0.0125914   Gradients
Cast-op101                               Cast                                         0.00926143  Default
Cast-op136                               Cast                                         0.00819714  Gradients
Cast-op45                                Cast                                         0.00711     Default
Cast-op46                                Cast                                         0.0046      Default
Cast-op47                                Cast                                         0.00445933  Default
Cast-op115                               Cast                                         0.00266143  Gradients
Cast-op34                                Cast                                         0.00139667  Default
ReLU-op71                                ReLU                                         0.327769    Default
ReLU-op78                                ReLU                                         0.100851    Default
ReLU-op85                                ReLU                                         0.0279364   Default
ReLU-op92                                ReLU                                         0.0167179   Default
ReLU-op99                                ReLU                                         0.0100079   Default
RealDiv-op174                            RealDiv                                      0.137046    Gradients
RealDiv-op76                             RealDiv                                      0.103911    Default
RealDiv-op161                            RealDiv                                      0.0425664   Gradients
RealDiv-op83                             RealDiv                                      0.0367986   Default
RealDiv-op90                             RealDiv                                      0.0254871   Default
RealDiv-op148                            RealDiv                                      0.0215086   Gradients
RealDiv-op97                             RealDiv                                      0.0157514   Default
RealDiv-op135                            RealDiv                                      0.0134129   Gradients
RealDiv-op104                            RealDiv                                      0.00482857  Default
RealDiv-op54                             RealDiv                                      0.00482467  Gradients
RealDiv-op50                             RealDiv                                      0.00455643  Gradients
RealDiv-op113                            RealDiv                                      0.00454714  Gradients
RealDiv-op51                             RealDiv                                      0.00451643  Gradients
RealDiv-op118                            RealDiv                                      0.00161786  Default
RealDiv-op44                             RealDiv                                      0.00143467  Default
StridedSlice-op69                        StridedSlice                                 0.333141    Default
StridedSlice-op41                        StridedSlice                                 0.0124273   Default
Adam-op198                               Adam                                         0.133745    Default
Adam-op202                               Adam                                         0.0842707   Default
Adam-op179                               Adam                                         0.0332157   Default
Adam-op166                               Adam                                         0.010665    Default
Adam-op153                               Adam                                         0.00629286  Default
Adam-op185                               Adam                                         0.00368857  Default
Adam-op172                               Adam                                         0.00317571  Default
Adam-op159                               Adam                                         0.00294786  Default
Adam-op146                               Adam                                         0.00289     Default
Adam-op140                               Adam                                         0.00281857  Default
Adam-op127                               Adam                                         0.00222571  Default
BiasAdd-op77                             BiasAdd                                      0.110156    Default
BiasAdd-op84                             BiasAdd                                      0.0401686   Default
BiasAdd-op91                             BiasAdd                                      0.0217207   Default
BiasAdd-op98                             BiasAdd                                      0.013145    Default
BiasAdd-op105                            BiasAdd                                      0.00447286  Default
BiasAddGrad-op173                        BiasAddGrad                                  0.03003     Gradients
BiasAddGrad-op160                        BiasAddGrad                                  0.0174807   Gradients
BiasAddGrad-op147                        BiasAddGrad                                  0.0123257   Gradients
BiasAddGrad-op134                        BiasAddGrad                                  0.00878357  Gradients
BiasAddGrad-op112                        BiasAddGrad                                  0.00306143  Gradients
Tile-op114                               Tile                                         0.0274664   Gradients
Tile-op56                                Tile                                         0.00871357  Gradients
Tile-op53                                Tile                                         0.00424333  Gradients
Tile-op49                                Tile                                         0.003735    Gradients
ReduceSum-op36                           ReduceSum                                    0.0150733   Default
ReduceSum-op42                           ReduceSum                                    0.00983267  Default
ReduceSum-op111                          ReduceSum                                    0.00314286  Gradients
ReduceSum-op48                           ReduceSum                                    0.00140067  Gradients
ReduceSum-op43                           ReduceSum                                    0.00131533  Gradients
ApplyFtrl-op133                          ApplyFtrl                                    0.0231964   Default
ApplyFtrl-op132                          ApplyFtrl                                    0.00225714  Default
AtomicAddrClean-op434                    AtomicAddrClean                              0.00771929  Default
AtomicAddrClean-op427                    AtomicAddrClean                              0.00293714  Default
AtomicAddrClean-op425                    AtomicAddrClean                              0.001515    Default
AtomicAddrClean-op430                    AtomicAddrClean                              0.00149714  Default
AtomicAddrClean-op431                    AtomicAddrClean                              0.00146     Default
AtomicAddrClean-op429                    AtomicAddrClean                              0.00145714  Default
AtomicAddrClean-op428                    AtomicAddrClean                              0.00140429  Default
AtomicAddrClean-op418                    AtomicAddrClean                              0.00137867  Default
AddN-op200                               AddN                                         0.0128364   Default
Square-op38                              Square                                       0.00979933  Default
SigmoidCrossEntropyWithLogitsGrad-op109  SigmoidCrossEntropyWithLogitsGrad            0.00495071  Gradients
SigmoidCrossEntropyWithLogitsGrad-op108  SigmoidCrossEntropyWithLogitsGrad            0.00463143  Gradients
TensorAdd-op106                          TensorAdd                                    0.00392571  Default
TensorAdd-op37                           TensorAdd                                    0.00383267  Default
TensorAdd-op124                          TensorAdd                                    0.00146     Default
SigmoidCrossEntropyWithLogits-op107      SigmoidCrossEntropyWithLogits                0.00480857  Default
ReduceMean-op110                         ReduceMean                                   0.004535    Default
Assign-op30                              Assign                                       0.00136067  Default
Assign-op32                              Assign                                       0.001116    Default
AssignAdd-op414                          AssignAdd                                    0.001688    Default
====================op compute time====================
optype_name                          compute_time(ms, per-step)    called_times(per-step)    percent
---------------------------------  ----------------------------  ------------------------  ---------
UnsortedSegmentSum                                    44.6078                           2      35.28
GatherV2                                              43.1554                           2      34.13
Slice                                                 20.3763                          16      16.12
Concat                                                 5.80845                          4       4.59
Split                                                  2.71428                          2       2.15
MatMul                                                 1.93668                         15       1.53
Mul                                                    1.90295                         32       1.51
StridedSliceGrad                                       1.50683                          2       1.19
TransData                                              1.11516                         30       0.88
ReluGrad                                               0.854069                         5       0.68
Cast                                                   0.484685                        15       0.38
ReLU                                                   0.483282                         5       0.38
RealDiv                                                0.422807                        15       0.33
StridedSlice                                           0.345569                         2       0.27
Adam                                                   0.285936                        11       0.23
BiasAdd                                                0.189663                         5       0.15
BiasAddGrad                                            0.071681                         5       0.06
Tile                                                   0.044158                         4       0.03
ReduceSum                                              0.030765                         5       0.02
ApplyFtrl                                              0.025454                         2       0.02
AtomicAddrClean                                        0.019369                         8       0.02
AddN                                                   0.012836                         1       0.01
Square                                                 0.009799                         1       0.01
SigmoidCrossEntropyWithLogitsGrad                      0.009582                         2       0.01
TensorAdd                                              0.009218                         3       0.01
SigmoidCrossEntropyWithLogits                          0.004809                         1       0
ReduceMean                                             0.004535                         1       0
Assign                                                 0.002477                         2       0
AssignAdd                                              0.001688                         1       0

Detail:
op_name                                  op_type                              avg_execution_time  subgraph
---------------------------------------  ---------------------------------  --------------------  ----------
UnsortedSegmentSum-op199                 UnsortedSegmentSum                          37.2522      Gradients
UnsortedSegmentSum-op123                 UnsortedSegmentSum                           7.35559     Gradients
GatherV2-op55                            GatherV2                                    42.2202      Default
GatherV2-op33                            GatherV2                                     0.935229    Default
Slice-op192                              Slice                                        1.56074     Gradients
Slice-op191                              Slice                                        1.55147     Gradients
Slice-op188                              Slice                                        1.5461      Gradients
Slice-op190                              Slice                                        1.54024     Gradients
Slice-op193                              Slice                                        1.53854     Gradients
Slice-op194                              Slice                                        1.53768     Gradients
Slice-op195                              Slice                                        1.53429     Gradients
Slice-op189                              Slice                                        1.53405     Gradients
Slice-op64                               Slice                                        1.12941     Gradients
Slice-op59                               Slice                                        1.06433     Gradients
Slice-op65                               Slice                                        1.00912     Gradients
Slice-op62                               Slice                                        1.00751     Gradients
Slice-op60                               Slice                                        0.967576    Gradients
Slice-op61                               Slice                                        0.967544    Gradients
Slice-op58                               Slice                                        0.962666    Gradients
Slice-op63                               Slice                                        0.92504     Gradients
Concat-op68                              Concat                                       3.08483     Default
Concat-op196                             Concat                                       2.58418     Gradients
Concat-op40                              Concat                                       0.0884167   Default
Concat-op66                              Concat                                       0.0510307   Gradients
Split-op67                               Split                                        2.61707     Default
Split-op39                               Split                                        0.0972053   Default
MatMul-op178                             MatMul                                       0.535181    Gradients
MatMul-op74                              MatMul                                       0.452185    Default
MatMul-op177                             MatMul                                       0.421444    Gradients
MatMul-op165                             MatMul                                       0.116006    Gradients
MatMul-op164                             MatMul                                       0.106089    Gradients
MatMul-op81                              MatMul                                       0.0983221   Default
MatMul-op151                             MatMul                                       0.053485    Gradients
MatMul-op152                             MatMul                                       0.0365136   Gradients
MatMul-op88                              MatMul                                       0.03152     Default
MatMul-op138                             MatMul                                       0.0295893   Gradients
MatMul-op139                             MatMul                                       0.016685    Gradients
MatMul-op95                              MatMul                                       0.01319     Default
MatMul-op120                             MatMul                                       0.00954643  Gradients
MatMul-op119                             MatMul                                       0.00929929  Gradients
MatMul-op102                             MatMul                                       0.007625    Default
Mul-op186                                Mul                                          0.385978    Gradients
Mul-op70                                 Mul                                          0.374378    Default
Mul-op72                                 Mul                                          0.331515    Default
Mul-op182                                Mul                                          0.317914    Gradients
Mul-op79                                 Mul                                          0.109431    Default
Mul-op169                                Mul                                          0.100926    Gradients
Mul-op86                                 Mul                                          0.039065    Default
Mul-op156                                Mul                                          0.03713     Gradients
Mul-op116                                Mul                                          0.0331357   Gradients
Mul-op93                                 Mul                                          0.0210179   Default
Mul-op121                                Mul                                          0.0209471   Gradients
Mul-op143                                Mul                                          0.0205921   Gradients
Mul-op197                                Mul                                          0.0166779   Default
Mul-op128                                Mul                                          0.0122129   Gradients
Mul-op100                                Mul                                          0.01205     Default
Mul-op201                                Mul                                          0.0108971   Default
Mul-op35                                 Mul                                          0.0102227   Default
Mul-op117                                Mul                                          0.0101321   Gradients
Mul-op176                                Mul                                          0.007605    Default
Mul-op163                                Mul                                          0.00625286  Default
Mul-op130                                Mul                                          0.00571571  Gradients
Mul-op150                                Mul                                          0.004635    Default
Mul-op183                                Mul                                          0.00165571  Default
Mul-op137                                Mul                                          0.00160786  Default
Mul-op129                                Mul                                          0.00159643  Gradients
Mul-op170                                Mul                                          0.00159571  Default
Mul-op157                                Mul                                          0.00153143  Default
Mul-op144                                Mul                                          0.00147357  Default
Mul-op28                                 Mul                                          0.001468    Default
Mul-op122                                Mul                                          0.00122071  Default
Mul-op29                                 Mul                                          0.001202    Default
Mul-op31                                 Mul                                          0.001166    Default
StridedSliceGrad-op187                   StridedSliceGrad                             1.3544      Gradients
StridedSliceGrad-op57                    StridedSliceGrad                             0.152437    Gradients
TransData-op284                          TransData                                    0.325711    Default
TransData-op271                          TransData                                    0.149802    Default
TransData-op229                          TransData                                    0.0921293   Default
TransData-op240                          TransData                                    0.0918471   Default
TransData-op257                          TransData                                    0.0662064   Default
TransData-op274                          TransData                                    0.0373564   Default
TransData-op245                          TransData                                    0.0371764   Default
TransData-op237                          TransData                                    0.0368179   Default
TransData-op231                          TransData                                    0.0327657   Default
TransData-op206                          TransData                                    0.0277764   Default
TransData-op250                          TransData                                    0.020935    Default
TransData-op233                          TransData                                    0.0204121   Default
TransData-op277                          TransData                                    0.01939     Default
TransData-op242                          TransData                                    0.0191893   Default
TransData-op204                          TransData                                    0.0162743   Default
TransData-op255                          TransData                                    0.0145864   Default
TransData-op235                          TransData                                    0.0144157   Default
TransData-op247                          TransData                                    0.012455    Default
TransData-op280                          TransData                                    0.0124257   Default
TransData-op272                          TransData                                    0.00974933  Default
TransData-op215                          TransData                                    0.00940429  Default
TransData-op252                          TransData                                    0.00857286  Default
TransData-op208                          TransData                                    0.00839571  Default
TransData-op216                          TransData                                    0.00669733  Default
TransData-op210                          TransData                                    0.00627071  Default
TransData-op275                          TransData                                    0.00546133  Default
TransData-op278                          TransData                                    0.00440333  Default
TransData-op212                          TransData                                    0.00333286  Default
TransData-op281                          TransData                                    0.00277333  Default
TransData-op214                          TransData                                    0.00242357  Default
ReluGrad-op184                           ReluGrad                                     0.514471    Gradients
ReluGrad-op171                           ReluGrad                                     0.187441    Gradients
ReluGrad-op158                           ReluGrad                                     0.090505    Gradients
ReluGrad-op145                           ReluGrad                                     0.0393679   Gradients
ReluGrad-op131                           ReluGrad                                     0.0222843   Gradients
Cast-op73                                Cast                                         0.251821    Default
Cast-op80                                Cast                                         0.0472729   Default
Cast-op175                               Cast                                         0.0464929   Gradients
Cast-op87                                Cast                                         0.0258764   Default
Cast-op162                               Cast                                         0.0248979   Gradients
Cast-op52                                Cast                                         0.023116    Default
Cast-op94                                Cast                                         0.01493     Default
Cast-op149                               Cast                                         0.0125914   Gradients
Cast-op101                               Cast                                         0.00926143  Default
Cast-op136                               Cast                                         0.00819714  Gradients
Cast-op45                                Cast                                         0.00711     Default
Cast-op46                                Cast                                         0.0046      Default
Cast-op47                                Cast                                         0.00445933  Default
Cast-op115                               Cast                                         0.00266143  Gradients
Cast-op34                                Cast                                         0.00139667  Default
ReLU-op71                                ReLU                                         0.327769    Default
ReLU-op78                                ReLU                                         0.100851    Default
ReLU-op85                                ReLU                                         0.0279364   Default
ReLU-op92                                ReLU                                         0.0167179   Default
ReLU-op99                                ReLU                                         0.0100079   Default
RealDiv-op174                            RealDiv                                      0.137046    Gradients
RealDiv-op76                             RealDiv                                      0.103911    Default
RealDiv-op161                            RealDiv                                      0.0425664   Gradients
RealDiv-op83                             RealDiv                                      0.0367986   Default
RealDiv-op90                             RealDiv                                      0.0254871   Default
RealDiv-op148                            RealDiv                                      0.0215086   Gradients
RealDiv-op97                             RealDiv                                      0.0157514   Default
RealDiv-op135                            RealDiv                                      0.0134129   Gradients
RealDiv-op104                            RealDiv                                      0.00482857  Default
RealDiv-op54                             RealDiv                                      0.00482467  Gradients
RealDiv-op50                             RealDiv                                      0.00455643  Gradients
RealDiv-op113                            RealDiv                                      0.00454714  Gradients
RealDiv-op51                             RealDiv                                      0.00451643  Gradients
RealDiv-op118                            RealDiv                                      0.00161786  Default
RealDiv-op44                             RealDiv                                      0.00143467  Default
StridedSlice-op69                        StridedSlice                                 0.333141    Default
StridedSlice-op41                        StridedSlice                                 0.0124273   Default
Adam-op198                               Adam                                         0.133745    Default
Adam-op202                               Adam                                         0.0842707   Default
Adam-op179                               Adam                                         0.0332157   Default
Adam-op166                               Adam                                         0.010665    Default
Adam-op153                               Adam                                         0.00629286  Default
Adam-op185                               Adam                                         0.00368857  Default
Adam-op172                               Adam                                         0.00317571  Default
Adam-op159                               Adam                                         0.00294786  Default
Adam-op146                               Adam                                         0.00289     Default
Adam-op140                               Adam                                         0.00281857  Default
Adam-op127                               Adam                                         0.00222571  Default
BiasAdd-op77                             BiasAdd                                      0.110156    Default
BiasAdd-op84                             BiasAdd                                      0.0401686   Default
BiasAdd-op91                             BiasAdd                                      0.0217207   Default
BiasAdd-op98                             BiasAdd                                      0.013145    Default
BiasAdd-op105                            BiasAdd                                      0.00447286  Default
BiasAddGrad-op173                        BiasAddGrad                                  0.03003     Gradients
BiasAddGrad-op160                        BiasAddGrad                                  0.0174807   Gradients
BiasAddGrad-op147                        BiasAddGrad                                  0.0123257   Gradients
BiasAddGrad-op134                        BiasAddGrad                                  0.00878357  Gradients
BiasAddGrad-op112                        BiasAddGrad                                  0.00306143  Gradients
Tile-op114                               Tile                                         0.0274664   Gradients
Tile-op56                                Tile                                         0.00871357  Gradients
Tile-op53                                Tile                                         0.00424333  Gradients
Tile-op49                                Tile                                         0.003735    Gradients
ReduceSum-op36                           ReduceSum                                    0.0150733   Default
ReduceSum-op42                           ReduceSum                                    0.00983267  Default
ReduceSum-op111                          ReduceSum                                    0.00314286  Gradients
ReduceSum-op48                           ReduceSum                                    0.00140067  Gradients
ReduceSum-op43                           ReduceSum                                    0.00131533  Gradients
ApplyFtrl-op133                          ApplyFtrl                                    0.0231964   Default
ApplyFtrl-op132                          ApplyFtrl                                    0.00225714  Default
AtomicAddrClean-op434                    AtomicAddrClean                              0.00771929  Default
AtomicAddrClean-op427                    AtomicAddrClean                              0.00293714  Default
AtomicAddrClean-op425                    AtomicAddrClean                              0.001515    Default
AtomicAddrClean-op430                    AtomicAddrClean                              0.00149714  Default
AtomicAddrClean-op431                    AtomicAddrClean                              0.00146     Default
AtomicAddrClean-op429                    AtomicAddrClean                              0.00145714  Default
AtomicAddrClean-op428                    AtomicAddrClean                              0.00140429  Default
AtomicAddrClean-op418                    AtomicAddrClean                              0.00137867  Default
AddN-op200                               AddN                                         0.0128364   Default
Square-op38                              Square                                       0.00979933  Default
SigmoidCrossEntropyWithLogitsGrad-op109  SigmoidCrossEntropyWithLogitsGrad            0.00495071  Gradients
SigmoidCrossEntropyWithLogitsGrad-op108  SigmoidCrossEntropyWithLogitsGrad            0.00463143  Gradients
TensorAdd-op106                          TensorAdd                                    0.00392571  Default
TensorAdd-op37                           TensorAdd                                    0.00383267  Default
TensorAdd-op124                          TensorAdd                                    0.00146     Default
SigmoidCrossEntropyWithLogits-op107      SigmoidCrossEntropyWithLogits                0.00480857  Default
ReduceMean-op110                         ReduceMean                                   0.004535    Default
Assign-op30                              Assign                                       0.00136067  Default
Assign-op32                              Assign                                       0.001116    Default
AssignAdd-op414                          AssignAdd                                    0.001688    Default
