Created by: ddokupil

Hi, We'd like to ask you for your BERT use case (in other words: how to test it to better suite your needs). How do you use BERT? What batch size? How many threads? In Unit Test by default it is BS=8. Do you confirm that?