Created by: dimeldo

As I'm using the Dialogue-PLATO model, My Nvidia Volta v100 GPU seems to be not fully utilized:

While other models I tested have been utilizing the GPU fully. I'm running on batch size 1. When bs is 2 I get an OOM error. I tried playing with FLAGS_fraction_of_gpu_memory_to_use but to no avail.