if a user does not define gpus_ids, current api will find gpus through CUDA_VISIBLE_DEVICES
otherwise, the server will startup cpu services as needed.