While doable with hb_deref_pointer() as well, we also would then
need to do it in a ton of places.  Not worth it / messy.