In preparation for adding limits, and one more user, abstract out the
core bits of the allocation+free cache.
Signed-off-by: NJens Axboe <axboe@kernel.dk>