• F
    btrfs: send: cache information about created directories · e8a7f49d
    Filipe Manana 提交于
    During an incremental send, when processing the reference for an inode
    we need to check if the directory where the new reference is located was
    already created before creating the new reference. This check, which is
    done by the helper did_create_dir(), can be expensive if the directory
    has many entries, since it consists in searching the send root's b+tree
    and visiting every single dir index key until we either find one which
    points to an inode with a number smaller than the current inode's number
    or until we visited all index keys. So it doesn't scale well for very
    large directories.
    
    So improve on this by caching created directories using a lru cache, and
    limiting its size to 64 entries, which results in using at most 4096
    bytes of memory. The caching is optional, if we fail to allocate memory,
    we just proceed as before and use the existing slower path.
    
    This patch is part of a larger patchset and the changelog of the last
    patch in the series contains a sample performance test and results.
    The patches that comprise the patchset are the following:
    
      btrfs: send: directly return from did_overwrite_ref() and simplify it
      btrfs: send: avoid unnecessary generation search at did_overwrite_ref()
      btrfs: send: directly return from will_overwrite_ref() and simplify it
      btrfs: send: avoid extra b+tree searches when checking reference overrides
      btrfs: send: remove send_progress argument from can_rmdir()
      btrfs: send: avoid duplicated orphan dir allocation and initialization
      btrfs: send: avoid unnecessary orphan dir rbtree search at can_rmdir()
      btrfs: send: reduce searches on parent root when checking if dir can be removed
      btrfs: send: iterate waiting dir move rbtree only once when processing refs
      btrfs: send: initialize all the red black trees earlier
      btrfs: send: genericize the backref cache to allow it to be reused
      btrfs: adapt lru cache to allow for 64 bits keys on 32 bits systems
      btrfs: send: cache information about created directories
      btrfs: allow a generation number to be associated with lru cache entries
      btrfs: add an api to delete a specific entry from the lru cache
      btrfs: send: use the lru cache to implement the name cache
      btrfs: send: update size of roots array for backref cache entries
      btrfs: send: cache utimes operations for directories if possible
    Signed-off-by: NFilipe Manana <fdmanana@suse.com>
    Reviewed-by: NDavid Sterba <dsterba@suse.com>
    Signed-off-by: NDavid Sterba <dsterba@suse.com>
    e8a7f49d
send.c 214.8 KB