• S
    Feature for sampling and reporting compressibility (#4842) · b45b1cde
    Shobhit Dayal 提交于
    Summary:
    This is a feature to sample data-block compressibility and and report them as stats. 1 in N (tunable) blocks is sampled for compressibility using two algorithms:
    1. lz4 or snappy for fast compression
    2. zstd or zlib for slow but higher compression.
    
    The stats are reported to the caller as raw-bytes and compressed-bytes. The block continues to be compressed for storage using the specified CompressionType.
    
    The db_bench_tool how has a command line option for specifying the sampling rate. It's default value is 0 (no sampling). To test the overhead for a certain value, users can compare the performance of db_bench_tool, varying the sampling rate. It is unlikely to have a noticeable impact for high values like 20.
    Pull Request resolved: https://github.com/facebook/rocksdb/pull/4842
    
    Differential Revision: D13629011
    
    Pulled By: shobhitdayal
    
    fbshipit-source-id: 14ca668bcab6499b2a1734edf848eb62a4f4fafa
    b45b1cde
builder.h 3.7 KB