1. 07 11月, 2020 2 次提交
  2. 05 11月, 2020 3 次提交
    • C
      Simplify a test case in Java ReadOnlyTest (#7608) · 1f627210
      cheng-chang 提交于
      Summary:
      The original test nests a lot of `try` blocks. This PR flattens these blocks into independent blocks, so that each `try` block closes the DB before opening the next DB instance.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7608
      
      Test Plan: watch the existing java tests to pass
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24611621
      
      Pulled By: cheng-chang
      
      fbshipit-source-id: d486c5d37ac25d4b860d739ef2cdd58e6064d42d
      1f627210
    • X
      Update clang-format-diff.py (#7609) · c9c9709a
      Xie Yanbo 提交于
      Summary:
      `llvm-mirror/clang` is archived. Get the `clang-format-diff.py` file from the active source.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7609
      
      Reviewed By: ajkr
      
      Differential Revision: D24711608
      
      Pulled By: pdillinger
      
      fbshipit-source-id: b115d8765ff23fbb8190290a170de21565daba84
      c9c9709a
    • Y
      Compute NeedCompact() after table builder Finish() (#7627) · b6d8e367
      Yanqin Jin 提交于
      Summary:
      In `BuildTable()`, we call `builder->Finish()` before evaluating `builder->NeedCompact()`.
      However, we call `builder->NeedCompact()` before `builder->Finish()` in compaction job. This can be wrong because the table properties collectors may rely on the success of `Finish()` to provide correct result for `NeedCompact()`.
      
      Test plan (on devserver):
      make check
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7627
      
      Reviewed By: ajkr
      
      Differential Revision: D24728741
      
      Pulled By: riversand963
      
      fbshipit-source-id: 5a0dce244e14eb1106c4f87021e6bebca82b486e
      b6d8e367
  3. 04 11月, 2020 5 次提交
    • Y
      Add API to verify whole sst file checksum (#7578) · fde0cd7c
      Yanqin Jin 提交于
      Summary:
      Existing API `VerifyChecksum()` allows application to verify sst files' block checksums.
      Since whole file, user-specified checksum is tracked in MANIFEST, we can expose a new
      API to verify sst files' file checksums.
      
      ```
      // Compute table file checksums if applicable and compare with MANIFEST.
      // Returns OK if no file has mismatching whole-file checksum.
      Status DB::VerifyFileChecksums(const ReadOptions& /*read_options*/);
      ```
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7578
      
      Test Plan: make check
      
      Reviewed By: pdillinger
      
      Differential Revision: D24436783
      
      Pulled By: riversand963
      
      fbshipit-source-id: 52b51519b842f2b3c4e3351998a97c86cbec85b3
      fde0cd7c
    • A
      Add "max_write_buffer_size_to_maintain" to crash test (#7634) · 06a92fcf
      Akanksha Mahajan 提交于
      Summary:
      Add "max_write_buffer_size_to_maintain" to crash test
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7634
      
      Test Plan: make crash_test -j64
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24710401
      
      Pulled By: akankshamahajan15
      
      fbshipit-source-id: 89e0412aaa56b2ef5a75603971b82f4b0b494ab7
      06a92fcf
    • P
      Ribbon: InterleavedSolutionStorage (#7598) · 746909ce
      Peter Dillinger 提交于
      Summary:
      The core algorithms for InterleavedSolutionStorage and the
      implementation SerializableInterleavedSolution make Ribbon fast for
      filter queries. Example output from new unit test:
      
          Simple      outside query, hot, incl hashing, ns/key: 117.796
          Interleaved outside query, hot, incl hashing, ns/key: 42.2655
          Bloom       outside query, hot, incl hashing, ns/key: 24.0071
      
      Also includes misc cleanup of previous Ribbon code and comments.
      
      Some TODOs and FIXMEs remain for futher work / investigation.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7598
      
      Test Plan: unit tests included (integration work and tests coming later)
      
      Reviewed By: jay-zhuang
      
      Differential Revision: D24559209
      
      Pulled By: pdillinger
      
      fbshipit-source-id: fea483cd354ba782aea3e806f2bc96e183d59441
      746909ce
    • Y
      Avoid skipping a test in db_wal_test (#7628) · 0b94468b
      Yanqin Jin 提交于
      Summary:
      Recent test report shows that some tests have been skipped.
      
      For DBWALTest that inherits from DBTestBase, the following will always be
      true, since `env_` is an instance of `SpecialEnv`, not `Env::Default()`. Thus the test
      will always be skipped.
      
      ```
      if (options.env != Env::Default()) {
        ROCKSDB_GTEST_SKIP("Test requires default environment");
        return;
      }
      ```
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7628
      
      Test Plan:
      ./db_wal_test --gtest_filter=DBWALTest.TruncateLastLogAfterRecoverWithoutFlush
      MEM_ENV=1 ./db_wal_test --gtest_filter=DBWALTest.TruncateLastLogAfterRecoverWithoutFlush
      make check
      
      Reviewed By: jay-zhuang
      
      Differential Revision: D24693006
      
      Pulled By: riversand963
      
      fbshipit-source-id: 7f2a772492a0f11bff17bbf5e9f493e9e9a1c125
      0b94468b
    • J
      Fix MultiGet unable to query timestamp data issue (#7589) · 881e0dcc
      Jay Zhuang 提交于
      Summary:
      The filter query key should not contain timestamp. The timestamp is
      stripped for Get(), but not MultiGet().
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7589
      
      Reviewed By: riversand963
      
      Differential Revision: D24494661
      
      Pulled By: jay-zhuang
      
      fbshipit-source-id: fc5ff40f9d683a89a760c6ff0ab3aed05a70c317
      881e0dcc
  4. 03 11月, 2020 2 次提交
    • Y
      Avoid skipping a test in db_test2 (#7629) · c992eb11
      Yanqin Jin 提交于
      Summary:
      Test report shows that this test has been skipped recently due to
      a condition that will never meet. `env_` is not equal to
      `Env::Default()` for DBTest2 that inherits from DBTestBase.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7629
      
      Test Plan:
      make check
      ./db_test2 --gtest_filter=DBTest2.PinnableSliceAndMmapReads
      
      Reviewed By: jay-zhuang
      
      Differential Revision: D24693317
      
      Pulled By: riversand963
      
      fbshipit-source-id: b1bbd5c1e05a6fa57c1de0d74462b69e3c2d5215
      c992eb11
    • A
      Expand effect of dictionary settings in `ColumnFamilyOptions::compression_opts` (#7619) · 1adbceb5
      Andrew Kryczka 提交于
      Summary:
      In dictionary compression's initial implementation, in order to save CPU overhead, we only enabled it
      for bottom level under the assumption that the vast majority of data is
      stored there. At that time, there was no
      such thing as `ColumnFamilyOptions::bottommost_compression_opts`, so we just
      hardcoded disabling dictionary compression in flush and compactions to
      non-bottommost level. Now, we have users who generate all their files
      through flush and are considering using dictionary compression.
      
      To support such a use case, this PR expands the scope of `ColumnFamilyOptions::compression_opts` to
      additionally include flushed files and files generated by compaction to
      a non-bottommost level. Users can still get the old behavior by moving
      their dictionary settings to `ColumnFamilyOptions::bottommost_compression_opts`
      and explicitly enabling both that and `ColumnFamilyOptions::bottommost_compression`.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7619
      
      Reviewed By: ltamasi
      
      Differential Revision: D24665610
      
      Pulled By: ajkr
      
      fbshipit-source-id: 656b90bce1033fe21c71e09af931ef5bde3e464c
      1adbceb5
  5. 31 10月, 2020 1 次提交
  6. 30 10月, 2020 3 次提交
  7. 29 10月, 2020 8 次提交
    • Y
      Remove unused includes (#7604) · 394210f2
      Yanqin Jin 提交于
      Summary:
      This is a PR generated **semi-automatically** by an internal tool to remove unused includes and `using` statements.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7604
      
      Test Plan: make check
      
      Reviewed By: ajkr
      
      Differential Revision: D24579392
      
      Pulled By: riversand963
      
      fbshipit-source-id: c4bfa6c6b08da1de186690d37eb73d8fff45aecd
      394210f2
    • J
      java: correct method name RocksDB.GetColumnFamilyMetaData() (#7606) · 99a0305b
      Jermy Li 提交于
      Summary:
      update GetColumnFamilyMetaData() to getColumnFamilyMetaData()
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7606
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24610298
      
      Pulled By: cheng-chang
      
      fbshipit-source-id: d24f9b65478da1456f50747637dc95688af874de
      99a0305b
    • Z
      Updated GenerateOneFileChecksum to use requested_checksum_func_name (#7586) · ea347d80
      Zhichao Cao 提交于
      Summary:
      CreateFileChecksumGenerator may uses requested_checksum_func_name in generator context to decide which generator will be used. GenerateOneFileChecksum has not being updated to use it, which will always get the generator when the name is empty. Fix it.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7586
      
      Test Plan: make check
      
      Reviewed By: riversand963
      
      Differential Revision: D24491989
      
      Pulled By: zhichao-cao
      
      fbshipit-source-id: d9fdfdd431240f0a9a2e781ddbd48a7d6c609aad
      ea347d80
    • J
      slightly improve jemalloc allocator API header (#7592) · 2404f8b9
      jsteemann 提交于
      Summary:
      Fix a few typos and avoid a potential nullptr dereference.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7592
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24582111
      
      Pulled By: riversand963
      
      fbshipit-source-id: 51e9260e8cad1fcdedd310c889f0faeec6efd937
      2404f8b9
    • V
      Fix typo in arena.cc (#7593) · 248d10fb
      vdimir 提交于
      Summary: Pull Request resolved: https://github.com/facebook/rocksdb/pull/7593
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24576218
      
      Pulled By: riversand963
      
      fbshipit-source-id: a3d77191362ca696ae9df643f97f4ab5b7ecff12
      248d10fb
    • shadowlux's avatar
      Remove duplicate close (#7594) · 793e9b7f
      shadowlux 提交于
      Summary:
      Because `Close()` have called in `Destroy()`
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7594
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24576407
      
      Pulled By: riversand963
      
      fbshipit-source-id: eba70d73375fd47dd78ca64c6a1fab3628448276
      793e9b7f
    • R
      In ParseInternalKey(), include corrupt key info in Status (#7515) · 9a690a74
      Ramkumar Vadivelu 提交于
      Summary:
      Fixes Issue https://github.com/facebook/rocksdb/issues/7497
      
      When allow_data_in_errors db_options is set, log error key details in `ParseInternalKey()`
      
      Have fixed most of the calls. Have few TODOs still pending - because have to make more deeper changes to pass in the allow_data_in_errors flag. Will do those in a separate PR later.
      
      Tests:
      - make check
      - some of the existing tests that exercise the "internal key too small" condition are: dbformat_test, cuckoo_table_builder_test
      - some of the existing tests that exercise the corrupted key path are: corruption_test, merge_helper_test, compaction_iterator_test
      
      Example of new status returns:
      - Key too small - `Corrupted Key: Internal Key too small. Size=5`
      - Corrupt key with allow_data_in_errors option set to false: `Corrupted Key: '<redacted>' seq:3, type:3`
      - Corrupt key with allow_data_in_errors option set to true: `Corrupted Key: '61' seq:3, type:3`
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7515
      
      Reviewed By: ajkr
      
      Differential Revision: D24240264
      
      Pulled By: ramvadiv
      
      fbshipit-source-id: bc48f5d4475ac19d7713e16df37505b31aac42e7
      9a690a74
    • A
      Require only one `Logger::Logv()` implementation (#7605) · 6c2c0635
      Andrew Kryczka 提交于
      Summary:
      A user who extended `Logger` recently pointed out it is unusual to
      require they implement the two-argument `Logv()` overload when they've
      already implemented the three-argument `Logv()` overload. I agree with
      that and think we can fix it by only calling the two-argument overload
      from the default implementation of the three-argument overload. Then
      when the three-argument overload is overridden, RocksDB would not
      rely on the two-argument overload. Only `Logger::LogHeader()` needed
      adjustment to achieve this.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7605
      
      Reviewed By: riversand963
      
      Differential Revision: D24584749
      
      Pulled By: ajkr
      
      fbshipit-source-id: 9aabe040ac761c4c0dbebc4be046967403ecaf21
      6c2c0635
  8. 28 10月, 2020 2 次提交
    • P
      Give instructions instead of broken 2to3 for clang-format-diff.py (#7603) · 0e2e6756
      Peter Dillinger 提交于
      Summary:
      My previous change to use lib2to3 to migrate clang-format-diff.py
      for Python 2 only works if there's nothing to reformat. Instead, give
      instructions to download to REPO_ROOT.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7603
      
      Test Plan: Try the instructions on a fresh CentOS 8 devserver
      
      Reviewed By: riversand963
      
      Differential Revision: D24569608
      
      Pulled By: pdillinger
      
      fbshipit-source-id: 1410ba163e016b226e883dec93fae3df9ed0eab2
      0e2e6756
    • M
      Fix many tests to run with MEM_ENV and ENCRYPTED_ENV; Introduce a MemoryFileSystem class (#7566) · f35f7f27
      mrambacher 提交于
      Summary:
      This PR does a few things:
      
      1.  The MockFileSystem class was split out from the MockEnv.  This change would theoretically allow a MockFileSystem to be used by other Environments as well (if we created a means of constructing one).  The MockFileSystem implements a FileSystem in its entirety and does not rely on any Wrapper implementation.
      
      2.  Make the RocksDB test suite work when MOCK_ENV=1 and ENCRYPTED_ENV=1 are set.  To accomplish this, a few things were needed:
      - The tests that tried to use the "wrong" environment (Env::Default() instead of env_) were updated
      - The MockFileSystem was changed to support the features it was missing or mishandled (such as recursively deleting files in a directory or supporting renaming of a directory).
      
      3.  Updated the test framework to have a ROCKSDB_GTEST_SKIP macro.  This can be used to flag tests that are skipped.  Currently, this defaults to doing nothing (marks the test as SUCCESS) but will mark the tests as SKIPPED when RocksDB is upgraded to a version of gtest that supports this (gtest-1.10).
      
      I have run a full "make check" with MEM_ENV, ENCRYPTED_ENV,  both, and neither under both MacOS and RedHat.  A few tests were disabled/skipped for the MEM/ENCRYPTED cases.  The error_handler_fs_test fails/hangs for MEM_ENV (presumably a timing problem) and I will introduce another PR/issue to track that problem.  (I will also push a change to disable those tests soon).  There is one more test in DBTest2 that also fails which I need to investigate or skip before this PR is merged.
      
      Theoretically, this PR should also allow the test suite to run against an Env loaded from the registry, though I do not have one to try it with currently.
      
      Finally, once this is accepted, it would be nice if there was a CircleCI job to run these tests on a checkin so this effort does not become stale.  I do not know how to do that, so if someone could write that job, it would be appreciated :)
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7566
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24408980
      
      Pulled By: jay-zhuang
      
      fbshipit-source-id: 911b1554a4d0da06fd51feca0c090a4abdcb4a5f
      f35f7f27
  9. 27 10月, 2020 2 次提交
    • Y
      Perform post-flush updates of memtable list in a callback (#6069) · 6134ce64
      Yanqin Jin 提交于
      Summary:
      Currently, the following interleaving of events can lead to SuperVersion containing both immutable memtables as well as the resulting L0. This can cause Get to return incorrect result if there are merge operands. This may also affect other operations such as single deletes.
      
      ```
        time  main_thr  bg_flush_thr  bg_compact_thr  compact_thr  set_opts_thr
      0  |                                                         WriteManifest:0
      1  |                                           issue compact
      2  |                                 wait
      3  |   Merge(counter)
      4  |   issue flush
      5  |                   wait
      6  |                                                         WriteManifest:1
      7  |                                 wake up
      8  |                                 write manifest
      9  |                  wake up
      10 |  Get(counter)
      11 |                  remove imm
         V
      ```
      
      The reason behind is that: one bg flush thread's installing new `Version` can be batched and performed by another thread that is the "leader" MANIFEST writer. This bg thread removes the memtables from current super version only after `LogAndApply` returns. After the leader MANIFEST writer signals (releasing mutex) this bg flush thread, it is possible that another thread sees this cf with both memtables (whose data have been flushed to the newest L0) and the L0 before this bg flush thread removes the memtables.
      
      To address this issue, each bg flush thread can pass a callback function to `LogAndApply`. The callback is responsible for removing the memtables. Therefore, the leader MANIFEST writer can call this callback and remove the memtables before releasing the mutex.
      
      Test plan (devserver)
      ```
      $make merge_test
      $./merge_test --gtest_filter=MergeTest.MergeWithCompactionAndFlush
      $make check
      ```
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/6069
      
      Reviewed By: cheng-chang
      
      Differential Revision: D18790894
      
      Pulled By: riversand963
      
      fbshipit-source-id: e41bd600c0448b4f4b2deb3f7677f95e3076b4ed
      6134ce64
    • L
      Integrate BlobFileBuilder into the compaction process (#7573) · a7a04b68
      Levi Tamasi 提交于
      Summary:
      Similarly to how https://github.com/facebook/rocksdb/issues/7345
      integrated blob file writing into the flush process,
      the patch adds support for writing blob files to the compaction logic.
      Namely, if `enable_blob_files` is set, large values encountered during
      compaction are extracted to blob files and replaced with blob indexes.
      The resulting blob files are then logged to the MANIFEST as part of the
      compaction job's `VersionEdit` and added to the `Version` alongside any
      table files written by the compaction. Any errors during blob file building fail
      the compaction job.
      
      There will be a separate follow-up patch to perform blob garbage collection
      during compactions.
      
      In addition, the patch continues to chip away at the mess around computing
      various compaction related statistics by eliminating some code duplication
      and by making the `num_output_files` and `bytes_written` stats more consistent
      for flushes, compactions, and recovery.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7573
      
      Test Plan: `make check`
      
      Reviewed By: riversand963
      
      Differential Revision: D24404696
      
      Pulled By: ltamasi
      
      fbshipit-source-id: 21216af3a172ad3ce8f85d11cd30923784ae426c
      a7a04b68
  10. 26 10月, 2020 1 次提交
    • P
      Ribbon: initial (general) algorithms and basic unit test (#7491) · 25d54c79
      Peter Dillinger 提交于
      Summary:
      This is intended as the first commit toward a near-optimal alternative to static Bloom filters for SSTs. Stephan Walzer and I have agreed upon the name "Ribbon" for a PHSF based on his linear system construction in "Efficient Gauss Elimination for Near-Quadratic Matrices with One Short Random Block per Row, with Applications" ("SGauss") and my much faster "on the fly" algorithm for gaussian elimination (or for this linear system, "banding"), which can be faster than peeling while also more compact and flexible. See util/ribbon_alg.h for more detailed introduction and background. RIBBON = Rapid Incremental Boolean Banding ON-the-fly
      
      This commit just adds generic (templatized) core algorithms and a basic unit test showing some features, including the ability to construct structures within 2.5% space overhead vs. information theoretic lower bound. (Compare to cache-local Bloom filter's ~50% space overhead -> ~30% reduction anticipated.) This commit does not include the storage scheme necessary to make queries fast, especially for filter queries, nor fractional "result bits", but there is some description already and those implementations will come soon. Nor does this commit add FilterPolicy support, for use in SST files, but that will also come soon.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7491
      
      Reviewed By: jay-zhuang
      
      Differential Revision: D24517954
      
      Pulled By: pdillinger
      
      fbshipit-source-id: 0119ee597e250d7e0edd38ada2ba50d755606fa7
      25d54c79
  11. 24 10月, 2020 3 次提交
    • Y
      Allow compaction iterator to perform garbage collection (#7556) · 65952679
      Yanqin Jin 提交于
      Summary:
      Add a threshold timestamp, full_history_ts_low_ of type `std::string*` to
      `CompactionIterator`, so that RocksDB can also perform garbage collection during
      compaction.
      * If full_history_ts_low_ is nullptr, then compaction iterator does not perform
        GC, preserving all timestamp history for all keys. Compaction iterator will
      treat user key with different timestamps as different user keys.
      * If full_history_ts_low_ is not nullptr, then compaction iterator performs
        GC. GC will look at keys older than `*full_history_ts_low_` and determine their
        eligibility based on factors including snapshots.
      
      Current rules of GC:
       * If an internal key is in the same snapshot as a previous counterpart
          with the same user key, and this key is eligible for GC, and the key is
          not single-delete or merge operand, then this key can be dropped. Note
          that the previous internal key cannot be a merge operand either.
       * If a tombstone is the most recent one in the earliest snapshot and it
          is eligible for GC, and keyNotExistsBeyondLevel() is true, then this
          tombstone can be dropped.
       * If a tombstone is the most recent one in a snapshot and it is eligible
          for GC, and the compaction is at bottommost level, then all other older
          internal keys of the same user key must also be eligible for GC, thus
          can be dropped
      * Single-delete, delete-range and merge are not currently supported.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7556
      
      Test Plan: make check
      
      Reviewed By: ltamasi
      
      Differential Revision: D24507728
      
      Pulled By: riversand963
      
      fbshipit-source-id: 3c09c7301f41eed76dfcf4d1527e68cf6e0a8bb3
      65952679
    • C
      Track WAL in MANIFEST: persist WALs to and recover WALs from MANIFEST (#7256) · 1b224324
      Cheng Chang 提交于
      Summary:
      This PR makes it able to `LogAndApply` `VersionEdit`s related to WALs, and also be able to `Recover` from MANIFEST with WAL related `VersionEdit`s.
      
      The `VersionEdit`s related to WAL are treated similarly as those related to column family operations, they are not applied to versions, but can be in a commit group. Mixing WAL related `VersionEdit`s with other types of edits will make logic in `ProcessManifestWrite` more complicated, so `VersionEdit`s related to WAL can either be WAL additions or deletions, like column family add and drop.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7256
      
      Test Plan: a set of unit tests are added in `version_set_test.cc`
      
      Reviewed By: riversand963
      
      Differential Revision: D23123238
      
      Pulled By: cheng-chang
      
      fbshipit-source-id: 246be2ed4744fd03fa2738aba408aaa611d0379c
      1b224324
    • P
      Add Encode/DecodeFixedGeneric, coding_lean.h (#7587) · a16d1b2f
      Peter Dillinger 提交于
      Summary:
      To minimize dependencies for Ribbon filter code in progress,
      core part of coding.h for fixed sizes has been moved to coding_lean.h.
      Also, generic versions of these functions have been added to math128.h
      (since the generic versions are likely only to be used along with
      Unsigned128).
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7587
      
      Test Plan: Unit tests added for new functions
      
      Reviewed By: jay-zhuang
      
      Differential Revision: D24486718
      
      Pulled By: pdillinger
      
      fbshipit-source-id: a69768f742379689442135fa52237c01dfe2647e
      a16d1b2f
  12. 23 10月, 2020 3 次提交
    • J
      add StartTrace and EndTrace to stackable_db (#7585) · b1cdb8cc
      jmn 提交于
      Summary:
      In addition to trace block cache access, we want to support trace queries on MySQL. To achieve that StartTrace and EndTrace need to be added to the stackable_db.h
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7585
      
      Reviewed By: zhichao-cao
      
      Differential Revision: D24482306
      
      Pulled By: nmjnmjnmj
      
      fbshipit-source-id: de641b4837c64cd33b44b5bebaeae5d1527c8c31
      b1cdb8cc
    • Z
      Make FileType Public and Replace kLogFile with kWalFile (#7580) · d8ec0a76
      Zhichao Cao 提交于
      Summary:
      As suggested by pdillinger ,The name of kLogFile is misleading, in some tests, kLogFile is defined as info log. Replace it with kWalFile and move it to public, which will be used in https://github.com/facebook/rocksdb/issues/7523
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/7580
      
      Test Plan: make check
      
      Reviewed By: riversand963
      
      Differential Revision: D24485420
      
      Pulled By: zhichao-cao
      
      fbshipit-source-id: 955e3dacc1021bb590fde93b0a568ffe9ad80799
      d8ec0a76
    • Z
      Make parallel compression optimization code tidier (#6888) · 1c78e4b2
      Ziyue Yang 提交于
      Summary:
      This commit makes https://github.com/facebook/rocksdb/issues/6262's code change tidier and easier to understand by:
      
      1. Wrapping parallel compression initialization and termination into
         common methods;
      2. Wrapping BlockRep initialization, push/pop into common methods;
      3. Wrapping file size estimation into common methods;
      4. Fixing function declarations that use non-const reference;
      5. Fixing some uninitialized variables;
      6. Fixing first_block data race;
      7. Making BlockRep::status check in BlockBasedTableBuilder::Finish only present
      if ok();
      8. Making assert(ok()) in BlockBasedTableBuilder::CompressAndVerifyBlock only
      present in non-parallel compression mode. In parallel compression mode,
      compression will abort if status is not OK;
      9. Eliminating potential data race caused by BlockBasedTableBuilder::GetStatus()
      and BlockBasedTableBuilder::GetIOStatus() by returning status copy instead of
      unprotected reference.
      
      Pull Request resolved: https://github.com/facebook/rocksdb/pull/6888
      
      Reviewed By: ajkr
      
      Differential Revision: D21957110
      
      Pulled By: jay-zhuang
      
      fbshipit-source-id: 3a29892f249209513f030349756cecd7736eae80
      1c78e4b2
  13. 22 10月, 2020 2 次提交
  14. 21 10月, 2020 3 次提交