README.md

    logo

    An One-Stop Real-Time HTAP database

    GitHub Workflow Status GitHub license slack badge WeChat badge Twitter Follow

    What is StoneDB

    logo

    StoneDB is a MySQL-compatible high-performance hybrid transaction/analytical processing (HTAP) database. It provides analytical processing (AP) abilities to MySQL. The running systems can be seamlessly migrated to StoneDB without any code changed. Compared to InnoDB, StoneDB provides 10 times the query performance as well as 10 times the load performance. StoneDB also provides 10:1 to 40:1 compression ratio.

    Architecture

    logo

    For more information about StoneDB, see stonedb.io.

    Contribution

    StoneDB welcomes all kinds of contributions, such as contributing code to the code base, sharing your experience on how to use StoneDB, and providing insights in the community on the Forums, or contributing to projects that make StoneDB a better project. For more specifics, see the contributing guide for more specifics.

    Getting Started

    The Getting Started part provides information about StoneDB supported platforms, installation (including creating your first table), and migrating from the running MySQL databases to StoneDB.

    Supported Platform

    The officially supported subsets of platforms are:

    • CentOS 7.9 or higher
    • Ubuntu 20.04 or higher

    Compiler toolsets we verify our builds with:

    • GCC 7.3 or higher

    The following packages we verify our builds with:

    • CMake 3.16.3 or higher
    • RocksDB 6.12.6 or higher
    • marisa 0.2.6 or higher

    Build StoneDB from the Source Code

    On a fresh Ubuntu 20.04 instance:

    For more information, see Compile StoneDB on Ubuntu 20.04.

    On CentOS 7.9:

    For more information, see Compile StoneDB on CentOS 7.

    Build StoneDB from Source Code in a Docker Container

    For more information, see Compile StoneDB in a Docker Container.

    Configure StoneDB

    After StoneDB is installed, you need to configure at least the following parameters in the my.cnf file:

    #the stonedb configuration options are listed as following.
    #for an example.
    [mysqld] 
    default-storage-engine=stonedb
    default-tmp-storage-engine=MyISAM
    binlog-format=STATEMENT

    Initialize the Database

    cd /path/to/your/path/bin && ./mysql_install_db --basedir=/stonedb/install/ --datadir=/stonedb/install/data/ --user=mysql

    Start the Database Instance

    mysqld_safe --defaults-file=/path/to/my.cnf 

    or

    cp /path/to/your/path/support-files/mysql.server /etc/init.d/
    service mysql start

    Create a StoneDB Table

    --The example code for creating a table with 'stonedb' engine.
    CREATE TABLE `example_table` (
      `id1` bigint(20) unsigned NOT NULL DEFAULT '0',
      `id1_type` int(10) unsigned NOT NULL DEFAULT '0',
      `id2` bigint(20) unsigned NOT NULL DEFAULT '0',
      `id2_type` int(10) unsigned NOT NULL DEFAULT '0',
      `data` varchar(255) NOT NULL DEFAULT '',
      `time` bigint(20) unsigned NOT NULL DEFAULT '0',
      `version` int(11) unsigned NOT NULL DEFAULT '0',
    ) ENGINE=stonedb DEFAULT COLLATE=utf8mb4_general_ci;
    

    The example shows some important features and limitations in StoneDB. For more information about limitations, please see StoneDB Limitations.

    • StoneDB data is stored in Column format and persist to RocksDB, and RocksDB plays as a disk to store the formatted data by column. All data is compressed, and the compression ratio can be 10:1 to 40:1.
    • StoneDB can achieve a competitive performance when processing ad-hoc queries, even without any indexes created. For more details, click here.

    Now, let's exprience your StoneDB

    Switch from MySQL to StoneDB in Production

    If you want to use both InnoDB and StoneDB within the same instance to run a join query, set stonedb_ini_allowmysqlquerypath to 1 in file my.cnf.

    Online migration tools to move data between storage engines are not currently developed, but you obviously want this to happen without downtime, data loss, or inaccurate results. To achieve this, you need to move data logically from the source MySQL server that uses the InnoDB engine and load it into StoneDB to do analytical processing. The detailed procedure is as follows:

    1. Create a StoneDB instance and tables.
    2. Copy all the database and table schemas from the source to the destination.
    3. Dump each table to a file by executing SELECT … INTO OUTFILE.
    4. Send the files to the destination and load them using LOAD DATA … INFILE.

    Documentation

    Documentation can be found online at https://stonedb.io. The documentation provides you with StoneDB basics, extensive examples of using StoneDB, as well as other information that you may need during your usage of StoneDB.

    Discussion

    The GitHub Discussions is the home for most discussions and communications about the StoneDB project. We welcome your participation. Every single opinion or suggestion of yours is welcomed and valued. We anticipate StoneDB to be an open and influential project.

    When participating in the StoneDB project, please ensure all your behavior complies with the Code of Conduct.

    项目简介

    StoneDB is an Open-Source MySQL HTAP and MySQL-Native DataBase for OLTP, Real-Time Analytics, a counterpart of MySQLHeatWave. (https://stonedb.io)

    🚀 Github 镜像仓库 🚀

    源项目地址

    https://github.com/stoneatom/stonedb

    发行版本 11

    stonedb-5.7-v1.0.4-alpha

    全部发行版

    贡献者 13

    全部贡献者

    开发语言

    • C++ 52.1 %
    • C 38.6 %
    • Perl 3.1 %
    • Objective-C 1.1 %
    • Yacc 0.8 %