## A.10 MySQL 8.0 FAQ: NDB Cluster

[]()[]()[]()

 In the following section, we answer questions that are frequently asked about MySQL NDB Cluster and the [`NDB`](mysql-cluster.html) storage engine.

[]()A.10.1. [ Which versions of the MySQL software support NDB Cluster? Do I have to compile from source? ](faqs-mysql-cluster.html#faq-cluster-which-versions-support-cluster)A.10.2. [ What do “NDB” and “NDBCLUSTER” mean? ](faqs-mysql-cluster.html#faq-cluster-what-is-ndb)A.10.3. [ What is the difference between using NDB Cluster versus using MySQL Replication? ](faqs-mysql-cluster.html#faq-cluster-what-cluster-vs-replication)A.10.4. [ Do I need any special networking to run NDB Cluster? How do computers in a cluster communicate? ](faqs-mysql-cluster.html#faq-cluster-how-cluster-network-need)A.10.5. [ How many computers do I need to run an NDB Cluster, and why? ](faqs-mysql-cluster.html#faq-cluster-what-min-hosts-cluster)A.10.6. [ What do the different computers do in an NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-hosts-do-clustering)A.10.7. [ When I run the SHOW command in the NDB Cluster management client, I see a line of output that looks like this: ](faqs-mysql-cluster.html#faq-cluster-what-show-nodegroup-star)A.10.8. [ With which operating systems can I use NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-which-os-clustering)A.10.9. [ What are the hardware requirements for running NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-cluster-requirements)A.10.10. [ How much RAM do I need to use NDB Cluster? Is it possible to use disk memory at all? ](faqs-mysql-cluster.html#faq-cluster-what-memory-needed-cluster)A.10.11. [ What file systems can I use with NDB Cluster? What about network file systems or network shares? ](faqs-mysql-cluster.html#faq-cluster-what-cluster-file-systems)A.10.12. [ Can I run NDB Cluster nodes inside virtual machines (such as those created by VMWare, VirtualBox, Parallels, or Xen)? ](faqs-mysql-cluster.html#faq-cluster-can-cluster-vm)A.10.13. [ I am trying to populate an NDB Cluster database. The loading process terminates prematurely and I get an error message like this one: ](faqs-mysql-cluster.html#faq-cluster-why-error-1114)A.10.14. [ NDB Cluster uses TCP/IP. Does this mean that I can run it over the Internet, with one or more nodes in remote locations? ](faqs-mysql-cluster.html#faq-cluster-can-cluster-remote-network)A.10.15. [ Do I have to learn a new programming or query language to use NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-language-needed-cluster)A.10.16. [ What programming languages and APIs are supported by NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-api-cluster-support)A.10.17. [ Does NDB Cluster include any management tools? ](faqs-mysql-cluster.html#faq-cluster-what-cluster-management-tools)A.10.18. [ How do I find out what an error or warning message means when using NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-cluster-errors-are)A.10.19. [ Is NDB Cluster transaction-safe? What isolation levels are supported? ](faqs-mysql-cluster.html#faq-cluster-is-cluster-transaction-safe)A.10.20. [ What storage engines are supported by NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-storage-engines-cluster)A.10.21. [ In the event of a catastrophic failure— for example, the whole city loses power and my UPS fails—would I lose all my data? ](faqs-mysql-cluster.html#faq-cluster-is-data-loss-no-power)A.10.22. [ Is it possible to use FULLTEXT indexes with NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-can-cluster-fullindex)A.10.23. [ Can I run multiple nodes on a single computer? ](faqs-mysql-cluster.html#faq-cluster-can-multinode-cluster-one-host)A.10.24. [ Can I add data nodes to an NDB Cluster without restarting it? ](faqs-mysql-cluster.html#faq-cluster-how-add-nodes-no-restart)A.10.25. [ Are there any limitations that I should be aware of when using NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-cluster-limitations)A.10.26. [ Does NDB Cluster support foreign keys? ](faqs-mysql-cluster.html#faq-cluster-have-foreign-keys-cluster)A.10.27. [ How do I import an existing MySQL database into an NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-how-import-db-cluster)A.10.28. [ How do NDB Cluster nodes communicate with one another? ](faqs-mysql-cluster.html#faq-cluster-how-nodes-communicate)A.10.29. [ What is an arbitrator? ](faqs-mysql-cluster.html#faq-cluster-what-is-arbitrator)A.10.30. [ What data types are supported by NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-what-types-cluster-support)A.10.31. [ How do I start and stop NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-how-start-stop-cluster)A.10.32. [ What happens to NDB Cluster data when the NDB Cluster is shut down? ](faqs-mysql-cluster.html#faq-cluster-what-shutdown-do-data)A.10.33. [ Is it a good idea to have more than one management node for an NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-have-multiple-node-managers)A.10.34. [ Can I mix different kinds of hardware and operating systems in one NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-have-different-cluster-hosts)A.10.35. [ Can I run two data nodes on a single host? Two SQL nodes? ](faqs-mysql-cluster.html#faq-cluster-have-multiple-nodes-one-host)A.10.36. [ Can I use host names with NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-have-host-names-cluster)A.10.37. [ Does NDB Cluster support IPv6? ](faqs-mysql-cluster.html#faq-cluster-have-ipv6-support-cluster)A.10.38. [ How do I handle MySQL users in an NDB Cluster having multiple MySQL servers? ](faqs-mysql-cluster.html#faq-cluster-have-multiple-users-servers-cluster)A.10.39. [ How do I continue to send queries in the event that one of the SQL nodes fails? ](faqs-mysql-cluster.html#faq-cluster-how-continue-after-node-error)A.10.40. [ How do I back up and restore an NDB Cluster? ](faqs-mysql-cluster.html#faq-cluster-how-backup-restore-cluster)A.10.41. [ What is an “angel process”? ](faqs-mysql-cluster.html#faq-cluster-what-angel-process)

|[]()[]()<br/><br/>**A.10.1.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              Which versions of the MySQL software support NDB Cluster? Do I have to compile from source?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|:-----------------------------|: |
|                              | NDB Cluster is not supported in standard MySQL Server 8.0 releases. Instead, MySQL NDB Cluster is provided as a separate product. Available NDB Cluster release series include the following:<br/><br/>* **NDB Cluster 7.2.**  This series is no longer supported for new deployments or maintained. Users of NDB Cluster 7.2 should upgrade to a newer release series as soon as possible. We recommend that new deployments use the latest NDB Cluster 8.0 release.<br/><br/>* **NDB Cluster 7.3.**  This series is a previous General Availability (GA) version of NDB Cluster, still available for production use, although we recommend that new deployments use the latest NDB Cluster 8.0 release. The most recent NDB Cluster 7.3 release can be obtained from [https://dev.mysql.com/downloads/cluster/](https://dev.mysql.com/downloads/cluster/).<br/><br/>* **NDB Cluster 7.4.**  This series is a previous General Availability (GA) version of NDB Cluster, still available for production use, although we recommend that new deployments use the latest NDB Cluster 8.0 release. The most recent NDB Cluster 7.4 release can be obtained from [https://dev.mysql.com/downloads/cluster/](https://dev.mysql.com/downloads/cluster/).<br/><br/>* **NDB Cluster 7.5.**  This series is a previous General Availability (GA) version of NDB Cluster, still available for production use, although we recommend that new deployments use the latest NDB Cluster 7.6 release. The latest NDB Cluster 7.5 releases can be obtained from [https://dev.mysql.com/downloads/cluster/](https://dev.mysql.com/downloads/cluster/).<br/><br/>* **NDB Cluster 7.6.**  This series is a previous General Availability (GA) version of NDB Cluster, still available for production use, although we recommend that new deployments use the latest NDB Cluster 8.0 release. The latest NDB Cluster 7.6 releases can be obtained from [https://dev.mysql.com/downloads/cluster/](https://dev.mysql.com/downloads/cluster/).<br/><br/>* **NDB Cluster 8.0.**  This series is the most recent General Availability (GA) version of NDB Cluster, based on version 8.0 of the [`NDB`](mysql-cluster.html) storage engine and MySQL Server 8.0. NDB Cluster 8.0 is available for production use; new deployments intended for production should use the latest GA release in this series, which is currently NDB Cluster 8.0.29. You can obtain the most recent NDB Cluster 8.0 release from [https://dev.mysql.com/downloads/cluster/](https://dev.mysql.com/downloads/cluster/). For information about new features and other important changes in this series, see [Section 23.2.4, “What is New in NDB Cluster”](mysql-cluster-what-is-new.html).<br/><br/> You can obtain and compile NDB Cluster from source (see [Section 23.3.1.4, “Building NDB Cluster from Source on Linux”](mysql-cluster-install-linux-source.html), and [Section 23.3.2.2, “Compiling and Installing NDB Cluster from Source on Windows”](mysql-cluster-install-windows-source.html)), but for all but the most specialized cases, we recommend using one of the following installers provided by Oracle that is appropriate to your operating platform and circumstances:<br/><br/>* The web-based [NDB Cluster Auto-Installer](mysql-cluster-installer.html) (works on all platforms supported by `NDB`)<br/><br/>* Linux [binary release](mysql-cluster-install-linux-binary.html) (`tar.gz` file)<br/><br/>* Linux [RPM package](mysql-cluster-install-linux-rpm.html)<br/><br/>* Linux [`.deb` file](mysql-cluster-install-debian.html)<br/><br/>* Windows [binary “no-install” release](mysql-cluster-install-windows-binary.html)<br/><br/>* Windows [MSI Installer](mysql-installer.html)<br/><br/> Installation packages may also be available from your platform's package management system.<br/><br/> You can determine whether your MySQL Server has [`NDB`](mysql-cluster.html) support using one of the statements `SHOW VARIABLES LIKE 'have_%'`, [`SHOW ENGINES`](show-engines.html), or [`SHOW PLUGINS`](show-plugins.html).|
|[]()[]()<br/><br/>**A.10.2.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         What do “NDB” and “NDBCLUSTER” mean?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      “NDB” stands for “**N**etwork **D**ata**b**ase”. `NDB` and `NDBCLUSTER` are both names for the storage engine that enables clustering support with MySQL. `NDB` is preferred, but either name is correct.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
|[]()[]()<br/><br/>**A.10.3.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   What is the difference between using NDB Cluster versus using MySQL Replication?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      In traditional MySQL replication, a source MySQL server updates one or more replicas. Transactions are committed sequentially, and a slow transaction can cause the replica to lag behind the source. This means that if the source fails, it is possible that the replica might not have recorded the last few transactions. If a transaction-safe engine such as [`InnoDB`](innodb-storage-engine.html) is being used, a transaction is either completed on the replica or not applied at all, but replication does not guarantee that all data on the source and the replica remains consistent at all times. In NDB Cluster, all data nodes are kept in synchrony, and a transaction committed by any one data node is committed for all data nodes. In the event of a data node failure, all remaining data nodes remain in a consistent state.<br/><br/> In short, whereas standard MySQL replication is asynchronous, NDB Cluster is synchronous.<br/><br/> Asynchronous replication is also available in NDB Cluster. NDB Cluster Replication (also sometimes known as “geo-replication”) includes the capability to replicate both between two NDB Clusters, and from an NDB Cluster to a non-Cluster MySQL server. See [Section 23.7, “NDB Cluster Replication”](mysql-cluster-replication.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|[]()[]()<br/><br/>**A.10.4.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            Do I need any special networking to run NDB Cluster? How do computers in a cluster communicate?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               NDB Cluster is intended to be used in a high-bandwidth environment, with computers connecting using TCP/IP. Its performance depends directly upon the connection speed between the cluster's computers. The minimum connectivity requirements for NDB Cluster include a typical 100-megabit Ethernet network or the equivalent. We recommend you use gigabit Ethernet whenever available.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
|[]()[]()<br/><br/>**A.10.5.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             How many computers do I need to run an NDB Cluster, and why?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             A minimum of three computers is required to run a viable cluster. However, the minimum *recommended* number of computers in an NDB Cluster is four: one each to run the management and SQL nodes, and two computers to serve as data nodes. The purpose of the two data nodes is to provide redundancy; the management node must run on a separate machine to guarantee continued arbitration services in the event that one of the data nodes fails.<br/><br/> To provide increased throughput and high availability, you should use multiple SQL nodes (MySQL Servers connected to the cluster). It is also possible (although not strictly necessary) to run multiple management servers.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|[]()[]()<br/><br/>**A.10.6.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 What do the different computers do in an NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                An NDB Cluster has both a physical and logical organization, with computers being the physical elements. The logical or functional elements of a cluster are referred to as nodes, and a computer housing a cluster node is sometimes referred to as a cluster host. There are three types of nodes, each corresponding to a specific role within the cluster. These are:<br/><br/>* **Management node.**  This node provides management services for the cluster as a whole, including startup, shutdown, backups, and configuration data for the other nodes. The management node server is implemented as the application [**ndb\_mgmd**](mysql-cluster-programs-ndb-mgmd.html); the management client used to control NDB Cluster is [**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html). See [Section 23.5.4, “ndb\_mgmd — The NDB Cluster Management Server Daemon”](mysql-cluster-programs-ndb-mgmd.html), and [Section 23.5.5, “ndb\_mgm — The NDB Cluster Management Client”](mysql-cluster-programs-ndb-mgm.html), for information about these programs.<br/><br/>* **Data node.**  This type of node stores and replicates data. Data node functionality is handled by instances of the [`NDB`](mysql-cluster.html) data node process [**ndbd**](mysql-cluster-programs-ndbd.html). For more information, see [Section 23.5.1, “ndbd — The NDB Cluster Data Node Daemon”](mysql-cluster-programs-ndbd.html).<br/><br/>* **SQL node.**  This is simply an instance of MySQL Server ([**mysqld**](mysqld.html)) that is built with support for the [`NDBCLUSTER`](mysql-cluster.html) storage engine and started with the `--ndb-cluster` option to enable the engine and the `--ndb-connectstring` option to enable it to connect to an NDB Cluster management server. For more about these options, see [Section 23.4.3.9.1, “MySQL Server Options for NDB Cluster”](mysql-cluster-options-variables.html#mysql-cluster-program-options-mysqld).<br/><br/>  Note<br/><br/>   An API node is any application that makes direct use of Cluster data nodes for data storage and retrieval. An SQL node can thus be considered a type of API node that uses a MySQL Server to provide an SQL interface to the Cluster. You can write such applications (that do not depend on a MySQL Server) using the NDB API, which supplies a direct, object-oriented transaction and scanning interface to NDB Cluster data; see [NDB Cluster API Overview: The NDB API](https://dev.mysql.com/doc/ndbapi/en/overview-ndb-api.html), for more information.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|[]()[]()<br/><br/>**A.10.7.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              When I run the `SHOW` command in the NDB Cluster management client, I see a line of output that looks like this:<br/><br/>```<br/>id=2    @10.100.10.32  (Version: 8.0.29-ndb-8.0.29 Nodegroup: 0, *)<br/>```<br/><br/> What does the `*` mean? How is this node different from the others?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        The simplest answer is, “It's not something you can control, and it's nothing that you need to worry about in any case, unless you're a software engineer writing or analyzing the NDB Cluster source code”.<br/><br/> If you don't find that answer satisfactory, here's a longer and more technical version:<br/><br/> A number of mechanisms in NDB Cluster require distributed coordination among the data nodes. These distributed algorithms and protocols include global checkpointing, DDL (schema) changes, and node restart handling. To make this coordination simpler, the data nodes “elect” one of their number to act as leader. There is no user-facing mechanism for influencing this selection, which is completely automatic; the fact that it *is* automatic is a key part of NDB Cluster's internal architecture.<br/><br/> When a node acts as the “leader” for any of these mechanisms, it is usually the point of coordination for the activity, and the other nodes act as “followers”, carrying out their parts of the activity as directed by the leader. If the node acting as leader fails, then the remaining nodes elect a new leader. Tasks in progress that were being coordinated by the old leader may either fail or be continued by the new leader, depending on the actual mechanism involved.<br/><br/> It is possible for some of these different mechanisms and protocols to have different leader nodes, but in general the same leader is chosen for all of them. The node indicated as the leader in the output of [`SHOW`](mysql-cluster-mgm-client-commands.html#ndbclient-show) in the management client is known internally as the [`DICT`](https://dev.mysql.com/doc/ndb-internals/en/ndb-internals-kernel-blocks-dbdict.html) manager, responsible for coordinating DDL and metadata activity.<br/><br/> NDB Cluster is designed in such a way that the choice of leader has no discernible effect outside the cluster itself. For example, the current leader does not have significantly higher CPU or resource usage than the other data nodes, and failure of the leader should not have a significantly different impact on the cluster than the failure of any other data node.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
|[]()[]()<br/><br/>**A.10.8.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  With which operating systems can I use NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   NDB Cluster is supported on most Unix-like operating systems. NDB Cluster is also supported in production settings on Microsoft Windows operating systems.<br/><br/> For more detailed information concerning the level of support which is offered for NDB Cluster on various operating system versions, operating system distributions, and hardware platforms, please refer to [https://www.mysql.com/support/supportedplatforms/cluster.html](https://www.mysql.com/support/supportedplatforms/cluster.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
|[]()[]()<br/><br/>**A.10.9.** |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              What are the hardware requirements for running NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             NDB Cluster should run on any platform for which [`NDB`](mysql-cluster.html)-enabled binaries are available. For data nodes and API nodes, faster CPUs and more memory are likely to improve performance, and 64-bit CPUs are likely to be more effective than 32-bit processors. There must be sufficient memory on machines used for data nodes to hold each node's share of the database (see *How much RAM do I Need?* for more information). For a computer which is used only for running the NDB Cluster management server, the requirements are minimal; a common desktop PC (or the equivalent) is generally sufficient for this task. Nodes can communicate through the standard TCP/IP network and hardware. They can also use the high-speed SCI protocol; however, special networking hardware and software are required to use SCI (see [Section 23.4.4, “Using High-Speed Interconnects with NDB Cluster”](mysql-cluster-interconnects.html)).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
|[]()[]()<br/><br/>**A.10.10.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 How much RAM do I need to use NDB Cluster? Is it possible to use disk memory at all?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
|                              |                                                                                                                                                                               NDB Cluster was originally implemented as in-memory only, but all versions currently available also provide the ability to store NDB Cluster on disk. See [Section 23.6.10, “NDB Cluster Disk Data Tables”](mysql-cluster-disk-data.html), for more information.<br/><br/> For in-memory `NDB` tables, you can use the following formula for obtaining a rough estimate of how much RAM is needed for each data node in the cluster:<br/><br/>```<br/>(SizeofDatabase × NumberOfReplicas × 1.1 ) / NumberOfDataNodes<br/>```<br/><br/> To calculate the memory requirements more exactly requires determining, for each table in the cluster database, the storage space required per row (see [Section 11.7, “Data Type Storage Requirements”](storage-requirements.html), for details), and multiplying this by the number of rows. You must also remember to account for any column indexes as follows:<br/><br/>* Each primary key or hash index created for an [`NDBCLUSTER`](mysql-cluster.html) table requires 21−25 bytes per record. These indexes use `IndexMemory`.<br/><br/>* Each ordered index requires 10 bytes storage per record, using `DataMemory`.<br/><br/>* Creating a primary key or unique index also creates an ordered index, unless this index is created with `USING HASH`. In other words:<br/><br/>  * A primary key or unique index on a Cluster table normally takes up 31 to 35 bytes per record.<br/><br/>  * However, if the primary key or unique index is created with `USING HASH`, then it requires only 21 to 25 bytes per record.<br/><br/> Creating NDB Cluster tables with `USING HASH` for all primary keys and unique indexes generally causes table updates to run more quickly—in some cases by a much as 20 to 30 percent faster than updates on tables where `USING HASH` was not used in creating primary and unique keys. This is due to the fact that less memory is required (because no ordered indexes are created), and that less CPU must be utilized (because fewer indexes must be read and possibly updated). However, it also means that queries that could otherwise use range scans must be satisfied by other means, which can result in slower selects.<br/><br/> When calculating Cluster memory requirements, you may find useful the [**ndb\_size.pl**](mysql-cluster-programs-ndb-size-pl.html) utility which is available in recent MySQL 8.0 releases. This Perl script connects to a current (non-Cluster) MySQL database and creates a report on how much space that database would require if it used the [`NDBCLUSTER`](mysql-cluster.html) storage engine. For more information, see [Section 23.5.28, “ndb\_size.pl — NDBCLUSTER Size Requirement Estimator”](mysql-cluster-programs-ndb-size-pl.html).<br/><br/> It is especially important to keep in mind that *every NDB Cluster table must have a primary key*. The [`NDB`](mysql-cluster.html) storage engine creates a primary key automatically if none is defined; this primary key is created without `USING HASH`.<br/><br/> You can determine how much memory is being used for storage of NDB Cluster data and indexes at any given time using the `REPORT MEMORYUSAGE` command in the [**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html) client; see [Section 23.6.1, “Commands in the NDB Cluster Management Client”](mysql-cluster-mgm-client-commands.html), for more information. In addition, warnings are written to the cluster log when 80% of available [`DataMemory`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-datamemory) or (prior to NDB 7.6) [`IndexMemory`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-indexmemory) is in use, and again when usage reaches 90%, 99%, and 100%.                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.11.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           What file systems can I use with NDB Cluster? What about network file systems or network shares?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                Generally, any file system that is native to the host operating system should work well with NDB Cluster. If you find that a given file system works particularly well (or not so especially well) with NDB Cluster, we invite you to discuss your findings in the [NDB Cluster Forums](https://forums.mysql.com/list.php?25).<br/><br/> For Windows, we recommend that you use `NTFS` file systems for NDB Cluster, just as we do for standard MySQL. We do not test NDB Cluster with `FAT` or `VFAT` file systems. Because of this, we do not recommend their use with MySQL or NDB Cluster.<br/><br/> NDB Cluster is implemented as a shared-nothing solution; the idea behind this is that the failure of a single piece of hardware should not cause the failure of multiple cluster nodes, or possibly even the failure of the cluster as a whole. For this reason, the use of network shares or network file systems is not supported for NDB Cluster. This also applies to shared storage devices such as SANs.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.12.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Can I run NDB Cluster nodes inside virtual machines (such as those created by VMWare, VirtualBox, Parallels, or Xen)?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         NDB Cluster is supported for use in virtual machines. We currently support and test using [Oracle VM](http://www.oracle.com/technetwork/server-storage/vm/index.html).<br/><br/> Some NDB Cluster users have successfully deployed NDB Cluster using other virtualization products; in such cases, Oracle can provide NDB Cluster support, but issues specific to the virtual environment must be referred to that product's vendor.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
|[]()[]()<br/><br/>**A.10.13.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          I am trying to populate an NDB Cluster database. The loading process terminates prematurely and I get an error message like this one:<br/><br/>`ERROR 1114: The table 'my_cluster_table' is full`<br/><br/> Why is this happening?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        The cause is very likely to be that your setup does not provide sufficient RAM for all table data and all indexes, *including the primary key required by the [`NDB`](mysql-cluster.html) storage engine and automatically created in the event that the table definition does not include the definition of a primary key*.<br/><br/> It is also worth noting that all data nodes should have the same amount of RAM, since no data node in a cluster can use more memory than the least amount available to any individual data node. For example, if there are four computers hosting Cluster data nodes, and three of these have 3GB of RAM available to store Cluster data while the remaining data node has only 1GB RAM, then each data node can devote at most 1GB to NDB Cluster data and indexes.<br/><br/> In some cases it is possible to get Table is full errors in MySQL client applications even when [**ndb\_mgm -e "ALL REPORT MEMORYUSAGE"**](mysql-cluster-programs-ndb-mgm.html) shows significant free [`DataMemory`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-datamemory). You can force [`NDB`](mysql-cluster.html) to create extra partitions for NDB Cluster tables and thus have more memory available for hash indexes by using the `MAX_ROWS` option for [`CREATE TABLE`](create-table.html). In general, setting `MAX_ROWS` to twice the number of rows that you expect to store in the table should be sufficient.<br/><br/> For similar reasons, you can also sometimes encounter problems with data node restarts on nodes that are heavily loaded with data. The [`MinFreePct`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-minfreepct) parameter can help with this issue by reserving a portion (5% by default) of [`DataMemory`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-datamemory) and (prior to NDB 7.6) [`IndexMemory`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-indexmemory) for use in restarts. This reserved memory is not available for storing [`NDB`](mysql-cluster.html) tables or data.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
|[]()[]()<br/><br/>**A.10.14.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               NDB Cluster uses TCP/IP. Does this mean that I can run it over the Internet, with one or more nodes in remote locations?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            It is *very* unlikely that a cluster would perform reliably under such conditions, as NDB Cluster was designed and implemented with the assumption that it would be run under conditions guaranteeing dedicated high-speed connectivity such as that found in a LAN setting using 100 Mbps or gigabit Ethernet—preferably the latter. We neither test nor warrant its performance using anything slower than this.<br/><br/> Also, it is extremely important to keep in mind that communications between the nodes in an NDB Cluster are not secure; they are neither encrypted nor safeguarded by any other protective mechanism. The most secure configuration for a cluster is in a private network behind a firewall, with no direct access to any Cluster data or management nodes from outside. (For SQL nodes, you should take the same precautions as you would with any other instance of the MySQL server.) For more information, see [Section 23.6.18, “NDB Cluster Security Issues”](mysql-cluster-security.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
|[]()[]()<br/><br/>**A.10.15.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Do I have to learn a new programming or query language to use NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           *No*. Although some specialized commands are used to manage and configure the cluster itself, only standard (My)SQL statements are required for the following operations:<br/><br/>* Creating, altering, and dropping tables<br/><br/>* Inserting, updating, and deleting table data<br/><br/>* Creating, changing, and dropping primary and unique indexes<br/><br/> Some specialized configuration parameters and files are required to set up an NDB Cluster—see [Section 23.4.3, “NDB Cluster Configuration Files”](mysql-cluster-config-file.html), for information about these.<br/><br/> A few simple commands are used in the NDB Cluster management client ([**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html)) for tasks such as starting and stopping cluster nodes. See [Section 23.6.1, “Commands in the NDB Cluster Management Client”](mysql-cluster-mgm-client-commands.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
|[]()[]()<br/><br/>**A.10.16.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           What programming languages and APIs are supported by NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    NDB Cluster supports the same programming APIs and languages as the standard MySQL Server, including ODBC, .Net, the MySQL C API, and numerous drivers for popular scripting languages such as PHP, Perl, and Python. NDB Cluster applications written using these APIs behave similarly to other MySQL applications; they transmit SQL statements to a MySQL Server (in the case of NDB Cluster, an SQL node), and receive responses containing rows of data. For more information about these APIs, see [Chapter 29, *Connectors and APIs*](connectors-apis.html).<br/><br/> NDB Cluster also supports application programming using the NDB API, which provides a low-level C++ interface to NDB Cluster data without needing to go through a MySQL Server. See [The NDB API](https://dev.mysql.com/doc/ndbapi/en/ndbapi.html). In addition, many [`NDBCLUSTER`](mysql-cluster.html) management functions are exposed by the C-language MGM API; see [The MGM API](https://dev.mysql.com/doc/ndbapi/en/mgm-api.html), for more information.<br/><br/> NDB Cluster also supports Java application programming using ClusterJ, which supports a domain object model of data using sessions and transactions. See [Java and NDB Cluster](https://dev.mysql.com/doc/ndbapi/en/mccj-overview-java.html), for more information.<br/><br/> In addition, NDB Cluster provides support for `memcached`, allowing developers to access data stored in NDB Cluster using the `memcached` interface; for more information, see [ndbmemcache—Memcache API for NDB Cluster (NO LONGER SUPPORTED)](https://dev.mysql.com/doc/ndbapi/en/ndbmemcache.html).<br/><br/> NDB Cluster also includes adapters supporting NoSQL applications written against `Node.js`, with NDB Cluster as the data store. See [MySQL NoSQL Connector for JavaScript](https://dev.mysql.com/doc/ndbapi/en/ndb-nodejs.html), for more information.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
|[]()[]()<br/><br/>**A.10.17.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    Does NDB Cluster include any management tools?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            NDB Cluster includes a command line client for performing basic management functions. See [Section 23.5.5, “ndb\_mgm — The NDB Cluster Management Client”](mysql-cluster-programs-ndb-mgm.html), and [Section 23.6.1, “Commands in the NDB Cluster Management Client”](mysql-cluster-mgm-client-commands.html).<br/><br/> NDB Cluster 7.6 and earlier are also supported by MySQL Cluster Manager, a separate product providing an advanced command line interface that can automate many NDB Cluster management tasks such as rolling restarts and configuration changes. Beginning with version 1.4.8, MySQL Cluster Manager also provides experimental support for NDB Cluster 8.0. For more information about MySQL Cluster Manager, see [MySQL Cluster Manager 1.4.8 User Manual](https://dev.mysql.com/doc/mysql-cluster-manager/1.4/en/).<br/><br/> NDB Cluster also provides a graphical, browser-based Auto-Installer for setting up and deploying NDB Cluster, as part of the NDB Cluster software distribution. For more information, see [The NDB Cluster Auto-Installer (NDB 7.5) (No longer supported)](https://dev.mysql.com/doc/refman/5.7/en/mysql-cluster-install-auto.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|[]()[]()<br/><br/>**A.10.18.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   How do I find out what an error or warning message means when using NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    There are two ways in which this can be done:<br/><br/>* From within the [**mysql**](mysql.html) client, use **SHOW ERRORS** or **SHOW WARNINGS** immediately upon being notified of the error or warning condition.<br/><br/>* From a system shell prompt, use [**perror --ndb *`error_code`***](perror.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|[]()[]()<br/><br/>**A.10.19.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         Is NDB Cluster transaction-safe? What isolation levels are supported?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        *Yes*. For tables created with the [`NDB`](mysql-cluster.html) storage engine, transactions are supported. Currently, NDB Cluster supports only the [`READ COMMITTED`](innodb-transaction-isolation-levels.html#isolevel_read-committed) transaction isolation level.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
|[]()[]()<br/><br/>**A.10.20.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  What storage engines are supported by NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               NDB Cluster requires the [`NDB`](mysql-cluster.html) storage engine. That is, in order for a table to be shared between nodes in an NDB Cluster, the table must be created using `ENGINE=NDB` (or the equivalent option `ENGINE=NDBCLUSTER`).<br/><br/> It is possible to create tables using other storage engines (such as [`InnoDB`](innodb-storage-engine.html) or [`MyISAM`](myisam-storage-engine.html)) on a MySQL server being used with NDB Cluster, but since these tables do not use [`NDB`](mysql-cluster.html), they do not participate in clustering; each such table is strictly local to the individual MySQL server instance on which it is created.<br/><br/> NDB Cluster is quite different from [`InnoDB`](innodb-storage-engine.html) clustering with regard to architecture, requirements, and implementation; despite any similarity in their names, the two are not compatible. For more information about `InnoDB` clustering, see [MySQL AdminAPI](https://dev.mysql.com/doc/mysql-shell/8.0/en/admin-api-userguide.html). See also [Section 23.2.6, “MySQL Server Using InnoDB Compared with NDB Cluster”](mysql-cluster-compared.html), for information about the differences between the `NDB` and `InnoDB` storage engines.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
|[]()[]()<br/><br/>**A.10.21.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             In the event of a catastrophic failure— for example, the whole city loses power *and* my UPS fails—would I lose all my data?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               All committed transactions are logged. Therefore, although it is possible that some data could be lost in the event of a catastrophe, this should be quite limited. Data loss can be further reduced by minimizing the number of operations per transaction. (It is not a good idea to perform large numbers of operations per transaction in any case.)                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.22.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              Is it possible to use `FULLTEXT` indexes with NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               `FULLTEXT` indexing is currently supported only by the [`InnoDB`](innodb-storage-engine.html) and [`MyISAM`](myisam-storage-engine.html) storage engines. See [Section 12.10, “Full-Text Search Functions”](fulltext-search.html), for more information.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.23.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    Can I run multiple nodes on a single computer?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                It is possible but not always advisable. One of the chief reasons to run a cluster is to provide redundancy. To obtain the full benefits of this redundancy, each node should reside on a separate machine. If you place multiple nodes on a single machine and that machine fails, you lose all of those nodes. For this reason, if you do run multiple data nodes on a single machine, it is *extremely* important that they be set up in such a way that the failure of this machine does not cause the loss of all the data nodes in a given node group.<br/><br/> Given that NDB Cluster can be run on commodity hardware loaded with a low-cost (or even no-cost) operating system, the expense of an extra machine or two is well worth it to safeguard mission-critical data. It also worth noting that the requirements for a cluster host running a management node are minimal. This task can be accomplished with a 300 MHz Pentium or equivalent CPU and sufficient RAM for the operating system, plus a small amount of overhead for the [**ndb\_mgmd**](mysql-cluster-programs-ndb-mgmd.html) and [**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html) processes.<br/><br/> It is acceptable to run multiple cluster data nodes on a single host that has multiple CPUs, cores, or both. The NDB Cluster distribution also provides a multithreaded version of the data node binary intended for use on such systems. For more information, see [Section 23.5.3, “ndbmtd — The NDB Cluster Data Node Daemon (Multi-Threaded)”](mysql-cluster-programs-ndbmtd.html).<br/><br/> It is also possible in some cases to run data nodes and SQL nodes concurrently on the same machine; how well such an arrangement performs is dependent on a number of factors such as number of cores and CPUs as well as the amount of disk and memory available to the data node and SQL node processes, and you must take these factors into account when planning such a configuration.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.24.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             Can I add data nodes to an NDB Cluster without restarting it?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           It is possible to add new data nodes to a running NDB Cluster without taking the cluster offline. For more information, see [Section 23.6.7, “Adding NDB Cluster Data Nodes Online”](mysql-cluster-online-add-node.html).<br/><br/> For other types of NDB Cluster nodes, a rolling restart is all that is required (see [Section 23.6.5, “Performing a Rolling Restart of an NDB Cluster”](mysql-cluster-rolling-restart.html)).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
|[]()[]()<br/><br/>**A.10.25.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Are there any limitations that I should be aware of when using NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 Limitations on [`NDB`](mysql-cluster.html) tables in MySQL NDB Cluster include the following:<br/><br/>* Temporary tables are not supported; a [`CREATE TEMPORARY TABLE`](create-table.html) statement using `ENGINE=NDB` or `ENGINE=NDBCLUSTER` fails with an error.<br/><br/>* The only types of user-defined partitioning supported for [`NDBCLUSTER`](mysql-cluster.html) tables are `KEY` and `LINEAR KEY`. Trying to create an `NDB` table using any other partitioning type fails with an error.<br/><br/>* `FULLTEXT` indexes are not supported.<br/><br/>* Index prefixes are not supported. Only complete columns may be indexed.<br/><br/>* Spatial indexes are not supported (although spatial columns can be used). See [Section 11.4, “Spatial Data Types”](spatial-types.html).<br/><br/>* Support for partial transactions and partial rollbacks is comparable to that of other transactional storage engines such as [`InnoDB`](innodb-storage-engine.html) that can roll back individual statements.<br/><br/>* The maximum number of attributes allowed per table is 512. Attribute names cannot be any longer than 31 characters. For each table, the maximum combined length of the table and database names is 122 characters.<br/><br/>* Priot to NDB 8.0, the maximum size for a table row is 14 kilobytes, not counting [`BLOB`](blob.html) values. In NDB 8.0, this maximum is increased to 30000 bytes. See [Section 23.2.7.5, “Limits Associated with Database Objects in NDB Cluster”](mysql-cluster-limitations-database-objects.html), for more information.<br/><br/>   There is no set limit for the number of rows per `NDB` table. Limits on table size depend on a number of factors, in particular on the amount of RAM available to each data node.<br/><br/> For a complete listing of limitations in NDB Cluster, see [Section 23.2.7, “Known Limitations of NDB Cluster”](mysql-cluster-limitations.html). See also [Section 23.2.7.11, “Previous NDB Cluster Issues Resolved in NDB Cluster 8.0”](mysql-cluster-limitations-resolved.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|[]()[]()<br/><br/>**A.10.26.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        Does NDB Cluster support foreign keys?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             NDB Cluster provides support for foreign key constraints which is comparable to that found in the [`InnoDB`](innodb-storage-engine.html) storage engine; see [Section 1.7.3.2, “FOREIGN KEY Constraints”](constraint-foreign-key.html), for more detailed information, as well as [Section 13.1.20.5, “FOREIGN KEY Constraints”](create-table-foreign-keys.html). Applications requiring foreign key support should use NDB Cluster 7.3, 7.4, 7.5, or later.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|[]()[]()<br/><br/>**A.10.27.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            How do I import an existing MySQL database into an NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      You can import databases into NDB Cluster much as you would with any other version of MySQL. Other than the limitations mentioned elsewhere in this FAQ, the only other special requirement is that any tables to be included in the cluster must use the [`NDB`](mysql-cluster.html) storage engine. This means that the tables must be created with `ENGINE=NDB` or `ENGINE=NDBCLUSTER`.<br/><br/> It is also possible to convert existing tables that use other storage engines to [`NDBCLUSTER`](mysql-cluster.html) using one or more [`ALTER TABLE`](alter-table.html) statement. However, the definition of the table must be compatible with the [`NDBCLUSTER`](mysql-cluster.html) storage engine prior to making the conversion. In MySQL 8.0, an additional workaround is also required; see [Section 23.2.7, “Known Limitations of NDB Cluster”](mysql-cluster-limitations.html), for details.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
|[]()[]()<br/><br/>**A.10.28.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                How do NDB Cluster nodes communicate with one another?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                Cluster nodes can communicate through any of three different transport mechanisms: TCP/IP, SHM (shared memory), and SCI (Scalable Coherent Interface). Where available, SHM is used by default between nodes residing on the same cluster host; however, this is considered experimental. SCI is a high-speed (1 gigabit per second and higher), high-availability protocol used in building scalable multi-processor systems; it requires special hardware and drivers. See [Section 23.4.4, “Using High-Speed Interconnects with NDB Cluster”](mysql-cluster-interconnects.html), for more about using SCI as a transport mechanism for NDB Cluster.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|[]()[]()<br/><br/>**A.10.29.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                What is an arbitrator?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       If one or more data nodes in a cluster fail, it is possible that not all cluster data nodes are able to “see” one another. In fact, it is possible that two sets of data nodes might become isolated from one another in a network partitioning, also known as a “split-brain” scenario. This type of situation is undesirable because each set of data nodes tries to behave as though it is the entire cluster. An arbitrator is required to decide between the competing sets of data nodes.<br/><br/> When all data nodes in at least one node group are alive, network partitioning is not an issue, because no single subset of the cluster can form a functional cluster on its own. The real problem arises when no single node group has all its nodes alive, in which case network partitioning (the “split-brain” scenario) becomes possible. Then an arbitrator is required. All cluster nodes recognize the same node as the arbitrator, which is normally the management server; however, it is possible to configure any of the MySQL Servers in the cluster to act as the arbitrator instead. The arbitrator accepts the first set of cluster nodes to contact it, and tells the remaining set to shut down. Arbitrator selection is controlled by the `ArbitrationRank` configuration parameter for MySQL Server and management server nodes. You can also use the `ArbitrationRank` configuration parameter to control the arbitrator selection process. For more information about these parameters, see [Section 23.4.3.5, “Defining an NDB Cluster Management Server”](mysql-cluster-mgm-definition.html).<br/><br/> The role of arbitrator does not in and of itself impose any heavy demands upon the host so designated, and thus the arbitrator host does not need to be particularly fast or to have extra memory especially for this purpose.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
|[]()[]()<br/><br/>**A.10.30.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     What data types are supported by NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  NDB Cluster supports all of the usual MySQL data types, including those associated with MySQL's spatial extensions; however, the [`NDB`](mysql-cluster.html) storage engine does not support spatial indexes. (Spatial indexes are supported only by [`MyISAM`](myisam-storage-engine.html); see [Section 11.4, “Spatial Data Types”](spatial-types.html), for more information.) In addition, there are some differences with regard to indexes when used with [`NDB`](mysql-cluster.html) tables.<br/><br/>Note<br/><br/> NDB Cluster Disk Data tables (that is, tables created with `TABLESPACE ... STORAGE DISK ENGINE=NDB` or `TABLESPACE ... STORAGE DISK ENGINE=NDBCLUSTER`) have only fixed-width rows. This means that (for example) each Disk Data table record containing a [`VARCHAR(255)`](char.html) column requires space for 255 characters (as required for the character set and collation being used for the table), regardless of the actual number of characters stored therein.<br/><br/> See [Section 23.2.7, “Known Limitations of NDB Cluster”](mysql-cluster-limitations.html), for more information about these issues.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
|[]()[]()<br/><br/>**A.10.31.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         How do I start and stop NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
|                              |                                                                                                                                                                                                                                                                                                                                           It is necessary to start each node in the cluster separately, in the following order:<br/><br/>1. Start the management node, using the [**ndb\_mgmd**](mysql-cluster-programs-ndb-mgmd.html) command.<br/><br/>    You must include the [`-f`](mysql-cluster-programs-ndb-mgmd.html#option_ndb_mgmd_config-file) or [`--config-file`](mysql-cluster-programs-ndb-mgmd.html#option_ndb_mgmd_config-file) option to tell the management node where its configuration file can be found.<br/><br/>2. Start each data node with the [**ndbd**](mysql-cluster-programs-ndbd.html) command.<br/><br/>    Each data node must be started with the [`-c`](mysql-cluster-programs-ndbd.html#option_ndbd_ndb-connectstring) or [`--ndb-connectstring`](mysql-cluster-programs-ndbd.html#option_ndbd_ndb-connectstring) option so that the data node knows how to connect to the management server.<br/><br/>3. Start each MySQL Server (SQL node) using your preferred startup script, such as [**mysqld\_safe**](mysqld-safe.html).<br/><br/>    Each MySQL Server must be started with the [`--ndbcluster`](mysql-cluster-options-variables.html#option_mysqld_ndbcluster) and [`--ndb-connectstring`](mysql-cluster-options-variables.html#option_mysqld_ndb-connectstring) options. These options cause [**mysqld**](mysqld.html) to enable [`NDBCLUSTER`](mysql-cluster.html) storage engine support and how to connect to the management server.<br/><br/> Each of these commands must be run from a system shell on the machine housing the affected node. (You do not have to be physically present at the machine—a remote login shell can be used for this purpose.) You can verify that the cluster is running by starting the [`NDB`](mysql-cluster.html) management client [**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html) on the machine housing the management node and issuing the `SHOW` or `ALL STATUS` command.<br/><br/> To shut down a running cluster, issue the command `SHUTDOWN` in the management client. Alternatively, you may enter the following command in a system shell:<br/><br/>```<br/>$> ndb_mgm -e "SHUTDOWN"<br/>```<br/><br/> (The quotation marks in this example are optional, since there are no spaces in the command string following the `-e` option; in addition, the `SHUTDOWN` command, like other management client commands, is not case-sensitive.)<br/><br/> Either of these commands causes the [**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html), [**ndb\_mgm**](mysql-cluster-programs-ndb-mgm.html), and any [**ndbd**](mysql-cluster-programs-ndbd.html) processes to terminate gracefully. MySQL servers running as SQL nodes can be stopped using [**mysqladmin shutdown**](mysqladmin.html).<br/><br/> For more information, see [Section 23.6.1, “Commands in the NDB Cluster Management Client”](mysql-cluster-mgm-client-commands.html), and [Section 23.3.6, “Safe Shutdown and Restart of NDB Cluster”](mysql-cluster-install-shutdown-restart.html).<br/><br/> MySQL Cluster Manager and the NDB Cluster Auto-Installer provide additional ways to handle starting ansd stopping of NDB Cluster nodes. See [MySQL Cluster Manager 1.4.8 User Manual](https://dev.mysql.com/doc/mysql-cluster-manager/1.4/en/), and [Section 23.3.8, “The NDB Cluster Auto-Installer (No longer supported)”](mysql-cluster-installer.html), for more information about these tools.                                                                                                                                                                                                                                                                                                                                          |
|[]()[]()<br/><br/>**A.10.32.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          What happens to NDB Cluster data when the NDB Cluster is shut down?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                The data that was held in memory by the cluster's data nodes is written to disk, and is reloaded into memory the next time that the cluster is started.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.33.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      Is it a good idea to have more than one management node for an NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 It can be helpful as a fail-safe. Only one management node controls the cluster at any given time, but it is possible to configure one management node as primary, and one or more additional management nodes to take over in the event that the primary management node fails.<br/><br/> See [Section 23.4.3, “NDB Cluster Configuration Files”](mysql-cluster-config-file.html), for information on how to configure NDB Cluster management nodes.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|[]()[]()<br/><br/>**A.10.34.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    Can I mix different kinds of hardware and operating systems in one NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   Yes, as long as all machines and operating systems have the same “endianness” (all big-endian or all little-endian).<br/><br/> It is also possible to use software from different NDB Cluster releases on different nodes. However, we support such use only as part of a rolling upgrade procedure (see [Section 23.6.5, “Performing a Rolling Restart of an NDB Cluster”](mysql-cluster-rolling-restart.html)).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
|[]()[]()<br/><br/>**A.10.35.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               Can I run two data nodes on a single host? Two SQL nodes?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    Yes, it is possible to do this. In the case of multiple data nodes, it is advisable (but not required) for each node to use a different data directory. If you want to run multiple SQL nodes on one machine, each instance of [**mysqld**](mysqld.html) must use a different TCP/IP port.<br/><br/> Running data nodes and SQL nodes together on the same host is possible, but you should be aware that the [**ndbd**](mysql-cluster-programs-ndbd.html) or [**ndbmtd**](mysql-cluster-programs-ndbmtd.html) processes may compete for memory with [**mysqld**](mysqld.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|[]()[]()<br/><br/>**A.10.36.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        Can I use host names with NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                Yes, it is possible to use DNS and DHCP for cluster hosts. However, if your application requires “five nines” availability, you should use fixed (numeric) IP addresses, since making communication between Cluster hosts dependent on services such as DNS and DHCP introduces additional potential points of failure.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.37.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            Does NDB Cluster support IPv6?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               IPv6 is supported for connections between SQL nodes (MySQL servers), but connections between all other types of NDB Cluster nodes must use IPv4.<br/><br/> In practical terms, this means that you can use IPv6 for replication between NDB Clusters, but connections between nodes in the same NDB Cluster must use IPv4. For more information, see [Section 23.7.3, “Known Issues in NDB Cluster Replication”](mysql-cluster-replication-issues.html).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
|[]()[]()<br/><br/>**A.10.38.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     How do I handle MySQL users in an NDB Cluster having multiple MySQL servers?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       MySQL user accounts and privileges are normally not automatically propagated between different MySQL servers accessing the same NDB Cluster. MySQL NDB Cluster provides support for shared and synchronized users and privileges using the [`NDB_STORED_USER`](privileges-provided.html#priv_ndb-stored-user) privilege; see [Distributed Privileges Using Shared Grant Tables](https://dev.mysql.com/doc/refman/5.7/en/mysql-cluster-privilege-distribution.html), for more information. You should be aware that this implementation is new to NDB 8.0 and is not compatible with the shared privileges mechanism employed in earlier versions of NDB Cluster, which is no longer supported in NDB 8.0.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      |
|[]()[]()<br/><br/>**A.10.39.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    How do I continue to send queries in the event that one of the SQL nodes fails?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 MySQL NDB Cluster does not provide any sort of automatic failover between SQL nodes. Your application must be prepared to handle the loss of SQL nodes and to fail over between them.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
|[]()[]()<br/><br/>**A.10.40.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     How do I back up and restore an NDB Cluster?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            You can use the NDB Cluster native backup and restore functionality in the NDB management client and the [**ndb\_restore**](mysql-cluster-programs-ndb-restore.html) program. See [Section 23.6.8, “Online Backup of NDB Cluster”](mysql-cluster-backup.html), and [Section 23.5.23, “ndb\_restore — Restore an NDB Cluster Backup”](mysql-cluster-programs-ndb-restore.html).<br/><br/> You can also use the traditional functionality provided for this purpose in [**mysqldump**](mysqldump.html) and the MySQL server. See [Section 4.5.4, “mysqldump — A Database Backup Program”](mysqldump.html), for more information.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
|[]()[]()<br/><br/>**A.10.41.**|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              What is an “angel process”?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
|                              |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          This process monitors and, if necessary, attempts to restart the data node process. If you check the list of active processes on your system after starting [**ndbd**](mysql-cluster-programs-ndbd.html), you can see that there are actually 2 processes running by that name, as shown here (we omit the output from [**ndb\_mgmd**](mysql-cluster-programs-ndb-mgmd.html) and [**ndbd**](mysql-cluster-programs-ndbd.html) for brevity):<br/><br/>```<br/>$> ./ndb_mgmd<br/><br/>$> ps aux | grep ndb<br/>me      23002  0.0  0.0 122948  3104 ?        Ssl  14:14   0:00 ./ndb_mgmd<br/>me      23025  0.0  0.0   5284   820 pts/2    S+   14:14   0:00 grep ndb<br/><br/>$> ./ndbd -c 127.0.0.1 --initial<br/><br/>$> ps aux | grep ndb<br/>me      23002  0.0  0.0 123080  3356 ?        Ssl  14:14   0:00 ./ndb_mgmd<br/>me      23096  0.0  0.0  35876  2036 ?        Ss   14:14   0:00 ./ndbmtd -c 127.0.0.1 --initial<br/>me      23097  1.0  2.4 524116 91096 ?        Sl   14:14   0:00 ./ndbmtd -c 127.0.0.1 --initial<br/>me      23168  0.0  0.0   5284   812 pts/2    R+   14:15   0:00 grep ndb<br/>```<br/><br/> The [**ndbd**](mysql-cluster-programs-ndbd.html) process showing `0.0` for both memory and CPU usage is the angel process (although it actually does use a very small amount of each). This process merely checks to see if the main [**ndbd**](mysql-cluster-programs-ndbd.html) or [**ndbmtd**](mysql-cluster-programs-ndbmtd.html) process (the primary data node process which actually handles the data) is running. If permitted to do so (for example, if the [`StopOnError`](mysql-cluster-ndbd-definition.html#ndbparam-ndbd-stoponerror) configuration parameter is set to `false`), the angel process tries to restart the primary data node process.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |

