From 7d1eb3c001498609dd05bb60fbf4033d38ef9523 Mon Sep 17 00:00:00 2001 From: Mel Kiyama Date: Thu, 12 Jul 2018 16:03:23 -0700 Subject: [PATCH] docs - gpbackup S3 plugin support for S3 compatible data stores. (#5233) * docs - gpbackup S3 plugin - support for S3 compatible data stores. Link to HTML format on GPDB docs review site. http://docs-gpdb-review-staging.cfapps.io/review/admin_guide/managing/backup-s3-plugin.html * docs - gpbackup S3 plugin - review comment updates * docs - gpbackup S3 plugin - Add OSS/Pivotal support information. * docs - gpbackup S3 plugin - fix typos. * docs - gpbackup S3 plugin - updated information about S3 compatible data stores. --- .../admin_guide/managing/backup-s3-plugin.xml | 54 ++++++++++++++----- 1 file changed, 40 insertions(+), 14 deletions(-) diff --git a/gpdb-doc/dita/admin_guide/managing/backup-s3-plugin.xml b/gpdb-doc/dita/admin_guide/managing/backup-s3-plugin.xml index dee16662de..79442df7fb 100644 --- a/gpdb-doc/dita/admin_guide/managing/backup-s3-plugin.xml +++ b/gpdb-doc/dita/admin_guide/managing/backup-s3-plugin.xml @@ -13,22 +13,26 @@ gprestore. Amazon S3 provides secure, durable, highly-scalable object storage.

-

To use the S3 storage plugin application, you specify the location of the plugin and the - Amazon Web Services (AWS) login and backup location in a configuration file. When you run - gpbackup or gprestore, you specify the configuration file - with the option --plugin-config. For information about the configuration - file, see .

+

The S3 storage plugin can also connect to an Amazon S3 compatible service such as Dell + EMC Elastic Cloud Storage (ECS) and Minio.

+

To use the S3 storage plugin application, you specify the location of the plugin and the S3 + login and backup location in a configuration file. When you run gpbackup or + gprestore, you specify the configuration file with the option + --plugin-config. For information about the configuration file, see .

If you perform a backup operation with the gpbackup option --plugin-config, you must also specify the --plugin-config option when you restore the backup with gprestore.

S3 Storage Plugin Configuration File Format

The configuration file specifies the absolute path to the Greenplum Database S3 storage - plugin executable, AWS connection credentials, and S3 location.

+ plugin executable, connection credentials, and S3 location.

The S3 storage plugin configuration file uses the YAML 1.1 document format and implements its own - schema for specifying the location of the Greenplum Database S3 storage plugin, AWS - connection credentials, and S3 location and login information.

+ schema for specifying the location of the Greenplum Database S3 storage plugin, connection + credentials, and S3 location and login information.

The configuration file must be a valid YAML document. The gpbackup and gprestore utilities process the control file document in order and use indentation (spaces) to determine the document hierarchy and the relationships of the @@ -38,10 +42,12 @@ executablepath: <absolute-path-to-gpbackup_s3_plugin> options: region: <aws-region> + endpoint: <S3-endpoint> aws_access_key_id: <aws-user-id> aws_secret_access_key: <aws-user-id-key> bucket: <s3-bucket> - folder: <s3-location> + folder: <s3-location> + encryption: [on|off] executablepath @@ -54,27 +60,47 @@ Required. Begins the S3 storage plugin options section. region - Required. The AWS region. + Required for AWS S3. If connecting to an S3 compatible service, this option is + not required. + + + endpoint + Required for an S3 compatible service. Specify this option to connect to an S3 + compatible service such as ECS. The plugin connects to the specified S3 endpoint + (hostname or IP address) to access the S3 compatible data store. + If this option is specified, the plugin ignores the region + option and does not use AWS to resolve the endpoint. When this option is not + specified, the plugin uses the region to determine AWS S3 + endpoint. aws_access_key_id - Required. The AWS S3 ID to access the S3 bucket location that stores backup + Required. The S3 ID to access the S3 bucket location that stores backup files. aws_secret_access_key - Required. AWS S3 passcode for the S3 ID to access the S3 bucket location. + Required. S3 passcode for the S3 ID to access the S3 bucket location. bucket - Required. The name of the S3 bucket in the AWS region. The bucket must exist. - + Required. The name of the S3 bucket in the AWS region or S3 compatible data + store. The bucket must exist. folder Required. The S3 location for backups. During a backup operation, the plugin creates the S3 location if it does not exist in the S3 bucket. + + encryption + Optional. Enable or disable use of Secure Sockets Layer (SSL) when connecting to + an S3 location. Default value is on, use connections that are + secured with SSL. Set this option to off to connect to an S3 + compatible service that is not configured to use SSL. + Any value other than off is treated as on. + + -- GitLab