Create Elasticsearch Data Source

NineData supports adding various types and environments of data sources to the console for unified management. You can use database DevOps, backup and recovery, data replication, and database comparison features for data sources that have been added. This article introduces how to add an Elasticsearch source to NineData.

Prerequisites

• The server IP address of NineData has been added to the data source allowlist. Please refer to the image below for instructions on how to obtain the server IP address.

  

• Make sure you have available data source quota; otherwise, the data source cannot be added. You can quickly check your remaining quota at the top-right corner of the NineData console.

Operation Steps

1. Log in to the NineData Console.

2. On the left navigation pane, click > .

3. Click  tab, and click  on the page. In the popup window for selecting the data source type, choose > (the type of data source to be added), and configure the parameters based on the table below on the page.
   tip

   If you make a mistake during the operation, you can click the icon at the top of the page to make a new selection.

4. Configure the parameters of the data source:

   Parameter	Description
   	Enter the name of the data source. To facilitate subsequent search and management, please use a meaningful name.
   	Select the access method of the data source. Supports access through , , SSH Tunnel three methods. : Access the data source through a public network address. : A secure and fast intranet access method provided by NineData, which requires the host where the data source is located to be connected first. For connection methods, please refer to Add Gateway. SSH Tunnel: Access the data source through an SSH tunnel.
   Select configuration items	: The public network connection address and port of the data source.
   Select configuration items	: Select the NineData gateway installed on the host where the data source is located. : Can be written as localhost (the data source is on this machine) or the intranet IP of the host where the data source is located.
   Select SSH Tunnel configuration items	: Enter the public IP or domain name of the server where the target data source is located, and the corresponding port number (the default port number for SSH service is 22). : Select the SSH authentication method. : Connect through (i.e., the server's login name) and (i.e., the server's login password). : Enter the login username of the server where the target data source is located. : Enter the login password of the server where the target data source is located. (recommended): Connect through and . : Enter the login username of the server where the target data source is located. : Click to upload the private key file, which is a key file without a suffix. If you have not created one yet, please refer to Generate SSH Tunnel Key File. : Enter the password set when the key file was generated. If you did not set a password during the key generation process, leave this field blank. Note: After the SSH configuration is completed, you need to click on the on the right, and there may be the following two results: Prompt : Indicates that the SSH Tunnel has been established. Prompt error message: Indicates a connection failure, you need to troubleshoot the cause of the error and retry. : Can be written as localhost (the data source is on this machine) or the intranet IP of the host where the data source is located.
   	The username of the data source.
   	The password of the data source.
   	Select the region closest to your data source location to effectively reduce network latency.
   	Choose according to the actual business purpose of the data source, as an environmental identifier of the data source. Default provides and environments, and supports you to create a custom environment. Note: Under the organization mode, the database environment can also be applied to permission policy management, for example, the default role only supports access to data sources in the environment and cannot access data sources in other environments. For more information, please refer to Manage Roles.
   	Whether to use SSL encryption to access the data source (default off). If the data source enforces SSL encrypted connections, this switch must be turned on, otherwise, the connection will fail. Click the switch on the right to turn on or off encrypted transmission. Click the > to the left of to expand detailed configuration, and then click to upload the CA Cert certificate. For more SSL configuration methods, please refer to the official documentation: Configure Elasticsearch Encrypted Connections.

5. After all configurations are completed, click on the next to to test whether the data source can be accessed normally. If prompted with , you can click to complete the addition of the data source. Otherwise, please recheck the connection settings until the connection test is successful.

Appendix: Add NineData's IP Address to the Elasticsearch Database Whitelist

When adding a data source located in , you need to add NineData's service IP address to the Elasticsearch database whitelist to allow NineData to provide services.

This section takes Elasticsearch version 7.17 as an example to provide a method for adding IP whitelists. This method is applicable to Elasticsearch 5.x, 6.x, and 7.x versions.

1. Open the Elasticsearch configuration file elasticsearch.yml with a text editor. This file is usually located in the config subdirectory of the Elasticsearch installation directory.

2. Find the network.host parameter and configure its value to the IP address or address range that needs to be allowed to access, with multiple IP addresses or address ranges separated by English commas (,).

   Example:

   network.host: 121.199.39.25, 123.57.58.208

3. Save the configuration file.