Manage datasources
NineData supports adding data sources of various types in multiple environments with unified management console, providing Database DevOps, backup and recovery, data replication, database comparison and other functions for the data sources.
Prerequisite
Supported cloud vendors: Alibaba Cloud, Tencent Cloud, Huawei Cloud, AWS, China Mobile Cloud, Baidu Cloud
Supported data source: MySQL, SQL Server, PostgreSQL, KingBase, Oracle, Dameng, OceanBase Oracle, OceanBase MySQL, DB2, Redis, ClickHouse, MongoDB, Kafka, Elasticsearch, Doris, SelectDB, Greenplum, Redshift (AWS instance), GaussDB (Huawei Cloud Instance), DWS (Huawei Cloud Instance), openGauss, StarRocks, SingleStore, Sybase, TiDB, Hive, AnalyticDB for PostgreSQL (Alibaba Cloud Instance), GreatSQL, GBase, GaiaDB (Baidu Cloud Instance), GaiaDB-X (Baidu Cloud Instance), TDSQL (Tencent Cloud Instance)
To ensure smooth connectivity of the service, please first select the option on the page. Then, add the NineData service IP address located at the position in the diagram below to the allowlist of your server. For instructions on how to add a allowlist in a self-built database in the IDC, refer to Appendix 2. For adding a allowlist in cloud provider servers or databases, please refer to the official documentation of each respective cloud provider.
Please make sure you still have available data source quota, otherwise, you won't be able to input a new data source. You can quickly check the remaining quota on the NineData console page in the upper right corner.
Adding Self-Built Data Source
Log in to the NineData Console.
On the left navigation pane, click > .
- Click tab, and click on the page. In the popup window for selecting the data source type, choose > (the type of data source to be added), and configure the parameters based on the table below on the page.tip
If you make a mistake during the operation, you can click the icon at the top of the page to make a new selection.
Relational Databases
- MySQL
- SQL Server
- PostgreSQL
- Oracle
- OceanBase Oracle
- obmysql
- DB2
- DaMeng
- KingBase
- openGauss
- greatsql
- gbase
Parameter | Description |
---|---|
Enter a name for the data source to facilitate future searching and management. | |
Choose the connection method for the data source. Options include , , and SSH Tunnel.
| |
Configuration under for | : Enter the public network connection address and port of the data source. |
Configuration under for |
|
Configuration under for SSH Tunnel |
|
Choose the deployment architecture of MySQL.
| |
Username for the data source. | |
Password for the data source. | |
Choose the region closest to the location of your data source to reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to access the data source using SSL encryption (default enabled). If the data source enforces SSL encrypted connection, this switch must be turned on, otherwise the connection will fail. Click on the switch on the right to enable or disable encrypted transmission. Click on the > on the left of to expand detailed configurations.
|
Parameter | Description |
---|---|
Enter the name of the data source for easy identification and management. Use meaningful names whenever possible. | |
Select the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration when is set to | : Public connection address and port of the data source. |
Configuration when is set to |
|
Configuration when is set to SSH Tunnel |
|
Username for the data source. | |
Password for the data source. | |
Select the region closest to the location of your data source to effectively reduce network latency. | |
Select based on the actual business purpose of the data source as an environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, the database environment can also be applied to role-based access control. For example, the default role only supports access to data sources in the environment and cannot access data sources in other environments. For more information, see Manage Roles. | |
Whether to use SSL encryption when accessing the data source (default is on). If the data source requires SSL encryption, this switch must be turned on, or the connection will fail. Click the switch on the right to turn encryption transmission on or off. Click the > on the left of to expand detailed configurations.
|
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Public connection address and port of the data source. |
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Enter the PostgreSQL login username. | |
Enter the PostgreSQL login password. | |
Choose the region closest to the location of your PostgreSQL host to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to use SSL encryption for accessing the data source (default off). If the data source requires SSL encryption, you must enable this switch, otherwise the connection will fail. Click the switch on the right to turn encryption on or off. Click the > on the left of to expand detailed configuration.
|
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Public connection address, port, and SIDUsed to uniquely identify a specific Oracle database instance. (Service NameA logical identifier for identifying and accessing Oracle database instances, associated with a specific SID. By configuring different Service Names, multiple logical identifiers can be associated with the same database instance.). |
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Enter the Oracle login username. | |
Enter the Oracle login password. | |
Select the role to use after logging in to Oracle.
| |
Choose the region closest to the location of your Oracle host to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
The name of the input data source for easy identification and management. Please use meaningful names whenever possible. | |
Choose the data source's access method. It supports two methods: through or .
| |
Configuration options for selecting | : Public network connection address and port of the data source. |
Configuration options for selecting |
|
Enter the login username for OceanBase Oracle. | |
Enter the login password for OceanBase Oracle. | |
Choose the region closest to the location of your OceanBase Oracle host to reduce network latency effectively. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Enter the public connection address and port number of the data source. |
Configuration options for | : Choose the NineData gateway installed on the host where the data source resides. : Can be set as localhost (data source is on the local machine) or the intranet IP of the data source's host. |
Configuration options for SSH Tunnel |
|
Data source username. | |
Data source password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to access the data source using SSL encryption (default enabled). If the data source enforces SSL encrypted connection, this switch must be turned on, otherwise the connection will fail. Click on the switch on the right to enable or disable encrypted transmission. Click on the > on the left of to expand detailed configurations.
|
Parameter | Description |
---|---|
Enter the name of the data source for easy identification and management. Please use a meaningful name. | |
Select the access method for the data source. Supports three options: , , and SSH Tunnel.
| |
Configuration for | : Public connection address and port of the data source. |
DATABASE | Specify the name of the database to connect to. |
Configuration for Selection of |
|
Configuration for Selection of SSH Tunnel |
|
Enter the login username for DB2. | |
Enter the login password for DB2. | |
Select the region closest to the location of your DB2 host to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter a name for the data source to facilitate future searching and management. | |
Choose the connection method for the data source. Options include , , and SSH Tunnel.
| |
Configuration under for | : Enter the public network connection address and port of the data source. |
Configuration under for |
|
Configuration under for SSH Tunnel |
|
Username for the data source. | |
Password for the data source. | |
Choose the region closest to the location of your data source to reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter a name for the data source to facilitate future searching and management. | |
Choose the connection method for the data source. Options include , , and SSH Tunnel.
| |
Configuration under for | : Enter the public network connection address and port of the data source. |
Configuration under for |
|
Configuration under for SSH Tunnel |
|
Username for the data source. | |
Password for the data source. | |
Choose the region closest to the location of your data source to reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter a name for the data source to facilitate future searching and management. | |
Choose the connection method for the data source. Options include , , and SSH Tunnel.
| |
Configuration under for | : Enter the public network connection address and port of the data source. |
Configuration under for |
|
Configuration under for SSH Tunnel |
|
Username for the data source. | |
Password for the data source. | |
Choose the region closest to the location of your data source to reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter the name of the data source. To facilitate subsequent searching and management, please use a meaningful name. | |
Choose the method to connect to the data source. Three methods are supported: , , and SSH Tunnel.
| |
Configuration options for when selecting | : The public connection address and port of the data source. |
Configuration options for when selecting |
|
Configuration options for when selecting SSH Tunnel |
|
Choose the deployment architecture of the data source.
| |
The username of the data source. | |
The password of the data source. | |
Choose the region closest to your data source location to effectively reduce network latency. | |
Select based on the actual business use of this data source as the environment identifier of the data source. The default environments provided are and , and it also supports you creating a custom environment. Note: In Organization Mode, the database environment can also be used for permission policy management. For example, the default role can only access data sources in the environment and cannot access data sources in other environments. For more information, see Manage Roles. | |
Whether to use SSL encryption to access the data source (enabled by default). If the data source enforces SSL encrypted connections, this switch must be turned on, otherwise the connection will fail. Click the switch on the right to enable or disable encrypted transmission. Click the > to the left of to expand detailed configurations.
|
Parameter | Description |
---|---|
Enter the name of the data source. To facilitate subsequent searching and management, please use a meaningful name. | |
Choose the method to connect to the data source. Three methods are supported: , , and SSH Tunnel.
| |
Configuration options for when selecting | : The public connection address and port of the data source. |
Configuration options for when selecting |
|
Configuration options for when selecting SSH Tunnel |
|
Choose the deployment architecture of the data source.
| |
The username of the data source. | |
The password of the data source. | |
Choose the region closest to your data source location to effectively reduce network latency. | |
Select based on the actual business use of this data source as the environment identifier of the data source. The default environments provided are and , and it also supports you creating a custom environment. Note: In Organization Mode, the database environment can also be used for permission policy management. For example, the default role can only access data sources in the environment and cannot access data sources in other environments. For more information, see Manage Roles. | |
Whether to use SSL encryption to access the data source (enabled by default). If the data source enforces SSL encrypted connections, this switch must be turned on, otherwise the connection will fail. Click the switch on the right to enable or disable encrypted transmission. Click the > to the left of to expand detailed configurations.
|
NoSQL Databases
- Redis
- MongoDB
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Select the deployment type of your Redis database.
| |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for |
|
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Username of the data source. For some older versions of instances from certain cloud providers, there may be authentication issues. If you have confirmed that the account password is correct but still receive authentication failures, please leave this field blank. Instead, try entering the username and password in the <username>@<password> or <username>:<password> format (formats may vary for different cloud providers) in the field. For example: example_user@abcdefg or example_user:abcdefg . | |
Password of the data source. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to use SSL encryption when accessing the data source (default is off). If the data source requires a mandatory SSL encrypted connection, this switch must be turned on; otherwise, the connection will fail. Click the switch on the right to enable or disable encrypted transmission. Click the > on the left of to expand detailed configurations.
|
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Select the deployment architecture of your MongoDB data source. Three architectures are supported:
| |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Public connection address and port of the data source. |
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Choose the deployment architecture type of MongoDB.
| |
Read Preference | is optional when is set. Configure which node to distribute read traffic to.
|
The authentication database name your account belongs to, default is admin . | |
Username of the data source. | |
Password of the data source. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to use SSL encryption to access the data source. If the data source enforces SSL encryption, you must enable this switch, otherwise the connection will fail. Refer to the official documentation for SSL configuration: Configure MongoDB SSL Connection. |
Data Warehouse
- ClickHouse
- Doris
- SelectDB
- Greenplum
- StarRocks
- SingleStore
- Hive
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Public connection address and port of the data source. |
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Username of the data source. | |
Password of the data source. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to use SSL encryption to access the data source. If the data source enforces SSL encryption, you must enable this switch, otherwise the connection will fail. Refer to the official documentation for SSL configuration: Configure ClickHouse SSL Connection. |
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Enter the public connection address and port number of the data source. |
Configuration options for | : Choose the NineData gateway installed on the host where the data source resides. : Can be set as localhost (data source is on the local machine) or the intranet IP of the data source's host. |
Configuration options for SSH Tunnel |
|
Data source username. | |
Data source password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Enter the public connection address and port number of the data source. |
Configuration options for | : Choose the NineData gateway installed on the host where the data source resides. : Can be set as localhost (data source is on the local machine) or the intranet IP of the data source's host. |
Configuration options for SSH Tunnel |
|
Data source username. | |
Data source password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Enter the public connection address and port number of the data source. |
Configuration options for | : Choose the NineData gateway installed on the host where the data source resides. : Can be set as localhost (data source is on the local machine) or the intranet IP of the data source's host. |
Configuration options for SSH Tunnel |
|
Data source username. | |
Data source password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Enter the public connection address and port number of the data source. |
Configuration options for | : Choose the NineData gateway installed on the host where the data source resides. : Can be set as localhost (data source is on the local machine) or the intranet IP of the data source's host. |
Configuration options for SSH Tunnel |
|
Data source username. | |
Data source password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter a name for the data source to facilitate future searching and management. | |
Choose the connection method for the data source. Options include , , and SSH Tunnel.
| |
Configuration under for | : Enter the public network connection address and port of the data source. |
Configuration under for |
|
Configuration under for SSH Tunnel |
|
Username for the data source. | |
Password for the data source. | |
Choose the region closest to the location of your data source to reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. |
Parameter | Description |
---|---|
Enter the name of the data source for easy identification and management. Please use meaningful names whenever possible. | |
Choose the connection method for the data source. Supports three methods:
| |
Configuration when selecting for | : The public connection address and port of the data source. Clicking on will display the section, where you can enter HDFS connection information. Once entered, data interaction between NineData and Hive will bypass Hive, greatly improving data exchange rates. |
Configuration when selecting for |
|
Configuration when selecting SSH Tunnel for |
|
Choose the authentication method for connecting to Hive.
| |
Choose the region closest to your data source to effectively reduce network latency. | |
Choose the environment identifier for the data source based on its actual business purpose. Default options include and . You can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports access to data sources in the environment and cannot access data sources in other environments. For more information, see Managing Roles. |
Other Databases
- Kafka
- Elasticsearch
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | Broker List: Kafka cluster composed of multiple broker connection addresses. Each broker is an independent Kafka server instance. Enter the public connection address and port number of the Kafka data source below. If there are multiple brokers, click to continue filling in. |
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Choose the authentication mode for Kafka.
| |
Kafka username. | |
Kafka password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Whether to access the data source using SSL encryption (default off). If the data source enforces SSL encrypted connections, this switch must be turned on, otherwise the connection will fail. Click on the > on the left of to expand the detailed configuration:
|
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access method for the data source. Supports three methods: , , and SSH Tunnel.
| |
Configuration options for | : Enter the public connection address and port number of the data source. |
Configuration options for |
|
Configuration options for SSH Tunnel |
|
Data source username. | |
Data source password. | |
Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to use SSL encryption for accessing the data source (default: off). If the data source requires SSL encryption, you must enable this option, otherwise the connection will fail. Click the switch on the right to toggle encryption on or off. Click on the left of to expand detailed configuration, then click to upload the CA Cert certificate. For more SSL configuration methods, refer to the official documentation: Configure Elasticsearch encrypted connections. |
- Once all configurations are complete, click the button on the right side of to test whether the data source can be accessed properly. If the prompt shows , click to finish adding the data source. If not, please review the connection settings until the connection test succeeds.
Add cloud vendor data source
Log in to the NineData Console.
On the left navigation pane, click > .
- Click tab, and click on the page. In the popup window for selecting the data source type, choose (Cloud provider name) > (the type of data source to be added), and configure the parameters based on the table below on the page.tip
If you make a mistake during the operation, you can click the icon at the top of the page to make a new selection.
- Alibabacloud
- Tencent Cloud
- HUAWEI Cloud
- AWS
- E Cloud
- Baidu Cloud
Supported database types include:
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access mode for the data source.
| |
Choose the access method for Alibaba Cloud instances. Supports access via or .
| |
When the data source is MongoDB, it is necessary to input and specify the authentication database for the current user. | |
Data source username. | |
Data source password. | |
Only required when accessing via connection address. Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to use SSL encryption for accessing the data source. If the data source requires SSL encryption, you must enable this option, otherwise the connection will fail. Click the switch on the right to toggle encryption on or off. For some data source types, click on the left of to expand detailed configuration. Note: Different data source types support different options, please refer to the console for accurate options. |
Supported database types include:
- TDSQL MySQL
- TDSQL PostgreSQL
- Elasticsearch Service
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access mode for the data source.
| |
Choose the access method for Tencent Cloud instances. Supports access via or .
| |
When the data source is MongoDB, it is necessary to input and specify the authentication database for the current user. | |
Data source username. | |
Data source password. | |
Only required when accessing via connection address. Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to use SSL encryption for accessing the data source. If the data source requires SSL encryption, you must enable this option, otherwise the connection will fail. Click the switch on the right to toggle encryption on or off. For some data source types, click on the left of to expand detailed configuration. Note: Different data source types support different options, please refer to the console for accurate options. |
Supported database types include:
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access mode for the data source.
| |
Choose the access method for Huawei Cloud instances. Supports access via or .
| |
When the data source is MongoDB, it is necessary to input and specify the authentication database for the current user. | |
Data source username. | |
Data source password. | |
Only required when accessing via connection address. Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to use SSL encryption for accessing the data source. If the data source requires SSL encryption, you must enable this option, otherwise the connection will fail. Click the switch on the right to toggle encryption on or off. For some data source types, click on the left of to expand detailed configuration. Note: Different data source types support different options, please refer to the console for accurate options. |
Supported database types include:
- RDS MySQL
- Aurora MySQL
- DocumentDB
- MemoryDB for Redis
- Redshift
Parameter | Description |
---|---|
Enter the name of the input data source. Please use a meaningful name for easy future lookup and management. | |
Choose the access mode for the data source.
| |
Choose the access method for AWS instances. Supports access via or .
| |
When the data source is MongoDB or Redshift, it is necessary to input and specify the authentication database for the current user. | |
Data source username. | |
Data source password. | |
Only required when accessing via connection address. Choose the region closest to the location of your data source to effectively reduce network latency. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to use SSL encryption for accessing the data source. If the data source requires SSL encryption, you must enable this option, otherwise the connection will fail. Click the switch on the right to toggle encryption on or off. For some data source types, click on the left of to expand detailed configuration. Note: Different data source types support different options, please refer to the console for accurate options. |
Supported database types include:
- RDS for MySQL
- MongoDB
- Redis
Parameter | Description |
---|---|
Enter the name of the data source. Please use a meaningful name for easy lookup and management. | |
Choose the access mode for the data source.
| |
Choose the access mode for Mobile Cloud instances. Support accessing by or .
| |
When the data source is MongoDB, it is necessary to input and specify the authentication database for the current user. | |
Username of the data source. | |
Password of the data source. | |
Only select this when accessing the data source through the connection address. Choose the region closest to the location of your data source to reduce network latency effectively. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to access the data source using SSL encryption. If the data source requires an SSL encrypted connection, you must enable this switch; otherwise, the connection will fail. Click the switch on the right to enable or disable encrypted transmission. Some data source types allow you to click the > on the left of to expand detailed configuration. Note: Different data source types have different supported options. Please refer to the console for accurate information. |
Supported database types include:
- DocDB for MongoDB
Parameter | Description |
---|---|
Enter the name of the data source. Please use a meaningful name for easy lookup and management. | |
Choose the access mode for the data source.
| |
Choose the access mode for Baidu Cloud instances. Support accessing by or .
| |
When the data source is MongoDB, it is necessary to input and specify the authentication database for the current user. | |
Username of the data source. | |
Password of the data source. | |
Only select this when accessing the data source through the connection address. Choose the region closest to the location of your data source to reduce network latency effectively. | |
Select the actual business purpose of this data source as the environmental identifier. Default options include and , and you can also create custom environments. Note: In organization mode, database environments can also be applied to permission policy management. For example, the default role only supports accessing data sources in the environment and cannot access data sources in other environments. For more information, see manage roles. | |
Choose whether to access the data source using SSL encryption. If the data source requires an SSL encrypted connection, you must enable this switch; otherwise, the connection will fail. Click the switch on the right to enable or disable encrypted transmission. Some data source types allow you to click the > on the left of to expand detailed configuration. Note: Different data source types have different supported options. Please refer to the console for accurate information. |
- After completing all the configurations, you can click on the right side of and select to test if the data source can be accessed successfully. If you see indicating a successful connection test, you can then proceed to click on to finalize the addition of the data source. If the connection test does not succeed, please review your connection settings and keep testing until the connection is successfully established.
Appendix 1: Creating an Environment
To meet the needs of different enterprises, in addition to providing default and environments, NineData also supports manually creating custom environments.
Log in to the NineData Console.
In the left navigation bar, click >.
Click on the tab. This shows all the environments currently under the user (personal mode) or organization (organization mode). Here you can or custom created environments.
Click on in the upper right corner of the page.
Complete the configuration according to the following table and click .
Parameter Description Enter the name of the environment, which can contain 1 to 16 characters. This name serves as the identifier of the environment and needs to have some distinguishing characteristics. Please try to use meaningful names. Choose the color of the environment label displayed in the console.
Appendix 2: Add NineData's IP address to the database allowlist (self-built database environment)
When adding a data source located at , the IP address of the NineData service must be added to the database allowlist to allow NineData to provide services.
- MySQL
- Oracle
- PostgreSQL
- MongoDB
- Kafka
- SQL Server
- ClickHouse
- Redis
- ElasticSearch
This section takes MySQL 8.0 as an example to introduce how to add IP allowlist.
New account: Log in to the database using the Root account, and create an account for NineData to access and authorize the corresponding permissions with the following command.
CREATE USER '<account name>'@'<NineData IP address>' IDENTIFIED BY '<access password>';
GRANT <privilege name> ON <database name>.* TO '<account name>'@'<NineData IP address>';Existing account: Log in to the database using the Root account, and add NineData IP allowlist and grant corresponding permissions to the existing account with the following command.
GRANT <privilege name> ON <database name>.* TO '<account name>'@'<NineData IP address>' IDENTIFIED BY '<access password>';
When adding a MySQL data source, you need to use the account and corresponding password that have added NineData's IP address as mentioned above.
In this section, we provide the method to add an IP whitelist using Oracle 12 version as an example. This method is applicable to all versions of Oracle 10g and above.
Open the Oracle configuration file
sqlnet.ora
using a text editor. This file is typically located in the/network/admin/
directory within the Oracle installation directory. For example:/opt/oracle/product/OraHome/network/admin/sqlnet.ora
. If you can't locate this file, you can search for it using the commandfind / -name sqlnet.ora 2>/dev/null
in the terminal.Modify the parameters
tcp.validnode_checking
,tcp.invited_nodes
, andtcp.excluded_nodes
within thesqlnet.ora
file as shown below:cssCopy code
tcp.validnode_checking = yes
tcp.invited_nodes = (127.0.0.1, <allowed IP addresses or address ranges>)
tcp.excluded_nodes = (<denied IP addresses or address ranges>)tip- If the above parameters are not present, you can add them directly.
- The
tcp.validnode_checking
parameter can take valuesyes
orno
, indicating whether the whitelist is enabled or disabled. Setting it tono
will render thetcp.invited_nodes
andtcp.excluded_nodes
configurations ineffective. - The
tcp.invited_nodes
parameter must retain127.0.0.1
to allow local connections to the database. - If the same IP address is listed in both
tcp.invited_nodes
andtcp.excluded_nodes
, the IP will still be allowed to access the database. - Multiple addresses or address ranges should be separated by commas (,).
Execute the command
lsnrctl reload
to reload thesqlnet.ora
file and apply the configuration changes.tip- If the
sqlnet.ora
configuration file was manually created this time, you need to executelsnrctl stop
first, followed bylsnrctl start
to restart the Oracle database. - If you receive an error that the
lsnrctl
command does not exist, it might be because you are not currently in the Oracle account. You can execute the commandsu - oracle
to switch to the Oracle account and then try again.
- If the
This section uses PostgreSQL version 10.9 as an example to explain how to add an IP allowlist.
Open the PostgreSQL configuration file
postgresql.conf
, which is usually located at the following path:<PostgreSQL installation directory>/data/postgresql.conf
.Find the
listen_addresses
parameter, remove the preceding comment symbol (#
), and set its value to'*'
to allow connection requests from all IP addresses. Save and exit thepostgresql.conf
file.Open the
pg_hba.conf
configuration file, which is usually located at the following path:<PostgreSQL installation directory>/data/pg_hba.conf
.Find the line for
IPv4 local connections
orIPv6 local connections
, and add the IP address range that you want to allow access to below theADDRESS
column. For example, if you want to allow access from the192.168.1.0 ~ 192.168.1.255
address range, configure it as shown below:# TYPE DATABASE USER ADDRESS METHOD
# "local" is for Unix domain socket connections only
#local all all trust
# IPv4 local connections:
#host all all 127.0.0.1/32 trust
host all all 192.168.1.0/24 md5Save and exit the
pg_hba.conf
configuration file, then restart the PostgreSQL service for the changes to take effect.
This section uses MongoDB version 5.0 as an example to explain how to add an IP allowlist.
Connect to MongoDB using a user with root privileges and create or update an account for NineData access, based on your specific requirements.
Create an account: Use the following command to create an account for NineData access and grant the corresponding role permissions.
db.createUser{
user: "<account name>",
pwd: "<password>",
roles: [
{ role: "<role name>", db: "<database name>" },
],
authenticationRestrictions: [
{
clientSource: ["<NineData service IP address>"],
serverAddress: ["<MongoDB server IP address>"]
},
...
]
}Existing account: Use the following command to add the NineData IP allowlist and grant the corresponding role permissions to an existing account.
db.updateUser(
"<account name>",
{
roles : [
{ role: "<role name>", db: "<database name>" },
...
],
pwd: "<password>",
authenticationRestrictions: [
{
clientSource: ["<NineData service IP address>"],
serverAddress: ["<MongoDB server IP address>"]
},
...
]
)
Use the above account to add a MongoDB data source through the NineData console.
This section takes Kafka 3.3.2 as an example to introduce how to add IP allowlist.
Open the Kafka configuration file
server.properties
, which is usually located in the following path:<Kafka installation directory>/config/server.properties
.Find the
listeners
parameter and set its value to the IP address and port number that are allowed to access Kafka. For example, if you want to allow NineData to access Kafka, you can set it to:listeners=PLAINTEXT://121.199.39.25:9092
Save the changes and restart the Kafka service.
This section takes SQL Server 2022 as an example to introduce how to add IP allowlist.
Log in to the host where the SQL Server service is located, and open SQL Server Configuration Manager.
Select SQL Server Network Configuration in the left navigation bar, and select the SQL Server instance to be modified.
Double-click the TCP/IP protocol in the right window.
tipMake sure that the TCP/IP protocol is enabled.
Click the IP Addresses tab, and add the IP address that is allowed to access SQL Server. For example, if you want to allow the host with IP address
192.168.1.2
to access SQL Server, simply enter192.168.1.2
in the text box to the right of IP Address.Click OK and restart the SQL Server instance.
This section takes ClickHouse version 22.1 as an example to introduce how to add IP allowlist.
Open the ClickHouse configuration file
users.xml
with a text editor, which is usually located in the following path:/etc/clickhouse-server/users.xml
.Find the account that needs to be used to access NineData, for example,
<default>
, and find the<networks>
parameter below it, and enter NineData's IP into the<ip>
tag.Example:
<users>
<default>
<networks>
<ip>121.199.39.25</ip>
</networks>
</default>
</users>Save the configuration file.
IP allowlist can be added to Redis for all versions using the following steps:
Open Redis configuration file
redis.conf
with a text editor. The file is usually located in the following path:/etc/redis/redis.conf
.Find the
bind
parameter and set its value to the IP address(es) or address range(s) that need to be allowed access. Multiple IP addresses or address ranges can be separated by space or comma.Example:
bind 121.199.39.25
Find the
protected-mode
parameter and set its value tono
to allow external connections to access Redis.Example:
protected-mode no
Save the configuration file.
This section provides an example of adding an IP allowlist for Elasticsearch version 7.17. This method applies to versions 5.x, 6.x, and 7.x of Elasticsearch.
Open the Elasticsearch configuration file
elasticsearch.yml
with a text editor. This file is usually located in theconfig
subdirectory of the Elasticsearch installation directory.Find the
network.host
parameter and configure its value to the IP address(es) or address range(s) that needs to be allowed access. Multiple IP addresses or address ranges are separated by a comma.Example:
network.host: 121.199.39.25, 123.57.58.208
Save the configuration file.
Appendix 3: Add multi-active tag to data sources
If the data source serves for multi-node replication tasks (data replication between three or more data sources), in order to prevent circular replication, multi-active flags are required for all data sources participating in the replication, The multi-active tag of each data source must be globally unique.
Log in to NineData Console.
In the navigation pane on the left, click Datasource>Datasource.
Click the target data source ID to open the Data Source Details page.
- In the data source details area (including data source name, ID, creator, creation time, etc.), click Show Details.
Find Multi-Active Tag, click the icon on the right side of it.
Enter the Multi-Active Tag, and click OK.
tip- Multi-active tag can contain 1~64 characters.
- The multi-active tag must be globally unique and cannot be duplicated with other multi-active tag.
Appendix 4: Create Tags
Tags are used for custom grouping in the slow query analysis feature of the Database DevOps module. By configuring tags for specific data sources, you can flexibly group and display slow queries on the dashboard based on business logic, departments, or other requirements. This helps you more precisely identify and address performance bottlenecks.
Log in to the NineData console.
In the left navigation bar, click > .
Click the tab and then click on the page.
In the pop-up dialog, enter the and click .
tip- The tag name must be globally unique.
- After creating the tag, you need to bind it to the target data source in the slow query analysis module. For more information, see Slow Query Analysis.
Common problem
Issue | Possible Cause | Solution |
---|---|---|
Error when adding a data source: http connections are not allowed from xxx.xxx.xxx.xxx:xxxxx . | NineData service's IP address is not whitelisted on your server. | Before adding a data source, make sure to add NineData's service address to your data source whitelist. For more information, please refer to the Precautions section in this article. |