Configure External Collection Sources for Slow Query Analysis
NineData lets you supplement slow query analysis with external collection sources. You can collect slow logs from Elasticsearch, Alibaba Cloud, Huawei Cloud, or AWS. This is useful when slow logs are already centralized in a logging platform or need to be collected directly from managed databases on the cloud vendor side.
Supported Source Types
| Source Type | Scenario | Configuration Guide |
|---|---|---|
| Elasticsearch | Slow logs are already written to Elasticsearch. | Configure an Elasticsearch external collection source |
| Alibaba Cloud | Slow logs need to be collected from Alibaba Cloud managed databases. | Configure an Alibaba Cloud external collection source |
| Huawei Cloud | Slow logs need to be collected from Huawei Cloud managed databases. | Configure a Huawei Cloud external collection source |
| AWS | Slow logs need to be collected from AWS managed databases. | Configure an AWS external collection source |
Prerequisites
- You have created or joined an organization, and this organization has subscribed to either DevOps Pro or DevOps Enterprise. Please ensure that your annual or monthly subscription is still active. For more information, please refer to Manage Organizations.
- Your current account has switched to the target organization. For more information, please refer to Switching to an Organization.
- Your account has access to Slow Query.
- The database data source whose slow logs you want to view has already been added to the NineData console. For more information, see Create Data Source.
- If you use Elasticsearch, the Elasticsearch data source has already been added to NineData, and the target cluster already contains slow log data that matches the collection script requirements.
- If you use a cloud vendor source, access credentials for the corresponding cloud vendor have already been configured in NineData. For more information, see Configure Cloud Vendor Access Credentials.
- If you use a cloud vendor source, you have confirmed the target instance region, instance ID, project ID, cluster ID, or other required identifiers in advance.
- You have granted the minimum read permissions required by the selected source type to the Elasticsearch data source account or cloud vendor access credentials. See the corresponding source guide for details.
Open the External Collection Sources Page
Log in to the NineData Console.
In the left navigation pane, click DevOps > Slow Query.
On the top tab bar, click External Collection Source.
Recommendations
- If slow logs are already written to Elasticsearch by an application or log platform, use an Elasticsearch source.
- If slow logs still reside on managed database instances, use the corresponding cloud vendor source and bind it when you enable slow log collection for the target data source.
- If you maintain multiple cloud vendors, regions, or instance types, record instance identifiers by vendor, region, and instance type to avoid mixing parameters.