A Guide to Integrate Apache Server with Datadog

Introduction

In today’s digital landscape, maintaining the performance and reliability of web servers is critical. Apache, one of the most popular web servers, powers a significant portion of the internet. Monitoring Apache server performance and health ensures optimal operation and quick troubleshooting. Datadog, a powerful monitoring and analytics platform, provides extensive capabilities for monitoring and visualizing Apache server metrics. This blog will guide you through the steps to integrate Apache with Datadog and leverage its full potential for monitoring your server.

Prerequisites

Before we begin, ensure you have the following prerequisites in place:

An Apache server up and running.
A Datadog account. You can sign up for a free trial if you don’t have one.
Datadog Agent installed on the server where Apache is running.

Pioneers in Cloud Consulting & Migration Services

Reduced infrastructural costs
Accelerated application deployment

Get Started

Step-by-Step Integration

Install and Configure Datadog Agent

The first step is to install the Datadog Agent on the server where your Apache server is running. Detailed installation instructions for various platforms are available on the Datadog website.

Once installed, configure the agent by editing the configuration file, typically located at /etc/datadog-agent/datadog.yaml. Ensure that the API_key field is set to your Datadog API key.

api_key: YOUR_DATADOG_API_KEY

1	api_key: YOUR_DATADOG_API_KEY

Enable Apache Status Module

Datadog collects Apache metrics using the Apache status module. Enable this module by adding the following lines to your Apache configuration file (usually located at /etc/httpd/conf/httpd.conf or /etc/apache2/apache2.conf).

1. <IfModule mod_status.c>
2.     ExtendedStatus On
3.     <Location /server-status>
4.         SetHandler server-status
5.         Require local
6.     </Location>
7. </IfModule>

1. <IfModule mod_status.c>

2. ExtendedStatus On

3. <Location /server-status>

4. SetHandler server-status

5. Require local

6. </Location>

7. </IfModule>

Restart Apache to apply the changes:

sudo systemctl restart apache2

1	sudo systemctl restart apache2

You may want to restrict access to the status page to specific IP addresses for additional security. Replace Require local with Require ip YOUR_IP_ADDRESS.

Configure Datadog for Apache Integration

Datadog needs to be configured to collect metrics from the Apache status page. Create a new configuration file for the Apache integration:

sudo nano /etc/datadog-agent/conf.d/apache.d/conf.yaml

1	sudo nano /etc/datadog-agent/conf.d/apache.d/conf.yaml

Add the following configuration:

1. init_config:
2. instances:
3.   - apache_status_url: http://localhost/server-status?auto
4.     tags:
5.       - instance:apache_server

1. init_config:

2. instances:

3. - apache_status_url: http://localhost/server-status?auto

4. tags:

5. - instance:apache_server

Restart the Datadog Agent to apply the configuration:

sudo systemctl restart datadog-agent

1	sudo systemctl restart datadog-agent

Verify the Integration

Navigate to the Datadog dashboard to verify the integration and check for Apache metrics. You should see metrics like apache.net.bytes, apache.net.hits, and apache.performance.uptime being reported.

Additional Configuration

You can enable and configure additional Apache modules and Datadog features to collect more detailed metrics and logs.

Enable Additional Apache Modules

Apache provides various modules to extend its functionality. For example, to enable the mod_log_config module for enhanced logging:

1. sudo a2enmod log_config
2. sudo systemctl restart apache2

1 2	1. sudo a2enmod log_config 2. sudo systemctl restart apache2

You can also enable the mod_status module with extended options for more detailed metrics:

 1. <IfModule mod_status.c>
 2.     ExtendedStatus On
 3.     <Location /server-status>
 4.         SetHandler server-status
 5.         Require ip YOUR_IP_ADDRESS
 6.         Order deny, allow
 7.         Deny from all
 8.         Allow from YOUR_IP_ADDRESS
 9.     </Location>
10. </IfModule>

1. <IfModule mod_status.c>

2. ExtendedStatus On

3. <Location /server-status>

4. SetHandler server-status

5. Require ip YOUR_IP_ADDRESS

6. Order deny, allow

7. Deny from all

8. Allow from YOUR_IP_ADDRESS

9. </Location>

10. </IfModule>

Configure Datadog for Log Collection

You must enable log collection in the Datadog Agent to collect Apache logs. Edit the Datadog Agent configuration file:

sudo nano /etc/datadog-agent/datadog.yaml

1	sudo nano /etc/datadog-agent/datadog.yaml

Add or uncomment the following lines to enable log collection:

logs_enabled: true

1	logs_enabled: true

Create a new log configuration file for Apache logs:

sudo nano /etc/datadog-agent/conf.d/apache.d/conf.yaml

1	sudo nano /etc/datadog-agent/conf.d/apache.d/conf.yaml

Add the following configuration:

 1. logs:
 2.   - type: file
 3.     path: /var/log/apache2/access.log
 4.     service: apache
 5.     source: apache
 6.   - type: file
 7.     path: /var/log/apache2/error.log
 8.     service: apache
 9.     source: apache

1. logs:

2. - type: file

3. path: /var/log/apache2/access.log

4. service: apache

5. source: apache

6. - type: file

7. path: /var/log/apache2/error.log

8. service: apache

9. source: apache

Restart the Datadog Agent:

sudo systemctl restart datadog-agent

1	sudo systemctl restart datadog-agent

Utilizing Datadog Features

Once the integration is verified, you can start leveraging Datadog’s features to monitor your Apache server:

Dashboards: Create custom dashboards to visualize Apache metrics and track performance over time.
Alerts: Set up alerts to notify you of any issues or anomalies in your Apache server metrics.
Logs: Enable log collection to monitor Apache logs for errors and warnings.
APM (Application Performance Monitoring): Use Datadog APM to trace requests and monitor application performance.

Conclusion

Integrating Apache with Datadog provides a powerful solution for monitoring and managing your web server’s performance and health. Following the steps outlined in this guide, you can set up comprehensive monitoring for your Apache server, ensuring quick identification and resolution of issues and maintaining optimal performance.

This integration enables you to leverage Datadog’s robust monitoring, alerting, and visualization features, ensuring your Apache server operates smoothly and efficiently.

Drop a query if you have any questions regarding Datadog and we will get back to you quickly.

Making IT Networks Enterprise-ready – Cloud Management Services

Accelerated cloud migration
End-to-end view of the cloud environment

Get Started

About CloudThat

CloudThat is a leading provider of Cloud Training and Consulting services with a global presence in India, the USA, Asia, Europe, and Africa. Specializing in AWS, Microsoft Azure, GCP, VMware, Databricks, and more, the company serves mid-market and enterprise clients, offering comprehensive expertise in Cloud Migration, Data Platforms, DevOps, IoT, AI/ML, and more.

CloudThat is the first Indian Company to win the prestigious Microsoft Partner 2024 Award and is recognized as a top-tier partner with AWS and Microsoft, including the prestigious ‘Think Big’ partner award from AWS and the Microsoft Superstars FY 2023 award in Asia & India. Having trained 650k+ professionals in 500+ cloud certifications and completed 300+ consulting projects globally, CloudThat is an official AWS Advanced Consulting Partner, Microsoft Gold Partner, AWS Training Partner, AWS Migration Partner, AWS Data and Analytics Partner,AWS DevOps Competency Partner, Amazon QuickSight Service Delivery Partner, Amazon EKS Service Delivery Partner, AWS Microsoft Workload Partners, Amazon EC2 Service Delivery Partner, Amazon ECS Service Delivery Partner, AWS Glue Service Delivery Partner, Amazon Redshift Service Delivery Partner, AWS Control Tower Service Delivery Partner, AWS WAF Service Delivery Partner and many more.

To get started, go through our Consultancy page and Managed Services Package, CloudThat’s offerings.

FAQs

1. What metrics does Datadog collect from Apache?

ANS: – Datadog collects many metrics from Apache, including bytes served, request count, response time, uptime, etc.

2. How do I enable additional modules in Apache for more metrics?

ANS: – You can enable additional modules in Apache by editing the Apache configuration file and loading the desired modules. Consult the Apache documentation for specific module configurations.

3. Can I monitor multiple Apache servers with Datadog?

ANS: – Yes, you can monitor multiple Apache servers by configuring the Datadog Agent on each server and specifying the appropriate configurations.

WRITTEN BY Rajveer Singh Chouhan

Rajveer Singh Chouhan works as a Research Associate at CloudThat. He has been learning and gaining practical experience in AWS and Azure. Rajveer is also passionate about continuously expanding his skill set and knowledge base by actively seeking opportunities to learn new skills. Rajveer regularly reads blogs and articles related to various programming languages, technologies, and industry trends to stay up to date with the latest developments in the field.