Monitoring Kubernetes Clusters with Prometheus and Grafana


Introduction

Kubernetes is a powerful container orchestration platform, but monitoring it is crucial for ensuring reliability, performance, and scalability. 

Prometheus and Grafana are two of the most popular open-source tools for monitoring and visualizing Kubernetes clusters. 

In this guide, we’ll walk you through setting up Prometheus and Grafana on Kubernetes and configuring dashboards for real-time insights.

Why Use Prometheus and Grafana for Kubernetes Monitoring?

Prometheus: The Monitoring Backbone

  • Collects metrics from Kubernetes nodes, pods, and applications.
  • Uses a powerful query language (PromQL) for analyzing data.
  • Supports alerting based on predefined conditions.

Grafana: The Visualization Tool

  • Provides rich dashboards with graphs and metrics.
  • Allows integration with multiple data sources (e.g., Prometheus, Loki, Elasticsearch).
  • Enables alerting and notification management.

Step 1: Installing Prometheus and Grafana on Kubernetes

Prerequisites

Before starting, ensure you have:

  • A running Kubernetes cluster
  • kubectl and Helm installed

1. Add the Prometheus Helm Chart Repository

Helm makes it easy to deploy Prometheus and Grafana using predefined configurations.

sh
helm repo add prometheus-community https://prometheus-community.github.io/helm-charts
helm repo update

2. Install Prometheus and Grafana Using Helm

sh
helm install prometheus prometheus-community/kube-prometheus-stack --namespace monitoring --create-namespace

This command installs:
✅ Prometheus — For collecting metrics
✅ Grafana — For visualization
✅ Alertmanager — For notifications
✅ Node-exporter — To collect system-level metrics

Step 2: Accessing Prometheus and Grafana

Once deployed, we need to access the Prometheus and Grafana web interfaces.

1. Accessing Prometheus

Check the Prometheus service:

sh
kubectl get svc -n monitoring

Forward the Prometheus server port:

sh
kubectl port-forward svc/prometheus-kube-prometheus-prometheus 9090 -n monitoring

Now, open http://localhost:9090 in your browser.

2. Accessing Grafana

Retrieve the Grafana admin password:

sh
kubectl get secret --namespace monitoring prometheus-grafana -o jsonpath="{.data.admin-password}" | base64 --decode
Forward the Grafana service port:
sh
kubectl port-forward svc/prometheus-grafana 3000:80 -n monitoring

Open http://localhost:3000, and log in with:

  • Username: admin
  • Password: (obtained from the previous command)

Step 3: Configuring Prometheus as a Data Source in Grafana

  1. Open Grafana and navigate to Configuration > Data Sources.
  2. Click Add data source and select Prometheus.
  3. Set the URL to:
  1. Click Save & Test to verify the connection.

Step 4: Importing Kubernetes Dashboards into Grafana

Grafana provides ready-made dashboards for Kubernetes monitoring.

  1. Go to Dashboards > Import.
  2. Enter a dashboard ID from Grafana’s dashboard repository.
  • Example: Use 3119 for Kubernetes cluster monitoring.
  1. Select Prometheus as the data source and click Import.

You’ll now have a real-time Kubernetes monitoring dashboard! 🎯

Step 5: Setting Up Alerts in Prometheus and Grafana

Creating Prometheus Alerting Rules

Create a ConfigMap for alerts:

yaml
apiVersion: v1
kind: ConfigMap
metadata:
  name: alert-rules
  namespace: monitoring
data:
  alert.rules: |
    groups:
      - name: InstanceDown
        rules:
          - alert: InstanceDown
            expr: up == 0
            for: 5m
            labels:
              severity: critical
            annotations:
              summary: "Instance {{ $labels.instance }} is down"

Apply it to the cluster:

sh
kubectl apply -f alert-rules.yaml

Configuring Grafana Alerts

  • Navigate to Alerting > Notification Channels.
  • Set up a channel (Email, Slack, or PagerDuty).
  • Define alert rules based on metrics from Prometheus.

Step 6: Enabling Persistent Storage for Prometheus

By default, Prometheus stores data in memory. To make the data persistent, configure storage:

Modify the Helm values:

yaml
prometheus:
  server:
    persistentVolume:
      enabled: true
      size: 10Gi

Apply the changes:

sh
helm upgrade prometheus prometheus-community/kube-prometheus-stack -f values.yaml

Conclusion

In this guide, we’ve set up Prometheus and Grafana to monitor a Kubernetes cluster. You now have:
✅ Real-time dashboards in Grafana
✅ Prometheus alerts to detect failures
✅ Persistent storage for historical metrics

WEBSITE: https://www.ficusoft.in/devops-training-in-chennai/

Comments

Post a Comment

Popular posts from this blog

Best Practices for Secure CI/CD Pipelines

Image
  🔒 Best Practices for Secure CI/CD Pipelines In a world where software is built and deployed faster than ever, CI/CD pipelines have become the engine room of modern development. But with speed comes risk. If not properly secured, your CI/CD pipeline can become a prime target for attackers looking to inject malicious code, access secrets, or hijack production systems. Here are essential best practices to help you secure your CI/CD pipelines without slowing down your delivery. 1. 🔑 Protect Your Secrets Secrets (API keys, tokens, passwords) are gold for attackers. Use secret managers like HashiCorp Vault, AWS Secrets Manager, or GitHub Actions’ built-in secrets. Never store secrets in code, config files, or environment variables in plaintext. Rotate secrets regularly and audit access. 2. 👤 Enforce Least Privilege Access Only give users, services, and tools the permissions they absolutely need. Use role-based access control (RBAC) . Ensure build agents only have access to t...
Read more

What is DevSecOps? Integrating Security into the DevOps Pipeline

Image
  What is DevSecOps? Integrating Security into the DevOps Pipeline In today’s fast-paced digital landscape, delivering software quickly isn’t just a competitive advantage — it’s a necessity. Enter DevOps: the fusion of development and operations, aimed at streamlining software delivery through automation, collaboration, and continuous improvement. But as we build faster, we must also build safer . That’s where DevSecOps comes in. What is DevSecOps? DevSecOps stands for Development, Security, and Operations . It’s an evolution of the DevOps philosophy that embeds security practices directly into the DevOps pipeline  — from planning to production. Instead of treating security as a final step or a separate process, DevSecOps makes it an integral part of the development lifecycle . In short: DevSecOps = DevOps + Continuous Security. Why DevSecOps Matters Traditional security models often acted as bottlenecks, kicking in late in the software lifecycle, causing delays and costly r...
Read more

SEO for E-Commerce: How to Rank Your Online Store

Image
  🛒 SEO for E-Commerce: How to Rank Your Online Store Running an online store is exciting — but it means nothing if no one can find it. That’s where e-commerce SEO comes in. Search Engine Optimization helps your online store appear higher in search results, driving free, organic traffic that converts. Let’s break down what matters, and how you can boost your store’s visibility. 🔍 Why SEO Matters for E-Commerce 67% of clicks go to the first five results on Google Paid ads are costly — SEO delivers long-term ROI SEO builds trust, visibility, and traffic Whether you’re on Shopify, WooCommerce, Magento, or a custom build —  the fundamentals stay the same . ✅ E-Commerce SEO Checklist 1. Keyword Research for Product Pages Start with what people are actually searching for . 🔧 Tools: Google Keyword Planner Ubersuggest Ahrefs / SEMrush 🎯 Focus on: Product-specific keywords: “black leather sneakers” Long-tail keywords: “eco-friendly yoga mat for beginners” Buyer intent: ...
Read more