Posts

Prometheus & Grafana Setup on Kubernetes

Image
  Introduction Behind the trends of cloud-native architectures and micro-services lies a technical complexity, a paradigm shift, and a rugged learning curve. This complexity manifests itself in the design, deployment, security, and everything that concerns the monitoring and observability of applications running in distributed systems like Kubernetes. Fortunately, there are tools to help the DevOps team to overcome these obstacles. For example, at the observability level, tools such as Prometheus and Grafana provide enormous help to the developers’ community. In this blog post, we are going to see how to use Prometheus and Grafana with Kubernetes. We are going to see how Prometheus works, and how to create custom dashboards. Then we’ll dive into some concepts and talk about which metrics to watch in production and how to do it. Requirements Some basic knowledge of Kubernetes is assumed, and the code for this tutorial will be deployed into a Kubernetes cluster running in minikube/GKE/EK

Druid Cluster Setup

Image
  What is Druid? Apache Druid is a real-time analytics database designed for fast slice-and-dice analytics (“ OLAP ” queries) on large data sets. Druid is most often used as a database for powering use cases where real-time ingest, fast query performance, and high uptime are important. As such, Druid is commonly used for powering GUIs of analytical applications, or as a backend for highly-concurrent APIs that need fast aggregations. Druid works best with event-oriented data. Ideal Druid Setup Architecture This section describes the Druid processes and the suggested Master/Query/Data server organisation, as shown in the architecture diagram above. Processes and Servers : Druid has several process types, briefly described below: Coordinator  processes manage data availability on the cluster. Overlord  processes control the assignment of data ingestion workloads. Broker  processes handle queries from external clients. Router  processes are optional processes that can route requests to Bro