Observability - Prometheus/Grafana

Architecture Diagram:

Prometheus is a free software application used for event monitoring and alerting. It records metrics in a time series database built using an HTTP pull model, with flexible queries and real-time alerting.

Grafana is a multi-platform open source analytics and interactive visualization web application. It provides charts, graphs, and alerts for the web when connected to supported data sources.

Note: All dev environment servers will point to dev monitoring platform. All other environments, (testing/uat/qa/prod) will all point to production platform.

Note: Starting point of alerts

Documentation Status:

Status

DRAFT

Approval

IN-PROGRESS

Last Modified

Server List

Server Name Environment DC IP Address CPU Memory ServerOS Notes OKDODEVPRM01 Dev OKR1 10.103.70.28 4 16GB Ubuntu 22.04

Prometheus Server. 120GB Disk

http://dev-prometheus.caliberfs.com/

OKDODEVGRF01 Dev OKR1 10.103.70.29 4 8GB Ubuntu 22.04

Grafana Server. 80GB Disk

http://dev-grafana.caliberfs.com/

OKDODEVGRF02 Dev OKR2 10.103.70.162 4 8GB Ubuntu 24.04

Grafana Enterprise Server. 80GB Disk

http://dev-grafana.caliberfs.com/

OKDODEVALM01 Dev OKR1 10.103.70.33 4 8GB Ubuntu 22.04

Alert Manager, Exporters, PushGateway. 80GB Disk

http://dev-alertmanager.caliberfs.com/

OKDOPRDPRM01 Prod OKR1 10.103.70.27 4 32GB Ubuntu 22.04

Prometheus Server. 500GB Disk

https://prometheus.caliberfs.com/

OKDOPRDGRF01 Prod OKR1 10.103.70.30 4 16GB Ubuntu 22.04

Grafana Server. 160GB Disk

https://grafana.caliberfs.com/

OKDOPRDGRF02 Prod OKR1 10.103.70.163 4 16GB Ubuntu 24.04

Grafana Server. 160GB Disk

https://grafana.caliberfs.com/

OKDOPRDALM01 Prod OKR1 10.103.70.32 4 8GB Ubuntu 22.04

Alert Manager, Exporters, PushGateway. 80GB Disk

https://alertmanager.caliberfs.com/

Firewall Rules:

Environment

Source Server

Source IP

Destination Server

Destination IP

Destination Port

Dev OKDODEVDMZ01 OKDODEVDMZ02 OKDODEVHLK01 OKDODEVHLK02 172.23.3.12 172.23.3.13 172.23.3.4 172.23.3.5 OKDODEVLOK01.OTOEMC.LOCAL 10.103.70.119 3100 QA OKDOQASDMZ01 OKDOQASDMZ02 OKDOQASHLK01 OKDOQASHLK02 172.23.3.14 172.23.3.15 172.23.3.6 172.23.3.7 OKDODEVLOK01.OTOEMC.LOCAL 10.103.70.119 3100 QA2 OKDOQA2DMZ01 OKDOQA2DMZ02 OKDOQA2HLK01 OKDOQA2HLK02 72.23.3.20 172.23.3.21 172.23.3.22 172.23.3.26 OKDODEVLOK01.OTOEMC.LOCAL 10.103.70.119 3100 UAT OKDOUATDMZ01 OKDOUATDMZ02 OKDOUATHLK01 OKDOUATHLK02 172.23.3.16 172.23.3.17 172.23.3.8 172.23.3.9 OKDODEVLOK01.OTOEMC.LOCAL 10.103.70.119 3100 Prod OKDOPRDDMZ01 OKDOPRDDMZ02 OKDOPRDHLK01 OKDOPRDHLK02 172.23.3.18 172.23.3.19 172.23.3.10 172.23.3.11 OKDOPRDLOK01.OTOEMC.LOCAL 10.103.70.121 3100

Knowledge Documents

Search This Documentation

Recent updates

Observability - Prometheus/Grafana
Jul 03, 2025 • contributed by Chase Vernon
DevOps
Jun 30, 2025 • contributed by Anthony Klynsma
RabbitMQ
Oct 29, 2024 • contributed by Jeffery White
Postman
Apr 01, 2024 • contributed by TJ Blogumas
AppDynamics
Feb 29, 2024 • contributed by TJ Blogumas