MC_MODULE
Observability and Logging

Metrics Collection

Aggregates high-volume telemetry data from compute nodes into Prometheus time-series format for real-time monitoring and Grafana visualization dashboards.

High
SRE
Group discusses data displayed on a large screen near server racks and technical equipment.

Priority

High

Execution Context

This function orchestrates the ingestion, normalization, and storage of performance metrics generated by compute instances. It ensures low-latency collection of CPU, memory, and network statistics into a centralized Prometheus backend. The system automatically scrapes agents deployed on servers, formats data according to standard time-series protocols, and indexes it for immediate retrieval via Grafana panels. This process is critical for detecting resource bottlenecks and maintaining service availability.

The system initiates a scheduled scrape cycle targeting all registered compute agents to fetch current metric snapshots.

Collected data undergoes validation against schema constraints before being streamed into the Prometheus ingestion pipeline.

Processed metrics are immediately available for visualization in Grafana dashboards and alerting rule triggers.

Operating Checklist

Deploy compute agents on target infrastructure nodes

Configure Prometheus scrape configurations to identify agent endpoints

Execute periodic scraping cycles to collect raw metric streams

Render aggregated data into interactive Grafana visualizations

Integration Surfaces

Compute Agent

Local agent software installed on servers that exposes internal hardware counters and application performance data.

Prometheus Server

Centralized time-series database handling ingestion, retention policies, and query execution for metric data.

Grafana Dashboard

Visualization layer providing real-time charts and alerting capabilities for SRE monitoring operations.

FAQ

Bring Metrics Collection Into Your Operating Model

Connect this capability to the rest of your workflow and design the right implementation path with the team.