# Monitoring Architecture: Spring Cloud Data Flow + Prometheus RSocket Proxy

The Data Flow metrics architecture is designed around the [Micrometer](https://micrometer.io/) library - vendor-neutral application metrics facade.
The Spring Cloud Data Flow server leverages the [Prometheus RSocket Proxy](https://github.com/micrometer-metrics/prometheus-rsocket-proxy), 
for monitoring of `tasks`, which are short lived, as well as long lived `stream` applications. 
The RSocket based monitoring architecture is reusable across the Local, Kubernetes and Cloud Foundry platforms. 

The prebuilt `stream` and `task` applications support the Prometheus Proxy RSocket monitoring architecture. 

The [stream-apps](./stream-apps/) samples shows how to enable monitoring for custom built `source`, `processor` and `sink` apps.  

The [task-apps](./task-apps/) sample shows how to enable monitoring for custom built `task` apps.

The following image shows the general architecture of how the Stream applications are monitored:

![Stream App Monitoring](./images/SCDF-monitoring-prometheus-streams.png)

and the same architecture is used for monitoring the tasks as well. 
 
![Stream App Monitoring](./images/SCDF-monitoring-prometheus-tasks.png)

Prometheus is configured to scrape each rsocket-proxy instance. 
Proxies in turn use the RSocket connection to pull metrics from each application. 
The scraped metrics are then viewable through Grafana dashboards. 

Following animated diagram shows the metrics collection flow:
 
![Stream App Monitoring](./images/SCDF-monitoring-promethesu-proxy.gif)

#### Spring Cloud Data Flow Monitoring Related Documentation

- [SCDF Monitoring](https://dataflow.spring.io/docs/2.3.0.SNAPSHOT/concepts/monitoring/)
- [Stream Monitoring with Prometheus and InfluxDB](https://dataflow.spring.io/docs/2.3.0.SNAPSHOT/feature-guides/streams/monitoring/).
- [Task and Batch Monitoring with Prometheus and InfluxDB](https://dataflow.spring.io/docs/2.3.0.SNAPSHOT/feature-guides/batch/monitoring/#task-and-batch-monitoring-with-prometheus-and-influxdb)