a128253930
- Add K8s on-disk installation configuration yaml files to extend the SCDF k8s on-disk installation. - Add K8s on-disk installation configuration yaml files to extend the SCDF k8s Helm installation. - Add AlertWebhookReciver Spring Boot app. - Publish the webhook app to springcloud DockerHub
28 lines
1.7 KiB
Markdown
28 lines
1.7 KiB
Markdown
|
|
# Auto-scaling adapter for Streaming Data Pipelines
|
|
|
|
The `AlertWebHookApplication` is a [Prometheus Alertmanager Webhook Receiver](https://github.com/prometheus/alertmanager)
|
|
that listens for pre-configured Prometheus alerts and leverages the SCDF Scale API to scale out or in a preconfigured
|
|
stream application.
|
|
|
|
Use the `scdf.alert.webhook.scaleOutAlertName` and `scdf.alert.webhook.scaleInAlertName` to configure the names of the scale-out and scale-in alert names.
|
|
|
|
On scale-out alert, the `AlertWebHookApplication` increases the number of application (defined by `scdf.alert.webhook.scaleApplicationName` or `application_name` alert label) instances to the `scdf.alert.webhook.scaleOutFactor` count.
|
|
|
|
On scale-in alert, the `AlertWebHookApplication` decreases the number of application (defined by `scdf.alert.webhook.scaleApplicationName` or `application_name` alert label) instances to the `scdf.alert.webhook.scaleInFactor` count.
|
|
|
|
The stream name should be provided either as `scdf.alert.webhook.scaleStreamName` property or an Alert label called: `stream_name`.
|
|
|
|
The application name should be provided either as `scdf.alert.webhook.scaleApplicationName` property or an Alert label called: `application_name`.
|
|
|
|
Internally, `AlertWebHookApplication` uses the Data Flow Scale REST API to scale the app instances in platform agnostic way.
|
|
|
|
Use the `spring.cloud.dataflow.client.server-uri` property to configure url of the Data Flow server.
|
|
|
|
Following video illustrates the overall flow and the role for the AlertWebHookApplication:
|
|
|
|
<a href="http://www.youtube.com/watch?feature=player_embedded&v=IDH6X1pmgxc
|
|
" target="_blank"><img src="http://img.youtube.com/vi/IDH6X1pmgxc/0.jpg"
|
|
alt="SCDF Auto Scaling" width="240" height="180" border="10" /></a>
|
|
|