* GH-265: Add Kafka Consumer and Sink
Fixes https://github.com/spring-cloud/stream-applications/issues/265
* Make `kafkaPublisher` based on the Spring for Apache Kafka auto-configuration
and Spring Integration channel adapter, essentially `KafkaProducerMessageHandler`
* Make this `KafkaPublisherConfiguration` as an auto-configuration by itself.
* Expose those simple properties required by the `KafkaProducerMessageHandlerSpec`
* Add `kafka-sink` module based on the `kafkaPublisher`
* Add `kafka-sink` into apps metadata properties
Fixes https://github.com/spring-cloud/stream-applications/issues/275
Many functions make use of `ComponentCustomizer` ot let end-user
to provide any custom configuration for target component used by the function.
First of all for use-case which are not covered by standard configuration
properties and secondly for those options which cannot be represented
as a configuration option.
* Add a sentence to READMEs of those functions which make use of `ComponentCustomizer`
with an expected generic argument type
* Add README into `rabbit-supplier` where it is fully missed at the moment
This commit removes all legacy config props metadata files
named `dataflow-configuration-metadata-whitelist.properties`.
This is safe with respect to SCDF because stream apps 4.x
require SCDF 2.11.x to launch the apps. Therefore, no existing
SCDF customers on an older SCDF version (that only supports
the legacy file) will be impacted - the users will all be on
the latest version of SCDF.
Fixes#252
* Renamed spring-configuration-metadata-whitelist.properties (removed "-whitelist")
* Renamed spring-configuration-metadata.properties to
dataflow-configuration-metadata.properties
* Fix rsocket
* Rsocket props now added back in
* Rename rsocket-sink metadate file to non-legacy format
- Add a marker value for the 'configClass' attriubte: 'AUTOCONFIGURATION'.
- If the configClass=='AUTOCONFIGURATION' then the '@Import(configClass)' statment is dropped from the generated app.
- Update maven versions to 3.9.x
- Udate project versions from 1.0.7 to 1.0.8-SNAPSHOT
Resolves#23
- Move the `DebeziumEngineBuilderAutoConfiguration` and META-INF configurations to new function project: debezium-autoconfigure.
- Introduce the `EmbeddedEngineExecutorService` helper class for help DebezuimEngine implementations.
- Move the relevant tests from debezium-supplier to the debeizum-autoconfigure.
- Add detailed README documentation.
- Adjust the debeizum-supplier and debezium-source configurations.
- Clean the related tests.
Resolves#462
---------
Co-authored-by: Artem Bilan <abilan@vmware.com>
Add `JsonBytesToMap` function to allow conversion between byte[] and JSON Map.
Fixes https://github.com/spring-cloud/stream-applications/issues/441
* Introduce a `JsonBytesToMap` as a part of a `payload-converter-function` module
which is auto-discovered by Spring Cloud Function scanning algorithm - the `functions` package.
* Add a `payload-converter-function` as dependency into an `aggregator-function`
* Compose `jsonBytesToMap|aggregatorFunction` for the `aggregator-processor`
* Verify a `JsonBytesToMap` function in action with an `AggregatorProcessorTests`
* Mentioned such a payload conversion in the `aggregator-processor` README
* Factor out the Debezium Engine Builder auto-configuration
- Rename DebeziumEngineAutoConfiguration into DebeziumEngineBuilderAutoConfiguration.
- Make the DebeziumEngineBuilderAutoConfiguration auto-create a DebeizumEngine.Builder instance.
- Move the DebeizumEngine bean creation to the DebeziumReactiveConsumerConfiguration.
- Make DebeziumEngineBuilderAutoConfiguration conditional on Debeizum connecgtor on the class path and debezium.properties.connector.class property set.
- Minor improvment on the serialization format class resolution.
- Add support for debezium header serialization format, required for the change event headers to work.
Resolves#458
