251 Commits

Author SHA1 Message Date
GitHub Actions Bot
493d6e0be2 Next development version 5.1.1-SNAPSHOT / 2025.0.1-SNAPSHOT 2025-01-29 21:16:21 +00:00
GitHub Actions Bot
6296e0d118 Release 5.1.0 / 2025.0.0 2025-01-29 21:16:00 +00:00
Chris Bono
476769dbb0 Update version to 5.1.0-SNAPSHOT
This updates the project version from 6.0.0-SNAPSHOT
to 5.1.0-SNAPSHOT as the former was incorrect.
2025-01-23 13:37:58 -05:00
Chris Bono
95550f0448 Update to Spring Boot 3.4.1
This commit updates the following dependencies:

- Spring Boot to 3.4.2-SNAPSHOT
- Spring Cloud 2024.0.1-SNAPSHOT
- Spring Functions Catalog 5.1.0-SNAPSHOT

Also removes these unnecessary version properties:
- spring-cloud-stream.version
- spring-cloud-function.version
- spring-cloud-starters.version

Also removes dependency mgmt for the following:
- testcontainers-bom
- junit-bom
- jakarta-jms-api
- groovy-bom

Resolves #599 #600

* Remove Debezium Avro integration tests

This commit removes the DebeziumSupplierAvroFormatTest as it
relies on a dependency that has been removed in Spring Integration
and stream-applications. We should not need to test Debezium
support for Avro encoding.
2025-01-09 09:55:23 -05:00
Chris Bono
e17c18cc3d Update project versions after 2024.0.x branch
This commit updates the project version to `6.0.0-SNAPSHOT`
and the release train version to `2025.0.0-SNAPSHOT`.
2024-12-19 14:19:06 -06:00
GitHub Actions Bot
8de285d892 Next development version 5.0.1-SNAPSHOT / 2024.0.1-SNAPSHOT 2024-11-29 12:29:48 +00:00
GitHub Actions Bot
b875a3a595 Release 5.0.1-M1 / 2024.0.1-M1 2024-11-29 12:29:26 +00:00
Corneil du Plessis
bd5f8a2f2f Fix java-functions.version in xmpp source / sink modules. 2024-11-29 14:05:21 +02:00
GitHub Actions Bot
6d7e8b68ad Next development version 5.0.1-SNAPSHOT / 2024.0.1-SNAPSHOT 2024-06-03 09:24:57 +00:00
GitHub Actions Bot
498f3f7613 Release 5.0.0 / 2024.0.0 2024-06-03 09:24:29 +00:00
GitHub Actions Bot
b9fec40465 Next development version 5.0.0-SNAPSHOT / 2024.0.0-SNAPSHOT 2024-04-30 10:44:44 +00:00
GitHub Actions Bot
39358accde Release 5.0.0-RC1 / 2024.0.0-RC1 2024-04-30 10:44:22 +00:00
Artem Bilan
cc15d64d85 GH-536: Fix Debezium Source tests for Debezium version
Fixes: #536

There are some new fields emitted into Debezium events which we miss to assert in the tests
2024-04-22 12:41:13 -04:00
GitHub Actions Bot
7ff88679af Next development version 5.0.0-SNAPSHOT / 2024.0.0-SNAPSHOT 2024-04-03 13:16:32 +00:00
GitHub Actions Bot
31e43196e6 Release 5.0.0-M1 / 2024.0.0-M1 2024-04-03 13:16:08 +00:00
Corneil du Plessis
fa810c933d [CI] Fix POMs CVE-2023-51775 2024-04-03 10:19:46 +02:00
Corneil du Plessis
5c9b0c6154 fix redis sink (#533)
* Reverting to snapshot to fix build with spring-functions-catalog 5.0.0-M2

* Fix redis-sink and updated dependencies.

* Added commons-codec for test support.

* Remove tests when Spring Functions Catalog performs exact same test.

* Fix xmpp-sink test dependencies.
2024-04-02 15:29:36 +02:00
Chris Bono
7487dc8f61 Link to function catalog docs for config props (#526)
Prior to this commit, each app documented its available config props
in its README.adoc. Now that the functions have been moved to the
function catalog, these inline docs are replaced w/ a link to the
respective function catalog docs.

See #524
2024-03-28 10:44:08 -05:00
Artem Bilan
a72415684c Fix Checkstyle violations in the Debezium Source 2024-03-11 13:51:04 -04:00
Artem Bilan
ba80e3d409 Fix Debezium integration tests
Turned out there were unnecessary and conflicting dependencies
2024-03-11 13:31:01 -04:00
Artem Bilan
2880f3c00a Fix RabbitMQ modules for removed own-connection
* Clean up Testcontainers dependencies in the RabbitMQ modules
* Use `RabbitMQContainer` in the `RabbitSourceListenerTests`
2024-03-11 09:52:18 -04:00
Artem Bilan
288758a1a7 Migrate apps to Spring Functions Catalog (#523)
* Remove `functions` module
* Remove `functions` from build scripts
* Change internal `functions` mentioning in the docs to the dedication Spring Functions Catalog project
* Remove all the TensorFlow modules
* Change to `spring-functions-catalog-bom`
* Update READMEs using `quick-compile.sh`
2024-03-09 00:33:21 -06:00
Chris Bono
6d26122af0 Update major version to 5.0.x (#520)
This commit updates the version number to 5.0.0-SNAPSHOT and the release
train version to 2024.0.0-SNAPSHOT.
2024-02-22 15:21:17 +02:00
GitHub Actions Bot
683a999d7c Next development version 4.0.1-SNAPSHOT / 2022.0.1-SNAPSHOT 2023-10-27 21:14:16 -05:00
Chris Bono
d41c45c876 Update to Spring Cloud 2022.0.4 (#506)
* Also update to Spring Cloud Stream 4.0.4
2023-10-02 14:56:59 -05:00
Christian Tzolov
c905bf59e9 Upgrade debezium to 2.3.3.Final 2023-09-05 13:31:32 -04:00
GitHub Actions Bot
33f92ab047 Next development version 4.0.0-SNAPSHOT / 2022.0.0-SNAPSHOT 2023-07-21 12:40:45 +00:00
GitHub Actions Bot
99bd5982c9 Release 4.0.0-RC2 / 2022.0.0-RC2 2023-07-21 12:40:08 +00:00
GitHub Actions Bot
5f15796c8a Next development version 4.0.0-SNAPSHOT / 2022.0.0-SNAPSHOT 2023-07-20 14:56:01 +00:00
GitHub Actions Bot
f109933fda Release 4.0.0-RC2 / 2022.0.0-RC2 2023-07-20 14:55:34 +00:00
Artem Bilan
f4731801c4 Upgrade to AWS SDK v2
* Upgrade to Spring Integration AWS `3.0.1`
* Upgrade to Spring Cloud AWS `3.0.1`
* Use `spring-cloud-aws-dependencies` BOM to manage Spring Cloud AWS deps, as well as AWS SDK
* Remove `AmazonS3Properties` in favor of similar properties in the Spring Cloud AWS auto-configuration
* Remove `CompatibleStorageAmazonS3Configuration` in favor of its code migration to the single `AmazonS3Configuration`
* Fix `supplier`, `consumer`, `source` and `sink` for S3 to use API and programing model from the mentioned upgrades
* Add extra `dataflow-configuration-metadata` entries for the mentioned properties from the Spring Cloud AWS auto-configuration
* Regenerate README for `s3-source` and `s3-sink`
* Fix `metadata-store-common` to use the latest Spring Integration AWS for DynamoDB store impl

* * Fix `AmazonS3ConfigurationTests` for missed `AwsAutoConfiguration`
in an `ApplicationContextRunner` setup

* * Remove unused import in the `MetadataStoreAutoConfigurationTests`

* * Remove unused import in the `AbstractAwsS3ConsumerMockTests`
2023-07-19 09:36:09 -04:00
Christian Tzolov
f6c336e265 Upgrade Debezium to 2.3.0.Final
* address some review comments

* minor pom improvements

* undo Debezium BOM
2023-06-27 12:58:27 -04:00
Corneil du Plessis
db117de387 Updated asciidoc to use spring-asciidoctor-backends.
Fix unit tests.
2023-06-19 10:18:21 +02:00
GitHub Actions Bot
f65cb72e0c Next development version 4.0.0-SNAPSHOT 2023-06-14 04:47:46 +00:00
GitHub Actions Bot
354c82a114 Release 4.0.0-RC1 2023-06-14 04:47:29 +00:00
Artem Bilan
a841beba15 GH-475: Add some missed nested props for apps (#476)
Fixes https://github.com/spring-cloud/stream-applications/issues/475

* Fix JDBC props for limited listed number of them
2023-06-12 23:35:10 -05:00
Artem Bilan
546eb0b2c9 GH-265: Add Kafka Supplier & Source (#474)
* Also add support for nested config props for `kafka-sink`

Fixes #265
2023-06-12 14:23:06 -05:00
abilan
7dc4d4a3f5 Fix mail apps for Spring Boot 3.1 2023-06-09 10:02:34 +02:00
Corneil du Plessis
92871088d4 [Revert] Spring Boot to 3.0.7 2023-06-08 18:56:41 +02:00
Corneil du Plessis
f99016592f [Update] Spring Boot to 3.1.0 2023-06-08 18:47:25 +02:00
Christian Tzolov
1557d0a5b5 Functions auto-configuration support
Requires `org.springframework.cloud:spring-cloud-dataflow-apps-generator-plugin version >= 1.0.8`.
2023-06-05 16:52:36 -04:00
Chris Bono
d7ba24fa01 GH-252: Remove legacy config properties metadata files
This commit removes all legacy config props metadata files
named `dataflow-configuration-metadata-whitelist.properties`.

This is safe with respect to SCDF because stream apps 4.x
require SCDF 2.11.x to launch the apps. Therefore, no existing
SCDF customers on an older SCDF version (that only supports
the legacy file) will be impacted - the users will all be on
the latest version of SCDF.

Fixes #252

* Renamed spring-configuration-metadata-whitelist.properties (removed "-whitelist")

* Renamed spring-configuration-metadata.properties to
dataflow-configuration-metadata.properties

* Fix rsocket

* Rsocket props now added back in

* Rename rsocket-sink metadate file to non-legacy format
2023-06-05 14:35:43 -04:00
Christian Tzolov
11be59afd1 Move Debezium builder into standalone function common project (#463)
- Move the `DebeziumEngineBuilderAutoConfiguration` and META-INF configurations to new function project: debezium-autoconfigure.
 - Introduce the `EmbeddedEngineExecutorService` helper class for help DebezuimEngine implementations.
 - Move the relevant tests from debezium-supplier to the debeizum-autoconfigure.
 - Add detailed README documentation.
 - Adjust the debeizum-supplier and debezium-source configurations.
 - Clean the related tests.

 Resolves #462


---------

Co-authored-by: Artem Bilan <abilan@vmware.com>
2023-06-04 10:58:12 -05:00
Christian Tzolov
898938dd55 Update Debezium version and add mssql IT (#460)
* Update Debezium version from 2.2.0.Final to 2.2.1.Final
* Add Debezium mssql integration test
2023-05-31 12:17:22 -05:00
GitHub Actions Bot
bdc100a6c1 Next development version 4.0.0-SNAPSHOT 2023-05-25 11:30:37 +00:00
GitHub Actions Bot
251e1fb998 Release 4.0.0-M2 2023-05-25 11:30:19 +00:00
Christian Tzolov
7f33eabb84 Factor out the Debezium Engine Builder auto-configuration (#459)
* Factor out the Debezium Engine Builder auto-configuration

 - Rename DebeziumEngineAutoConfiguration into DebeziumEngineBuilderAutoConfiguration.
 - Make the DebeziumEngineBuilderAutoConfiguration auto-create a DebeizumEngine.Builder instance.
 - Move the DebeizumEngine bean creation to the DebeziumReactiveConsumerConfiguration.
 - Make DebeziumEngineBuilderAutoConfiguration conditional on Debeizum connecgtor on the class path and debezium.properties.connector.class property set.
 - Minor improvment on the serialization format class resolution.
 - Add support for debezium header serialization format, required for the change event headers to work.

 Resolves #458
2023-05-24 16:03:18 -05:00
Christian Tzolov
4bc5b5647f Document how to configure debezium offsets (#457)
* Document how to configure debezium offsets

 Resolves #321

* clarify the custom offset storage approach
2023-05-24 09:40:39 -04:00
Corneil du Plessis
bafa7b2133 Fix repositories 2023-05-04 16:19:16 +02:00
Christian Tzolov
6cf66ec779 Refactor CDC Debezium Source
- Add AVRO format support. Defaults to JSON
 - Remove the Metadata repo configuration.
 - Remove the Spring property sort-cuts. Only the native Debezium properties are used.
 - change the native properties prefix from `cdc.config to cdc.debezium`.
 - Removes the need to fork and modify the Debezium engine code.
 - Add binding name strategy.

Remove old CDC projects and replace with the new implementation
Remove duplicate pom properties
remove non existing pom module
Rename `cdc-debezium-supplier/source` to `debezium-supplier/source`
streamline naming and tests
streamline supplier tests
test streamline. Github workflow
Fix Debezium engine generics mess
Break `DebeziumConfiguration` into engine auto-config and consumer configuration
add initial reactive consumer impl.
Splits Debezium into a pure supplier and a streaming source

  - Remove any SCS related dependencies from the supplier.
  - Supplier uses Sinks.Many.

complete the supplier vs source separation
Improve Debezium Egine auto-conf

 - Provide configuration hooks for OffsetCommitPolicy, ConnectorCallback,
   CompletionCallback and Clock with default implementations.
 - Remove obsolete code.

minor improvements
Rename cdc property prefix to `debezium` and `cdc.debezium` to `debezium.inner`
remove obsolete `StreamBridge` tests
address reviews. improve testing
Supplier tests. Rename `inner` to `properties`.
Streamline the README. Minor improvements
streamline supplier tests
final fixes
2023-05-02 16:07:28 -04:00