150 Commits

Author SHA1 Message Date
Artem Bilan
69dade53de Add channel to the WebsocketConsumerServerHandler.CHANNELS before handshake
In attempt to fix a race condition in the tests

* Remove `log4j` deps as redundant: Spring Boot brings them anyway for logback compatibility
* Add `logback-test.xml` to the `spring-websocket-consumer.test` for test race condition failures
2024-10-16 10:52:06 -04:00
Artem Bilan
daa54a6dec Use Dependabot globstar option for dirs to scan
Move some deps from the top-level `dependencies.gradle` to their specific modules
2024-10-10 11:40:59 -04:00
Artem Bilan
af672f3374 Adjust timing for the WebsocketConsumerTests 2024-10-03 12:07:32 -04:00
Artem Bilan
ccfcf567cd Fix Checkstyle SyslogSupplierProperties & Encoding 2024-06-10 11:00:13 -04:00
Artem Bilan
ee398691d4 Fix Checkstyle violations in DebeziumProperties 2024-06-10 10:52:58 -04:00
Artem Bilan
38055fab7d Remove redundant semicolon in FileReadingMode 2024-06-10 10:29:39 -04:00
Artem Bilan
77112eb8a1 Clean up README files, fix typos and broken links 2024-03-20 15:57:35 -04:00
Artem Bilan
e4a0073e6f GH-41: Add software.amazon.awssdk:sts dep to AWS S3 common
Fixes: #41
2024-03-07 17:21:37 -05:00
Artem Bilan
5721870bb7 GH-8: Debezium auto-config: always use Json for headers format (#34)
Fixes: #8

It really does not make sense to keep headers in the `byte[]`, when typically all of them are strings.

* Change `DebeziumEngineBuilderAutoConfiguration` to always use `Json.class` for headers
* Remove `DebeziumProperties.headerFormat` respectively.
2024-02-26 09:10:09 -06:00
Chris Bono
0f65110e89 Remove Tensorflow modules
This commit removes the following Tensorflow 1.0 related modules:

- spring-tensorflow-common
- spring-image-recognition-function
- spring-object-detection-function
- spring-semantic-segmentation-function

These may be resurrected at a later date but re-implemented with
either DeepJavaLibrary or TensorFlow 2.0.

* Remove Tensorflow modules from README.adoc

* Remove protobuf - was only used by Tensorflow
2024-01-16 17:02:49 -05:00
Artem Bilan
76e7ed1b69 Make TCP modules as auto-config
* Fix their Checkstyle violations
2024-01-05 15:11:55 -05:00
Artem Bilan
e1a1845dab Various improvements for MQTT modules code style 2024-01-05 14:05:59 -05:00
Artem Bilan
fbe0d220f7 Make MQTT modules as auto-config
* Fix all the Checkstyle violations for those modules
* Introduce a `MosquittoContainerTest` contract into the `spring-function-test-support`
and use it in the MQTT modules
* Fix READMEs for previously migrated modules to auto-configuration
2024-01-05 13:57:55 -05:00
Artem Bilan
3f349ca451 Make file and FTP modules as auto-config
* Fix all the Checkstyle violations for those modules
2024-01-05 12:48:09 -05:00
Artem Bilan
d59c25fb41 Fix metadata auto-config for optional SC-AWS dep 2024-01-04 16:56:27 -05:00
Artem Bilan
0ea8b8afa0 Fix Checkstyle violations for spring-metadata-store-common
* Move `org.apache.curator:curator-test` to the `dependencies.gradle`
and include it into a `dev` group for Dependabot
2024-01-04 16:50:39 -05:00
Artem Bilan
bf35cee6fc Fix Checkstyle violations for spring-function-test-support 2024-01-04 16:37:18 -05:00
Artem Bilan
de6a659ab1 Make Twitter modules as auto-configuration
* Fix all the Checkstyle violation in the effected modules
* Fix Twitter modules READMEs to reflect a nature of the auto-configuration
* Add (and mention in README) new `enabled` properties for various Twitter supplier configurations:
by default all of them would be started just by the presence in classpath
2024-01-04 16:14:16 -05:00
Artem Bilan
eb4ce0615a Upgrade to Debezium 2.5.0.Final
* Fix all the Checkstyle violations in Debezium modules
* Fix developer emails in the `publish-maven.gradle`
2024-01-04 13:27:08 -05:00
Artem Bilan
7b9bd3f3a9 Make XMPP functions as auto-config
* Fix all the Checkstyle violations for those modules
2024-01-03 17:13:51 -05:00
Artem Bilan
8e64a131f7 Add updateCopyrights Gradle task
* Fix Checkstyle violations for `spring-config-common` and `spring-aggregator-function`
2024-01-03 14:46:20 -05:00
Chris Bono
836708f0f2 GH-7: Add checkstyle and javaformat plugins
Fixes: #7

* Run `./gradlew format`
* Updates from PR review suggestions
2024-01-03 10:40:42 -05:00
Chris Bono
84e732da08 Prefix function names with spring-
* Add `spring-` prefix to function names

Fixes: #9

This commit renames each sub-module in the common, consumer, function
and supplier groups with a prefix of `spring-`.

* Update README.adoc links to new prefixed names
2024-01-02 14:07:00 -05:00
Artem Bilan
5cfbbecb8b Adjust dependency management for Dependabot
* Add `com.github.spotbugs` plugin to avoid warnings about missed nullability annotations
* Make `TimeSupplierConfiguration` as an auto-configuration
* Add `io.debezium:debezium-bom` as the first one to let others override its deps versions
* Move `org.springframework.boot:spring-boot-dependencies` after `io.awspring.cloud:spring-cloud-aws-dependencies`
to override its deps versions (e.g. `jakarta.mail` `1.0.0` > `2.0.2`)
2023-12-23 12:42:44 -05:00
Artem Bilan
d20fb3e5fa Refactor version props to dependencies.gradle
This is what we need to satisfy Dependabot expectations
2023-12-22 17:04:19 -05:00
Artem Bilan
19f904eb66 Migrate project to Gradle
* Upgrade all the dependencies to the latest versions
* Fix some incompatibilities
* Fix some warnings
2023-11-23 15:45:29 -05:00
GitHub Actions Bot
180d4e55e8 Next development version 4.0.1-SNAPSHOT / 2022.0.1-SNAPSHOT 2023-10-27 21:14:16 -05:00
Artem Bilan
595f962128 Upgrade to latest SI-AWS for S3
* Fix `AwsS3SupplierConfiguration` to
serialize `S3Object` to JSON
2023-10-20 10:28:32 -04:00
Christian Tzolov
167bc78367 Upgrade debezium to 2.3.3.Final 2023-09-05 13:31:32 -04:00
GitHub Actions Bot
21079bdc54 Next development version 4.0.0-SNAPSHOT / 2022.0.0-SNAPSHOT 2023-07-21 12:40:45 +00:00
GitHub Actions Bot
4a595f2284 Release 4.0.0-RC2 / 2022.0.0-RC2 2023-07-21 12:40:08 +00:00
GitHub Actions Bot
c7548ae4e3 Next development version 4.0.0-SNAPSHOT / 2022.0.0-SNAPSHOT 2023-07-20 14:56:01 +00:00
GitHub Actions Bot
5eade0d669 Release 4.0.0-RC2 / 2022.0.0-RC2 2023-07-20 14:55:34 +00:00
Artem Bilan
1df9fd9ca5 Upgrade to AWS SDK v2
* Upgrade to Spring Integration AWS `3.0.1`
* Upgrade to Spring Cloud AWS `3.0.1`
* Use `spring-cloud-aws-dependencies` BOM to manage Spring Cloud AWS deps, as well as AWS SDK
* Remove `AmazonS3Properties` in favor of similar properties in the Spring Cloud AWS auto-configuration
* Remove `CompatibleStorageAmazonS3Configuration` in favor of its code migration to the single `AmazonS3Configuration`
* Fix `supplier`, `consumer`, `source` and `sink` for S3 to use API and programing model from the mentioned upgrades
* Add extra `dataflow-configuration-metadata` entries for the mentioned properties from the Spring Cloud AWS auto-configuration
* Regenerate README for `s3-source` and `s3-sink`
* Fix `metadata-store-common` to use the latest Spring Integration AWS for DynamoDB store impl

* * Fix `AmazonS3ConfigurationTests` for missed `AwsAutoConfiguration`
in an `ApplicationContextRunner` setup

* * Remove unused import in the `MetadataStoreAutoConfigurationTests`

* * Remove unused import in the `AbstractAwsS3ConsumerMockTests`
2023-07-19 09:36:09 -04:00
Corneil du Plessis
511900fed7 Update Spring versions. 2023-07-12 12:59:11 +02:00
Christian Tzolov
ca8228809a Upgrade Debezium to 2.3.0.Final
* address some review comments

* minor pom improvements

* undo Debezium BOM
2023-06-27 12:58:27 -04:00
Corneil du Plessis
5efe5d17e1 Limits tests to single thread 2023-06-19 13:26:13 +02:00
GitHub Actions Bot
bcdb881fac Next development version 4.0.0-SNAPSHOT 2023-06-14 04:47:46 +00:00
GitHub Actions Bot
358be92abd Release 4.0.0-RC1 2023-06-14 04:47:29 +00:00
Christian Tzolov
af1548f41c Update Debezium to 2.3.0.CR1 (#480) 2023-06-13 17:12:47 -05:00
Corneil du Plessis
0c0673552a Restore change for Mongo Tests. 2023-06-08 23:56:57 +02:00
Corneil du Plessis
1828a1677b [CI] Fix test support 2023-06-08 23:56:48 +02:00
Corneil du Plessis
1cdb6e3945 [Revert] Spring Boot to 3.0.7 2023-06-08 18:56:41 +02:00
Corneil du Plessis
a54d602d5c [Update] Spring Boot to 3.1.0 2023-06-08 18:47:25 +02:00
Christian Tzolov
6a34291c5a Move Debezium builder into standalone function common project (#463)
- Move the `DebeziumEngineBuilderAutoConfiguration` and META-INF configurations to new function project: debezium-autoconfigure.
 - Introduce the `EmbeddedEngineExecutorService` helper class for help DebezuimEngine implementations.
 - Move the relevant tests from debezium-supplier to the debeizum-autoconfigure.
 - Add detailed README documentation.
 - Adjust the debeizum-supplier and debezium-source configurations.
 - Clean the related tests.

 Resolves #462


---------

Co-authored-by: Artem Bilan <abilan@vmware.com>
2023-06-04 10:58:12 -05:00
GitHub Actions Bot
e52419e35b Next development version 4.0.0-SNAPSHOT 2023-05-25 11:30:37 +00:00
GitHub Actions Bot
17288d84b8 Release 4.0.0-M2 2023-05-25 11:30:19 +00:00
Christian Tzolov
648d81a8c6 Refactor CDC Debezium Source
- Add AVRO format support. Defaults to JSON
 - Remove the Metadata repo configuration.
 - Remove the Spring property sort-cuts. Only the native Debezium properties are used.
 - change the native properties prefix from `cdc.config to cdc.debezium`.
 - Removes the need to fork and modify the Debezium engine code.
 - Add binding name strategy.

Remove old CDC projects and replace with the new implementation
Remove duplicate pom properties
remove non existing pom module
Rename `cdc-debezium-supplier/source` to `debezium-supplier/source`
streamline naming and tests
streamline supplier tests
test streamline. Github workflow
Fix Debezium engine generics mess
Break `DebeziumConfiguration` into engine auto-config and consumer configuration
add initial reactive consumer impl.
Splits Debezium into a pure supplier and a streaming source

  - Remove any SCS related dependencies from the supplier.
  - Supplier uses Sinks.Many.

complete the supplier vs source separation
Improve Debezium Egine auto-conf

 - Provide configuration hooks for OffsetCommitPolicy, ConnectorCallback,
   CompletionCallback and Clock with default implementations.
 - Remove obsolete code.

minor improvements
Rename cdc property prefix to `debezium` and `cdc.debezium` to `debezium.inner`
remove obsolete `StreamBridge` tests
address reviews. improve testing
Supplier tests. Rename `inner` to `properties`.
Streamline the README. Minor improvements
streamline supplier tests
final fixes
2023-05-02 16:07:28 -04:00
Corneil du Plessis
a95bfaf10d Revert deploy-plugin to 2.8.2 for stream-applications-descriptor 2023-04-21 11:07:43 +02:00
Corneil du Plessis
b5c9652946 Upodated aggregator RedisMessageStoreAggregatorTests to use RedisTestContainerSupport. 2023-01-11 16:20:14 +02:00