Commit Graph

160 Commits

Author SHA1 Message Date
Artem Bilan
e2c11b4773 Upgrade Testcontainers tests to the latest images
* Un`@Disable` updated tests
2021-02-11 16:21:06 -05:00
Artem Bilan
d3c38406e8 Upgrade to the latest Testcontainers
* Use `debezium/example-mysql:latest` image in the `CdcBootStarterIntegrationTest`
to avoid failing when some transitive dependency does not exist any more
2021-02-11 11:08:12 -05:00
Soby Chacko
63c22a85d7 tests debugging continues 2021-02-10 14:26:24 -05:00
Artem Bilan
1e6a2e1f44 GH-143: Add an update option to MongoDB Supplier (#147)
* GH-143: Add an update option to MongoDB Supplier

Fixes https://github.com/spring-cloud/stream-applications/issues/143

* * Fix Checkstyle violations
* Update `README.adoc` for `mongodb-source`
2021-02-05 15:36:03 -05:00
Soby Chacko
fec91314b9 More checkstyle fixes 2021-02-05 11:36:33 -05:00
Soby Chacko
172e345c2d Fixing checkstyle issues 2021-02-05 11:16:45 -05:00
Soby Chacko
b15a798a78 Fix checkstyle issues 2021-02-05 10:45:23 -05:00
Artem Bilan
17162dd775 GH-146: SFTP supplier: Use proper FileListFilter
Fixes https://github.com/spring-cloud/stream-applications/issues/146

The `SftpRegexPatternFileListFilter` is used for the `filenamePattern` option, too.
It seems like a copy/paste artefact

* Change `filenamePattern`-based configuration for the `SftpSimplePatternFileListFilter`
* Fix `SftpSupplierApplicationTests` for multi-OS compatibility
2021-02-03 10:20:10 -05:00
Artem Bilan
70d89c7a3b GH-145: Some SFTP consumer props were not applied
Fixes https://github.com/spring-cloud/stream-applications/issues/145
2021-02-02 20:41:19 -05:00
Christian Tzolov
dd9a2f709d Fix cdc logging classpath issue
- Exclude a slf4j-log4j12 dependency inherited by slf4j-log4j12 that clashes with the spring boot logging.
2021-02-01 10:41:39 +01:00
Andrea Montemaggio
65f3b82d0b Introduce basic support for user-configurable sorting of the remote file list. 2021-01-14 10:57:43 -05:00
Soby Chacko
1aebb2abff Non application components next version update
stream-applications-build: 1.0.1-SNAPSHOT
functions: 1.0.1-SNAPSHOT
stream-applications-core: 3.0.2-SNAPSHOT
2020-12-16 13:06:52 -05:00
Soby Chacko
6c0e3b3167 Functions release: 1.0.0 2020-12-15 15:44:50 -05:00
Soby Chacko
c07aeeae13 remove unnecessary mvnw scripts from rabbit-supplier 2020-12-15 14:09:26 -05:00
Soby Chacko
26eeae18f0 Back to snapshot for non-apps components 2020-12-11 17:17:01 -05:00
Soby Chacko
af63c3fd09 Functions release: 1.0.0-RC2 2020-12-11 15:40:32 -05:00
Christian Tzolov
0d6c21b405 Analytics: prevent metrics duplication if multiple meter registries and the compositemeterregistry are present 2020-12-09 12:52:16 +01:00
Christian Tzolov
3f0bacfe7a Analytics: fix failing tests 2020-12-08 10:07:21 +01:00
Christian Tzolov
48b0f17489 Analytics: handle NPE condition 2020-12-08 09:53:46 +01:00
Christian Tzolov
ace860fb5e analticis: imprive handling for valueless tags 2020-12-07 22:22:16 +01:00
Soby Chacko
9a2ca148c8 Cleaning up repositories/pluginRepositories declarations 2020-12-07 16:04:07 -05:00
Christian Tzolov
18a29fd0fc Improve analytcs meter tas consistency 2020-12-07 13:25:58 +01:00
Christian Tzolov
a9692efc75 Fix CDC issues
- Fix cdc_key header string wrapping issue that causes problems with the spring.cloud.stream.kafka.default.producer.messageKeyExpression.
 - Rename Flattering property to the correct Flattening.
 - Remove wrong dependencies.
2020-12-04 19:50:45 +01:00
Andrea Montemaggio
7df5cc4971 Failing tests: fixed assertions on indexed content.
Fixed handling of String and Map payloads while building IndexRequest.

The wrong overload of IndexRequest.source was called, which caused the message payload to be used as the key of the two-fields document {<payload>: "JSON"}.
2020-12-02 15:35:15 -05:00
Soby Chacko
71772933d2 Back to snapshot for non-apps components 2020-11-24 15:39:43 -05:00
Soby Chacko
7d28373480 Functions release: 1.0.0-RC1 2020-11-24 12:33:06 -05:00
Soby Chacko
97244ee9b8 Add missing repoistory declarations.
README cleanup.
2020-11-23 18:04:05 -05:00
Soby Chacko
cb1474f03a Next update versions for 2020.0.0-SNAPSHOT 2020-11-13 13:06:27 -05:00
Soby Chacko
8ea7d67f02 Functions 1.0.0-M4 Release 2020-11-12 15:00:34 -05:00
David Turanski
426e058ad1 Increase timeouts on SftpSupplierApplicationTests 2020-11-10 14:11:57 -05:00
David Turanski
236ef55863 Upgrade Testcontainers, Debezium, and fix exceptions in MailSupplierTests 2020-11-06 12:32:33 -05:00
David Turanski
4707cbbbf2 Upgrade AWS S3 dependencies 2020-10-30 09:37:53 -04:00
David Turanski
5e0f24a8ee Refactored debezium tests to use TestContainers 2020-10-28 16:32:28 -04:00
Soby Chacko
1118a2a7cf Add json-path as a dependency to functions 2020-10-23 11:28:17 -04:00
Soby Chacko
2bb8e732d7 More restructuring
- Move stream-applications-build to release-train
 - Create a common parent for both apps and functions as stream-applications-build
2020-10-14 19:40:09 -04:00
David Turanski
b5a753d90a Add Maven flatten plugin 2020-10-14 11:18:58 -04:00
Soby Chacko
760683cc2a Restructuing with maven revision feature
Preserving the maven revision feature from the previous commit,
but perform a bit more restructuring the hierarchy.
2020-10-13 15:17:52 -04:00
Daniel Frey
5e9382c23a Refactor hardcoded versions in functions submodule branches
This is so they can be updated in a minimal amount of places and leverage the maven hierarchy to propagate them where appropriate.
While working with SNAPSHOT releases of Spring Boot, Spring Integration, and Spring Cloud, it required touching every pom.xml file
in order to reflect the use of the SNAPSHOT. After this change, it will only be required to change the property in the top
functions pom.xml and the versions will reflect to all submodules.

Maven introduced the ability use a key property, revision to propagate this information to the <parent> declarations in each pom.

This was enabled in Maven 3.5+
https://maven.apache.org/maven-ci-friendly.html
2020-10-13 15:15:59 -04:00
David Turanski
6645b390e8 Avoid timeout when attemting to connect to AWS 2020-10-11 11:30:04 -04:00
David Turanski
f286ced1a0 Upgrade apps to 3.0.0-SNAPSHOT 2020-10-11 10:43:16 -04:00
Soby Chacko
221ff6d7e7 Elasticsearch consumer/sink
* Elasticsearch consumer
 * Elasicsearch sink based on the consumer
 * Adding tests to verify
2020-10-09 11:35:24 -04:00
Soby Chacko
9a23be8e78 Upgrade SI AWS to 2.3.3 2020-10-06 13:14:01 -04:00
Soby Chacko
13aa71928a Update SI hazelcast version to 2.0.0.RELEASE 2020-10-06 13:12:36 -04:00
Soby Chacko
f257f48f78 Next version updates
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Next:2020.0.0-SNAPSHOT
2020-09-29 18:28:20 -04:00
Soby Chacko
73a3e55299 Functions: Release - 1.0.0-M3 2020-09-29 14:59:33 -04:00
Soby Chacko
2ba043e001 Updates
Spring Boot -> 2.3.4.RELEASE
Spring Cloud Stream -> 3.0.9.BUILD-SNAPSHOT
2020-09-29 14:53:45 -04:00
Soby Chacko
3ce5f50cf9 RSocket consumer/sink
* This RSocket consumer is using the fire-and-forget strategy of execution.
* Generating the corresponding sink.
* Addressing the original PR review comments from
  https://github.com/spring-cloud/stream-applications/pull/116

* Addressing PR review comments

* Fix README

* Addressing PR review
2020-09-28 16:28:09 -04:00
David Turanski
8143c63190 Fix S3 consumer dependencies 2020-09-28 08:22:41 -04:00
David Turanski
4048221f1e Fix race condition and other errors in S3Supplier 2020-09-25 18:20:16 -04:00
Artem Bilan
696ebca135 Defer subscription to the S3 until downstream one
It turns out that endpoint for S3 Source is starting to
consume the `Flux` earlier than an actual subscription
happens for the whole flow downstream

* Introduce a `MonoProcessor<Subscription> downstreamSubscription`
to fulfill from the downstream subscription and handle from the
`delaySubscription()` on the `Flux` for source data
2020-09-25 13:28:18 -04:00