Commit Graph

171 Commits

Author SHA1 Message Date
Soby Chacko
2a0edea722 Fixing TCP Source issues
Exclude `IpHeaders.LOCAL_ADDRESS` from TCP source output as it
causes issues with message conversion downstream.

Update SCSt/Spring-Cloud to the latest snapshots.

* Refactor `TcpSupplierConfiguration` for better readability and
current state of requirements for Spring libraries configuration
2021-03-30 09:00:21 -04:00
Thomas Recloux
126c53e8ad GH-151: Remove output bean from the Rabbit Supplier
Fixes https://github.com/spring-cloud/stream-applications/issues/151

The `RabbitSupplierConfiguration` comes with the `output` bean definition which
clashes with the `output` binding for Spring Cloud Stream.
The last one doesn't register the binding bean and leave the rest of the logic
to deal with existing bean when we resolve it by the `output` name.

* Rework the logic of the `RabbitSupplierConfiguration` to avoid an extra bean
in between and the binding in Spring Cloud Stream do it job
2021-03-10 13:09:12 -05:00
Artem Bilan
4eb34fb245 GH-154: Change FORM CT to JSON for HTTP supplier
Fixes https://github.com/spring-cloud/stream-applications/issues/154

The Binder conversion mechanism is not aware about a `MediaType.APPLICATION_FORM_URLENCODED`
and does not know how to convert the `MultiValueMap` with such a content-type

* Change the Http-Supplier to replace a `MediaType.APPLICATION_FORM_URLENCODED`
content-type header to the `MediaType.APPLICATION_JSON` for the proper
JSON serialization for the `MultiValueMap` on the binder level before sending to
the output destination
2021-03-09 11:49:08 -05:00
Nicolas Labrot
c899e71a64 GH-152: RabbitMQ consumer: Add headersMappedLast
Fixes https://github.com/spring-cloud/stream-applications/issues/152

* Add the possibilities to configure the `headersMappedLast` for the RabbitMQ consumer

* Changes following the code review
2021-02-26 17:00:36 -05:00
Soby Chacko
fa58243b31 Next version updates (non-apps) 2021-02-26 15:25:26 -05:00
Soby Chacko
eceda16e0a Functions 1.0.2 Release 2021-02-25 15:34:54 -05:00
David Turanski
f1d9f36dee Tag integration tests and enable integration profile 2021-02-22 14:09:22 -05:00
Artem Bilan
386dad6562 Use compatible image version with Debezium
* Fix MongoDb driver problem.
Probably we need to think about upgrading Debezium support to the latest
version, so its MongoDb connector is based on the latest Mongo Driver
which already is pulled by Spring Boot
2021-02-19 12:31:34 -05:00
Soby Chacko
721c506891 Update dependencies
Spring Boot 2.3.9
Spring Kafka 2.5.11
Spring Cloud Stream - Horsham.SR11
Spring Cloud - Hoxon.SR10
Spring Cloud Function - 3.0.13
2021-02-18 16:09:25 -05:00
Soby Chacko
dc0e31e132 Update next versions 2021-02-18 15:49:23 -05:00
Soby Chacko
b986495332 Functions 1.0.1 Release 2021-02-18 14:31:44 -05:00
Artem Bilan
e2c11b4773 Upgrade Testcontainers tests to the latest images
* Un`@Disable` updated tests
2021-02-11 16:21:06 -05:00
Artem Bilan
d3c38406e8 Upgrade to the latest Testcontainers
* Use `debezium/example-mysql:latest` image in the `CdcBootStarterIntegrationTest`
to avoid failing when some transitive dependency does not exist any more
2021-02-11 11:08:12 -05:00
Soby Chacko
63c22a85d7 tests debugging continues 2021-02-10 14:26:24 -05:00
Artem Bilan
1e6a2e1f44 GH-143: Add an update option to MongoDB Supplier (#147)
* GH-143: Add an update option to MongoDB Supplier

Fixes https://github.com/spring-cloud/stream-applications/issues/143

* * Fix Checkstyle violations
* Update `README.adoc` for `mongodb-source`
2021-02-05 15:36:03 -05:00
Soby Chacko
fec91314b9 More checkstyle fixes 2021-02-05 11:36:33 -05:00
Soby Chacko
172e345c2d Fixing checkstyle issues 2021-02-05 11:16:45 -05:00
Soby Chacko
b15a798a78 Fix checkstyle issues 2021-02-05 10:45:23 -05:00
Artem Bilan
17162dd775 GH-146: SFTP supplier: Use proper FileListFilter
Fixes https://github.com/spring-cloud/stream-applications/issues/146

The `SftpRegexPatternFileListFilter` is used for the `filenamePattern` option, too.
It seems like a copy/paste artefact

* Change `filenamePattern`-based configuration for the `SftpSimplePatternFileListFilter`
* Fix `SftpSupplierApplicationTests` for multi-OS compatibility
2021-02-03 10:20:10 -05:00
Artem Bilan
70d89c7a3b GH-145: Some SFTP consumer props were not applied
Fixes https://github.com/spring-cloud/stream-applications/issues/145
2021-02-02 20:41:19 -05:00
Christian Tzolov
dd9a2f709d Fix cdc logging classpath issue
- Exclude a slf4j-log4j12 dependency inherited by slf4j-log4j12 that clashes with the spring boot logging.
2021-02-01 10:41:39 +01:00
Andrea Montemaggio
65f3b82d0b Introduce basic support for user-configurable sorting of the remote file list. 2021-01-14 10:57:43 -05:00
Soby Chacko
1aebb2abff Non application components next version update
stream-applications-build: 1.0.1-SNAPSHOT
functions: 1.0.1-SNAPSHOT
stream-applications-core: 3.0.2-SNAPSHOT
2020-12-16 13:06:52 -05:00
Soby Chacko
6c0e3b3167 Functions release: 1.0.0 2020-12-15 15:44:50 -05:00
Soby Chacko
c07aeeae13 remove unnecessary mvnw scripts from rabbit-supplier 2020-12-15 14:09:26 -05:00
Soby Chacko
26eeae18f0 Back to snapshot for non-apps components 2020-12-11 17:17:01 -05:00
Soby Chacko
af63c3fd09 Functions release: 1.0.0-RC2 2020-12-11 15:40:32 -05:00
Christian Tzolov
0d6c21b405 Analytics: prevent metrics duplication if multiple meter registries and the compositemeterregistry are present 2020-12-09 12:52:16 +01:00
Christian Tzolov
3f0bacfe7a Analytics: fix failing tests 2020-12-08 10:07:21 +01:00
Christian Tzolov
48b0f17489 Analytics: handle NPE condition 2020-12-08 09:53:46 +01:00
Christian Tzolov
ace860fb5e analticis: imprive handling for valueless tags 2020-12-07 22:22:16 +01:00
Soby Chacko
9a2ca148c8 Cleaning up repositories/pluginRepositories declarations 2020-12-07 16:04:07 -05:00
Christian Tzolov
18a29fd0fc Improve analytcs meter tas consistency 2020-12-07 13:25:58 +01:00
Christian Tzolov
a9692efc75 Fix CDC issues
- Fix cdc_key header string wrapping issue that causes problems with the spring.cloud.stream.kafka.default.producer.messageKeyExpression.
 - Rename Flattering property to the correct Flattening.
 - Remove wrong dependencies.
2020-12-04 19:50:45 +01:00
Andrea Montemaggio
7df5cc4971 Failing tests: fixed assertions on indexed content.
Fixed handling of String and Map payloads while building IndexRequest.

The wrong overload of IndexRequest.source was called, which caused the message payload to be used as the key of the two-fields document {<payload>: "JSON"}.
2020-12-02 15:35:15 -05:00
Soby Chacko
71772933d2 Back to snapshot for non-apps components 2020-11-24 15:39:43 -05:00
Soby Chacko
7d28373480 Functions release: 1.0.0-RC1 2020-11-24 12:33:06 -05:00
Soby Chacko
97244ee9b8 Add missing repoistory declarations.
README cleanup.
2020-11-23 18:04:05 -05:00
Soby Chacko
cb1474f03a Next update versions for 2020.0.0-SNAPSHOT 2020-11-13 13:06:27 -05:00
Soby Chacko
8ea7d67f02 Functions 1.0.0-M4 Release 2020-11-12 15:00:34 -05:00
David Turanski
426e058ad1 Increase timeouts on SftpSupplierApplicationTests 2020-11-10 14:11:57 -05:00
David Turanski
236ef55863 Upgrade Testcontainers, Debezium, and fix exceptions in MailSupplierTests 2020-11-06 12:32:33 -05:00
David Turanski
4707cbbbf2 Upgrade AWS S3 dependencies 2020-10-30 09:37:53 -04:00
David Turanski
5e0f24a8ee Refactored debezium tests to use TestContainers 2020-10-28 16:32:28 -04:00
Soby Chacko
1118a2a7cf Add json-path as a dependency to functions 2020-10-23 11:28:17 -04:00
Soby Chacko
2bb8e732d7 More restructuring
- Move stream-applications-build to release-train
 - Create a common parent for both apps and functions as stream-applications-build
2020-10-14 19:40:09 -04:00
David Turanski
b5a753d90a Add Maven flatten plugin 2020-10-14 11:18:58 -04:00
Soby Chacko
760683cc2a Restructuing with maven revision feature
Preserving the maven revision feature from the previous commit,
but perform a bit more restructuring the hierarchy.
2020-10-13 15:17:52 -04:00
Daniel Frey
5e9382c23a Refactor hardcoded versions in functions submodule branches
This is so they can be updated in a minimal amount of places and leverage the maven hierarchy to propagate them where appropriate.
While working with SNAPSHOT releases of Spring Boot, Spring Integration, and Spring Cloud, it required touching every pom.xml file
in order to reflect the use of the SNAPSHOT. After this change, it will only be required to change the property in the top
functions pom.xml and the versions will reflect to all submodules.

Maven introduced the ability use a key property, revision to propagate this information to the <parent> declarations in each pom.

This was enabled in Maven 3.5+
https://maven.apache.org/maven-ci-friendly.html
2020-10-13 15:15:59 -04:00
David Turanski
6645b390e8 Avoid timeout when attemting to connect to AWS 2020-10-11 11:30:04 -04:00