Commit Graph

246 Commits

Author SHA1 Message Date
Soby Chacko
a1362d5455 Version cleanup.
Removing spring-cloud-dependencies from apps.
2020-10-15 16:00:23 -04:00
David Turanski
73a302f5fe Upgrade Doc plugin and generate READMEs 2020-10-15 15:22:00 -04:00
Christian Tzolov
52cd4859f7 Revert to SNAPSHOT app generator maven version 2020-10-15 13:39:33 +02:00
Soby Chacko
d90ed61a3c Add missing dependency versions 2020-10-14 22:20:56 -04:00
Soby Chacko
222edbafd0 Maven property cleanup 2020-10-14 21:55:38 -04:00
Soby Chacko
2bb8e732d7 More restructuring
- Move stream-applications-build to release-train
 - Create a common parent for both apps and functions as stream-applications-build
2020-10-14 19:40:09 -04:00
Soby Chacko
0cdce97e98 More restructuring and cleanup
Move stream-applications-build to top level release-train folder

Add build folder to .gitignore
2020-10-14 15:04:50 -04:00
David Turanski
b5a753d90a Add Maven flatten plugin 2020-10-14 11:18:58 -04:00
Christian Tzolov
cf0c2c8784 Upgrade prometheus-rsocket.version to 1.2.1 2020-10-14 14:23:29 +02:00
Soby Chacko
760683cc2a Restructuing with maven revision feature
Preserving the maven revision feature from the previous commit,
but perform a bit more restructuring the hierarchy.
2020-10-13 15:17:52 -04:00
Daniel Frey
5e9382c23a Refactor hardcoded versions in functions submodule branches
This is so they can be updated in a minimal amount of places and leverage the maven hierarchy to propagate them where appropriate.
While working with SNAPSHOT releases of Spring Boot, Spring Integration, and Spring Cloud, it required touching every pom.xml file
in order to reflect the use of the SNAPSHOT. After this change, it will only be required to change the property in the top
functions pom.xml and the versions will reflect to all submodules.

Maven introduced the ability use a key property, revision to propagate this information to the <parent> declarations in each pom.

This was enabled in Maven 3.5+
https://maven.apache.org/maven-ci-friendly.html
2020-10-13 15:15:59 -04:00
David Turanski
6645b390e8 Avoid timeout when attemting to connect to AWS 2020-10-11 11:30:04 -04:00
David Turanski
a6ed4f3132 Disable Docker on skipTests 2020-10-11 11:00:30 -04:00
David Turanski
f286ced1a0 Upgrade apps to 3.0.0-SNAPSHOT 2020-10-11 10:43:16 -04:00
Soby Chacko
221ff6d7e7 Elasticsearch consumer/sink
* Elasticsearch consumer
 * Elasicsearch sink based on the consumer
 * Adding tests to verify
2020-10-09 11:35:24 -04:00
Soby Chacko
9a23be8e78 Upgrade SI AWS to 2.3.3 2020-10-06 13:14:01 -04:00
Soby Chacko
13aa71928a Update SI hazelcast version to 2.0.0.RELEASE 2020-10-06 13:12:36 -04:00
Christian Tzolov
9b814dee3b Remove kafkaNullConverter form cdc source test fixture 2020-09-30 16:56:59 +02:00
Soby Chacko
66def9d0b7 Update README on top 2020-09-29 18:52:02 -04:00
Soby Chacko
f257f48f78 Next version updates
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Next:2020.0.0-SNAPSHOT
2020-09-29 18:28:20 -04:00
Soby Chacko
ac7ae7ad84 Adding docs metadata 2020-09-29 17:56:43 -04:00
Soby Chacko
d1816d236d Aggregating docs/descriptors : Release - 2020.0.0-M3 2020-09-29 17:29:03 -04:00
Soby Chacko
d2a41a6c8a Metadata updates for newly added apps 2020-09-29 17:27:43 -04:00
Soby Chacko
7965e04af1 Applications: Release - 3.0.0-M3 2020-09-29 16:21:55 -04:00
Soby Chacko
43aa44a151 Dependency updates 2020-09-29 16:13:39 -04:00
Soby Chacko
5dc1fc0ada Stream Applications Core: Release - 3.0.0-M3 2020-09-29 15:47:16 -04:00
Soby Chacko
def034e2db Update plugins to 1.0.0-M1 2020-09-29 15:45:05 -04:00
Soby Chacko
73a3e55299 Functions: Release - 1.0.0-M3 2020-09-29 14:59:33 -04:00
Soby Chacko
2ba043e001 Updates
Spring Boot -> 2.3.4.RELEASE
Spring Cloud Stream -> 3.0.9.BUILD-SNAPSHOT
2020-09-29 14:53:45 -04:00
Soby Chacko
40df881d05 Cleaning up - pgcopy sink apps 2020-09-28 18:18:31 -04:00
Soby Chacko
3ce5f50cf9 RSocket consumer/sink
* This RSocket consumer is using the fire-and-forget strategy of execution.
* Generating the corresponding sink.
* Addressing the original PR review comments from
  https://github.com/spring-cloud/stream-applications/pull/116

* Addressing PR review comments

* Fix README

* Addressing PR review
2020-09-28 16:28:09 -04:00
David Turanski
8143c63190 Fix S3 consumer dependencies 2020-09-28 08:22:41 -04:00
David Turanski
4048221f1e Fix race condition and other errors in S3Supplier 2020-09-25 18:20:16 -04:00
David Turanski
6c69d06bc9 Add spring-integration-bom to app dependencyManagement 2020-09-25 14:59:40 -04:00
Artem Bilan
696ebca135 Defer subscription to the S3 until downstream one
It turns out that endpoint for S3 Source is starting to
consume the `Flux` earlier than an actual subscription
happens for the whole flow downstream

* Introduce a `MonoProcessor<Subscription> downstreamSubscription`
to fulfill from the downstream subscription and handle from the
`delaySubscription()` on the `Flux` for source data
2020-09-25 13:28:18 -04:00
David Turanski
3bb3c0b6a1 Upgate Spring Integration dependencies 2020-09-24 13:09:48 -04:00
David Turanski
3e3b770742 Enhance FunctionBindingEnvironmentPostProcessor to handle quotes in function definition 2020-09-24 11:30:15 -04:00
David Turanski
c2b778fd3b Fix TimeSourceTests 2020-09-22 15:06:34 -04:00
Christian Tzolov
d42d6fdc3a Set apps baseImage global to springcloud/baseimage:1.0.0 2020-09-22 11:43:21 +02:00
David Turanski
02ade7ae25 Add list-only to README 2020-09-21 13:47:06 -04:00
Soby Chacko
a7a37950e9 Migrating pgcopy-sink
* pgcopy-sink is migrated from Spring Cloud Stream App Starters repository.
 * This is not converted as a function, rather preserved as a sink app.
 * Old location: https://github.com/spring-cloud-stream-app-starters/jdbc/tree/master/spring-cloud-starter-stream-sink-pgcopy
2020-09-18 20:05:03 -04:00
David Turanski
ddcc10363e List only enhancements
* Add metadata.store.type Property and idempotent SftpSupplier for list-only

* Implement list-only for S3 source and Optimize metadastore access

* Fixed build and READMEs

* Change to ConditionalOnProperty

* Change to ReactiveMessageProducer

* Update cdc-debezium-source/README.adoc

* Make all MetadataStoreProperties visible
2020-09-17 15:36:36 -04:00
Soby Chacko
0378f7d3a0 Migrating Mail Source
* Mail supplier for receiving email from a URL (IMAP/POP3)
 * Generating mail source apps
 * Migrating tests

* Addressing PR review comments

* Addressing PR review comments
2020-09-17 15:18:59 -04:00
David Turanski
f7efc39164 Remove SplitterFunction autoconfiguration for sources 2020-09-14 14:00:52 -04:00
David Turanski
d5d437ec04 Add composite function support to S3 source 2020-09-14 12:56:25 -04:00
David Turanski
fd5cadc60d Add use-path-style-access to AmazonS3Properties 2020-09-09 18:26:20 -04:00
David Turanski
7dacd25a60 Fix s3 READMEs 2020-09-08 09:31:47 -04:00
David Turanski
53369a2af2 Geode test container will not start locator by default 2020-09-07 13:21:27 -04:00
David Turanski
d920b8cb27 Replace deprecated code 2020-09-04 09:54:52 -04:00
Christian Tzolov
f67cdb1237 Fix application tables 2020-09-02 20:56:53 +02:00