SpringCloud/stream-applications
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
335 Commits 10 Branches 0 Tags
1aebb2abffcc25efe1f417ffd7844ba094ff41bb
Commit Graph

50 Commits

Author SHA1 Message Date
Christian Tzolov
a9692efc75 Fix CDC issues 
- Fix cdc_key header string wrapping issue that causes problems with the spring.cloud.stream.kafka.default.producer.messageKeyExpression.
 - Rename Flattering property to the correct Flattening.
 - Remove wrong dependencies.
 2020-12-04 19:50:45 +01:00
David Turanski
236ef55863 Upgrade Testcontainers, Debezium, and fix exceptions in MailSupplierTests 2020-11-06 12:32:33 -05:00
David Turanski
4707cbbbf2 Upgrade AWS S3 dependencies 2020-10-30 09:37:53 -04:00
David Turanski
5e0f24a8ee Refactored debezium tests to use TestContainers 2020-10-28 16:32:28 -04:00
Soby Chacko
760683cc2a Restructuing with maven revision feature 
Preserving the maven revision feature from the previous commit,
but perform a bit more restructuring the hierarchy.
 2020-10-13 15:17:52 -04:00
Daniel Frey
5e9382c23a Refactor hardcoded versions in functions submodule branches 
This is so they can be updated in a minimal amount of places and leverage the maven hierarchy to propagate them where appropriate.
While working with SNAPSHOT releases of Spring Boot, Spring Integration, and Spring Cloud, it required touching every pom.xml file
in order to reflect the use of the SNAPSHOT. After this change, it will only be required to change the property in the top
functions pom.xml and the versions will reflect to all submodules.

Maven introduced the ability use a key property, revision to propagate this information to the <parent> declarations in each pom.

This was enabled in Maven 3.5+
https://maven.apache.org/maven-ci-friendly.html
 2020-10-13 15:15:59 -04:00
David Turanski
6645b390e8 Avoid timeout when attemting to connect to AWS 2020-10-11 11:30:04 -04:00
Soby Chacko
9a23be8e78 Upgrade SI AWS to 2.3.3 2020-10-06 13:14:01 -04:00
Soby Chacko
13aa71928a Update SI hazelcast version to 2.0.0.RELEASE 2020-10-06 13:12:36 -04:00
Soby Chacko
f257f48f78 Next version updates 
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Next:2020.0.0-SNAPSHOT
 2020-09-29 18:28:20 -04:00
Soby Chacko
73a3e55299 Functions: Release - 1.0.0-M3 2020-09-29 14:59:33 -04:00
David Turanski
4048221f1e Fix race condition and other errors in S3Supplier 2020-09-25 18:20:16 -04:00
David Turanski
ddcc10363e List only enhancements 
* Add metadata.store.type Property and idempotent SftpSupplier for list-only

* Implement list-only for S3 source and Optimize metadastore access

* Fixed build and READMEs

* Change to ConditionalOnProperty

* Change to ReactiveMessageProducer

* Update cdc-debezium-source/README.adoc

* Make all MetadataStoreProperties visible
 2020-09-17 15:36:36 -04:00
David Turanski
fd5cadc60d Add use-path-style-access to AmazonS3Properties 2020-09-09 18:26:20 -04:00
David Turanski
7dacd25a60 Fix s3 READMEs 2020-09-08 09:31:47 -04:00
David Turanski
53369a2af2 Geode test container will not start locator by default 2020-09-07 13:21:27 -04:00
David Turanski
d920b8cb27 Replace deprecated code 2020-09-04 09:54:52 -04:00
Christian Tzolov
02a14b31e6 Fix cdc tests 2020-08-16 22:07:28 +02:00
Soby Chacko
9e3c1caaf2 Fixing test 2020-08-13 16:05:32 -04:00
Christian Tzolov
8ab33a195d CDC Debezium Supplier, Source Boot Starter 
- Add supplier, source and boot auto-config.
 - Add work around for KafkaNull handling.
 - Update CDC to 1.2.1.Final. Replace the deprecated properties.

remove comments

Add missing metadata configuration. Improve README docs.

CDC: add all metadata for doc auto-generation

Remove custom KafkaNullConverter.

  - The fixed KafkaNullConverter implementation comes with kafka binder 3.0.8-BUILD-SNAPSHOT or newer.

Add repositories to maven config in app generation project.

Remove the unnecessary function version in maven plugin configuration for app generation.
 2020-08-13 15:41:25 -04:00
David Turanski
562aa5c990 Fix function definition property (#91) 
* Remove deprecated spring.cloud.stream.function.definition property

* Restore tasklauncher-function

Co-authored-by: David Turanski <dturanski@pivotal.io>
 2020-07-20 18:23:30 -04:00
Soby Chacko
d59e4f5d86 Next version updates 
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Next:2020.0.0-SNAPSHOT
 2020-07-13 16:02:05 -04:00
Soby Chacko
7066283aa2 Functions: Release - 1.0.0-M2 2020-07-13 14:43:36 -04:00
Christian Tzolov
570877c9b9 Cleann the tensorflow-common dependencies 2020-07-09 14:09:51 +02:00
Timo Salm
c397df191b GH-75: add EnvPP for CS-AWS exclusion 
Fixes https://github.com/spring-cloud/stream-applications/issues/75
 2020-07-08 11:33:13 -04:00
Timo Salm
c21533e42c Support for s3 compatible storage 
* Add support for s3 compatible storage to s3 consumer and supplier.

* Add enhancements to s3 compatible storage implementation based on code review

* Move s3 compatible storage endpoint configuration bean to AmazonS3Configuration to remove code duplication

* Disable auto configuration of AmazonS3 Bean to enable custom configurations

* Add documentation for endpoint url configuration property

* Use localhost instead of a real URL to avoid an unexpected connection to the internet
 2020-07-07 14:27:31 -04:00
David Turanski
8cc6f546b6 Implement SFTP Source 
Address review comments

* Code style clean up - generics warnings
* Fix `SftpSupplierApplicationTests` for compatibility with Windows
 2020-07-01 15:35:27 -04:00
Christian Tzolov
6df0d71db1 Improve analytic sink documentation 2020-06-30 11:17:41 +02:00
Christian Tzolov
5fb9aa97c4 Remove twitter SpEL converter in favor of config-common 2020-06-30 00:40:11 +02:00
Christian Tzolov
d493fefd19 rename couner (consumer|sink) to analytics (consumer|sink). Remove the custom SpEL convert in favor of config-common 2020-06-30 00:13:08 +02:00
Soby Chacko
5c59ff6823 Next version updates 
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Build: 2020.0.0-SNAPSHOT
 2020-06-26 13:49:35 -04:00
Soby Chacko
327641fb05 Functions: Release - 1.0.0-M1 2020-06-25 17:42:02 -04:00
Christian Tzolov
bc0cc2ae4b tensorflow common readme fix 2020-06-25 14:55:30 +02:00
Christian Tzolov
e2932661dd semantic segmentation processor 2020-06-25 12:41:39 +02:00
Christian Tzolov
ebe05bc315 Tensorflow functions and applications 
* initial step
 * Tensorflow models functional model redesign

      -- Based on https://tzolov.github.io/mind-model-services
      -- Resolves #5

 * Add object detection processor README
 * Add image recognition processor README
 * Initial Tensorflow commonn README
 * Initial Tensorflow commonn README
 * Tensorflow common diagram
 * Tensorflow docs code
 * Tensorflow docs code snippets improve
 * Tensorflow docs code snippets improve
 * Tensorflow docs code snippets improve
 * Tensorflow docs code snippets improve
 * Add semantic segmentation function. add object detecteion function readme
 * oo images
 * Furether oo readme improvments
 * Final obj detection readme fixes
 * Add image recognition readme
 * Add image recognition readme 2
 * Semantic segmentation readme
 * Segmentation readme
 * Semantic segmentation readme 3
 * Fix image recognition and object detcion app starter dependecies

 * Add metadata for Tensorflow apps
 2020-06-24 18:37:03 -04:00
Christian Tzolov
052f86cf91 Port in the Geo and Users twitter function. Fix issue with handling SpEL expression porperties in the twitter functions. 2020-06-24 12:58:47 +02:00
Christian Tzolov
9792768d55 Address twitter review suggestions 2020-06-24 09:58:26 +02:00
Christian Tzolov
873f17414e Twitter functional apps 
* Streaming source
* Add twitter search and messasge sources
* Add more twitter source, sink and processors
* Add IT tests for twitter update sink
* Add IT tests for twitter message sink
* Add IT tests for twitter trend processor
* twitter suppliers readme
* twitter consumers readme
* twitter functions readme
* Disable TwitterStreamSourceTests
 2020-06-23 14:48:34 -04:00
Soby Chacko
cffbe2fa56 FTP supplier/source 
AWS S3 apps migration

s3-supplier/s3-source
s3-consumer/s3-sink

Fix merge conflicts

Addressing PR review comments

Rebasing

Add ConditionalOnMissingClass to Spel converter config

Test cleanup

* Fix `AwsS3SourceTests` to properly mock before starting endpoint
 2020-06-18 17:06:58 -04:00
David Turanski
cd990fc28e Fix condition on SpelExpressionConverterConfiguration 2020-06-17 12:34:07 -04:00
Soby Chacko
273b1af03c Websocket supplier/consumer - source/sink 2020-06-16 15:37:38 -04:00
Soby Chacko
50660a884e FTP supplier/source 
* Addressing PR review comments
 2020-06-16 15:31:22 -04:00
David Turanski
b61f9ad35a Fix Dockerfile 2020-06-04 09:15:17 -04:00
David Turanski
af2d303190 Implement geode-supplier and geode-source along with common config and test support 
Implement geodeCqSupplier

Implement Geode CQ Source

Implement Geode Sink

Removed @TestInstance

Combine CQ Source and Source

Clean up per review

Update README

Fix Javadoc
 2020-06-03 16:05:28 -04:00
David Turanski
89d1d1d5bf Add ConditionalOnMissingBean to fix bean override error 2020-05-29 16:52:15 -04:00
David Turanski
ce19c437fb Add common Expression to String Converter (#50) 
* Add common Expression to String Converter

Co-authored-by: David Turanski <dturanski@pivotal.io>
 2020-05-29 14:51:45 -04:00
Soby Chacko
dfeef686b3 MQTT source as supplier/source 
Resolves https://github.com/spring-cloud/stream-applications/issues/38
 2020-05-19 14:25:33 -04:00
Soby Chacko
12fb2cfd46 TCP Supplier/Source 
Resolves https://github.com/spring-cloud/stream-applications/issues/43
 2020-05-18 14:32:22 -04:00
Soby Chacko
5ba3d7ac66 SFTP Consumer/Sink 
Resolves https://github.com/spring-cloud/stream-applications/issues/32
 2020-05-13 16:12:23 -04:00
Soby Chacko
566d411a61 Ftp consumer/sink 
Resolves https://github.com/spring-cloud/stream-applications/issues/28
 2020-05-13 16:05:52 -04:00