Commit Graph

97 Commits

Author SHA1 Message Date
Artem Bilan
4463c1afb6 Add Aggregator function & processor
* Have all the required dependencies in class path which give us a `MessageGroupStore` implementation
* Disable all their auto-configurations in the `ExcludeStoresAutoConfigurationEnvironmentPostProcessor`
* Enable only those which are configured by the `aggregator.messageStoreType` property
* Implement a fully reactive function around an aggregator making an interaction via a pair of `FluxMessageChannel`
* Fix checkstyle issues
* Change the app generator maven plugin to new coordinates
2020-08-20 15:54:51 -04:00
Christian Tzolov
f88baf9b08 fix checkstyle issue 2020-08-20 20:51:34 +02:00
David Turanski
edfe13e745 Fix no factory bean warnings 2020-08-19 12:37:15 -04:00
Soby Chacko
61ec16d100 Syslog supplier/source
- Provide TCP/UDP based syslog supplier and then generate apps based on that
2020-08-18 15:37:50 -04:00
Christian Tzolov
a376f94412 Fix cdc tests 2020-08-16 22:07:28 +02:00
Soby Chacko
25a1c8d0d4 Fixing test 2020-08-13 16:05:32 -04:00
Christian Tzolov
ceee2fb724 CDC Debezium Supplier, Source Boot Starter
- Add supplier, source and boot auto-config.
 - Add work around for KafkaNull handling.
 - Update CDC to 1.2.1.Final. Replace the deprecated properties.

remove comments

Add missing metadata configuration. Improve README docs.

CDC: add all metadata for doc auto-generation

Remove custom KafkaNullConverter.

  - The fixed KafkaNullConverter implementation comes with kafka binder 3.0.8-BUILD-SNAPSHOT or newer.

Add repositories to maven config in app generation project.

Remove the unnecessary function version in maven plugin configuration for app generation.
2020-08-13 15:41:25 -04:00
David Turanski
fa2c0ec583 Wait for data 2020-08-13 15:01:31 -04:00
Soby Chacko
92569d8113 Increase timeout in mongodb consumer test 2020-08-13 13:36:59 -04:00
David Turanski
6b0f08712b Add max-buffer-size and fix app deps 2020-08-13 13:27:15 -04:00
David Turanski
93d87a4155 Refactor to use SpEL in function properties
* Clean up per review
2020-08-12 15:39:56 -04:00
David Turanski
5d1786bd99 Add true Consumer and tests (#99)
* Add true Consumer and tests

* Fixed some bugs

* Update README

* Replace block() with subscribe()
2020-08-11 13:08:28 -04:00
David Turanski
2a5490068d Add OSS JDBC drivers to consumer and supplier 2020-08-07 17:45:02 -04:00
Soby Chacko
0c07b4af05 Remove duplicate dependency in twitter-function
Add relativePath to core parent
2020-08-07 16:50:15 -04:00
Christian Tzolov
1e4a603df6 Fix javadoc checkstyle issue. Update generated READMEs 2020-08-06 12:51:47 +02:00
Christian Tzolov
f8ed9f9c38 Remove double quotes in the properties comments 2020-08-05 15:18:25 +02:00
Soby Chacko
478366f8ff Dependency updates
Spring Boot - 2.3.2.RELEASE
Spring Cloud - Hoxton.SR7
Spring Cloud Stream - Horsham.SR7
2020-08-03 17:37:16 -04:00
David Turanski
be818e02de Support filterFunction and spelFunction composition 2020-07-28 12:26:26 -04:00
David Turanski
dc2d2b2738 Fix checkstyle 2020-07-21 09:48:57 -04:00
David Turanski
5c54cd0953 Add try-finally 2020-07-21 09:48:01 -04:00
David Turanski
30caf06198 Fix function definition property (#91)
* Remove deprecated spring.cloud.stream.function.definition property

* Restore tasklauncher-function

Co-authored-by: David Turanski <dturanski@pivotal.io>
2020-07-20 18:23:30 -04:00
Soby Chacko
d29a238569 Next version updates
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Next:2020.0.0-SNAPSHOT
2020-07-13 16:02:05 -04:00
Soby Chacko
0e685334b2 Functions: Release - 1.0.0-M2 2020-07-13 14:43:36 -04:00
Christian Tzolov
94f360e06f Cleann the tensorflow-common dependencies 2020-07-09 14:09:51 +02:00
Timo Salm
0567e39a91 GH-75: add EnvPP for CS-AWS exclusion
Fixes https://github.com/spring-cloud/stream-applications/issues/75
2020-07-08 11:33:13 -04:00
Timo Salm
1bac396510 Support for s3 compatible storage
* Add support for s3 compatible storage to s3 consumer and supplier.

* Add enhancements to s3 compatible storage implementation based on code review

* Move s3 compatible storage endpoint configuration bean to AmazonS3Configuration to remove code duplication

* Disable auto configuration of AmazonS3 Bean to enable custom configurations

* Add documentation for endpoint url configuration property

* Use localhost instead of a real URL to avoid an unexpected connection to the internet
2020-07-07 14:27:31 -04:00
Soby Chacko
ea21c310c9 Function dependencies BOM 2020-07-06 18:09:02 -04:00
Soby Chacko
4b1dd074ba Renaming internal test boot applications in functions 2020-07-02 18:31:58 -04:00
David Turanski
622b5f910b Fix import order 2020-07-01 19:00:52 -04:00
David Turanski
efafaf2ab6 Fixed test 2020-07-01 17:54:11 -04:00
David Turanski
aa7152fc18 Implement SFTP Source
Address review comments

* Code style clean up - generics warnings
* Fix `SftpSupplierApplicationTests` for compatibility with Windows
2020-07-01 15:35:27 -04:00
Timo Salm
c5e78e2f4b Add Wavefront Consumer and Wavefront Sink
- Supports direct and proxy access.
 - Uses SpEL expressions to compute output metrics value and tags from the input message.
 - Add tests.
2020-07-01 15:46:41 +02:00
Christian Tzolov
996a017224 another analytic sink documentation improvement 2020-06-30 11:53:49 +02:00
Christian Tzolov
608769fde6 Improve analytic sink documentation 2020-06-30 11:17:41 +02:00
Christian Tzolov
321c753c93 Remove twitter SpEL converter in favor of config-common 2020-06-30 00:40:11 +02:00
Christian Tzolov
cbeabd371e rename couner (consumer|sink) to analytics (consumer|sink). Remove the custom SpEL convert in favor of config-common 2020-06-30 00:13:08 +02:00
Christian Tzolov
7f19cfff22 Add gauge support for the Counter Consumer
- Add Micrometer GAUGE Meter metrics. Add new counter.meter-type property to select between counter and gauge meter types.
 - Add tests and stock-exchange demo application.
 - Update counter-consumer README.

 Resolves: https://github.com/spring-cloud/stream-applications/issues/69
2020-06-29 16:45:21 +02:00
Soby Chacko
51ed4d2f6d Next version updates
Functions: 1.0.0-SNAPSHOT
  Core Apps: 3.0.0-SNAPSHOT
  Apps: 3.0.0-SNAPSHOT
  Aggregate Build: 2020.0.0-SNAPSHOT
2020-06-26 13:49:35 -04:00
Soby Chacko
87e4a2d740 Functions: Release - 1.0.0-M1 2020-06-25 17:42:02 -04:00
Soby Chacko
ec26df38d2 cleanup 2020-06-25 16:05:55 -04:00
Christian Tzolov
a1e26baba8 Replace http https 2020-06-25 18:29:17 +02:00
Christian Tzolov
20ca5a4680 tensorflow common readme fix 2020-06-25 14:55:30 +02:00
Christian Tzolov
2a965d1fdc fix readme links 2020-06-25 14:33:55 +02:00
Christian Tzolov
e60184839a fix readme links 2020-06-25 14:30:17 +02:00
Christian Tzolov
db740ebdfd semantic segmentation processor 2020-06-25 12:41:39 +02:00
Christian Tzolov
dffb467da4 Tensorflow functions and applications
* initial step
 * Tensorflow models functional model redesign

      -- Based on https://tzolov.github.io/mind-model-services
      -- Resolves #5

 * Add object detection processor README
 * Add image recognition processor README
 * Initial Tensorflow commonn README
 * Initial Tensorflow commonn README
 * Tensorflow common diagram
 * Tensorflow docs code
 * Tensorflow docs code snippets improve
 * Tensorflow docs code snippets improve
 * Tensorflow docs code snippets improve
 * Tensorflow docs code snippets improve
 * Add semantic segmentation function. add object detecteion function readme
 * oo images
 * Furether oo readme improvments
 * Final obj detection readme fixes
 * Add image recognition readme
 * Add image recognition readme 2
 * Semantic segmentation readme
 * Segmentation readme
 * Semantic segmentation readme 3
 * Fix image recognition and object detcion app starter dependecies

 * Add metadata for Tensorflow apps
2020-06-24 18:37:03 -04:00
Christian Tzolov
3bb9e066b9 Port in the Geo and Users twitter function. Fix issue with handling SpEL expression porperties in the twitter functions. 2020-06-24 12:58:47 +02:00
Christian Tzolov
b1a57fc191 Address twitter review suggestions 2020-06-24 09:58:26 +02:00
Soby Chacko
2aae03abe4 Update versions
Docs/Descriptor metadata updates
2020-06-23 19:02:29 -04:00
Christian Tzolov
1892736b98 Twitter functional apps
* Streaming source
* Add twitter search and messasge sources
* Add more twitter source, sink and processors
* Add IT tests for twitter update sink
* Add IT tests for twitter message sink
* Add IT tests for twitter trend processor
* twitter suppliers readme
* twitter consumers readme
* twitter functions readme
* Disable TwitterStreamSourceTests
2020-06-23 14:48:34 -04:00