Commit Graph

3507 Commits

Author SHA1 Message Date
Soby Chacko
4089c46fff Migrating samples (#2375)
* Migrating samples

Confluent Schema Registry integration sample

* Addressing PR review comments
2022-05-05 15:24:26 -04:00
Soby Chacko
190b5f1fc4 Kafka binder docs cleanup
SeekToCurrentBatchErrorHandler is deprecated.
Removing docs references for this with the new DefaultErrorHandler.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2369
2022-05-04 10:56:13 -04:00
Artem Bilan
d8fd4c2aab GH-2359: Enable other KCL initial offsets
Fixes https://github.com/spring-cloud/spring-cloud-stream/issues/2359

The KCL mode does not apply at the moment `AT_TIMESTAMP` and `TRIM_HORIZON` initial offsets

Resolves #2365
* Change the `KinesisMessageChannelBinder` binder logic to create an explicit
`KinesisClientLibConfiguration` based on the provided properties including
custom stream iterator type
* Adjust `KinesisTestBinder` to be able to create a KCL/KPL based bindings
2022-05-04 15:34:16 +02:00
Chris Bono
210eb7e9f5 Consider generics when resolving Serdes for KafkaStreams binder
Fixes #2318
2022-05-03 11:45:20 -04:00
Chris Bono
37abca427d Remove Kafka binder dependence on KafkaAutoConfiguration
Fixes #2349

Use single instance of EmbeddedKafka for KafkaBinderBootstrapTest
2022-05-03 10:45:51 -04:00
Artem Bilan
3b32bea133 Fix Poller Config for ambiguity
Related to https://stackoverflow.com/questions/72023445/spring-cloud-stream-mutually-exclusive-property-issue

The `PollerConfigEnvironmentPostProcessor` has a flaw not checking user-provided properties
and does not check for mutually exclusive before setting default

* Fix `PollerConfigEnvironmentPostProcessor` to check for other mutual poller
properties before setting default for `fixed-delay`
* Same for `max-messages-per-poll`
* Verify that fix is working in the `PollableSourceTests` where poller
options make sense in the Spring Cloud Stream scenario

* Fix `PollerConfigEnvironmentPostProcessor` for redundant check
* Add more tests into `PollableSourceTests` to verify different
poller properties and their exclusive mutuality
2022-05-02 16:02:56 -04:00
Artem Bilan
53e6e1a85c Migrate Kinesis binder docs to the common place 2022-05-02 15:36:02 -04:00
Oleg Zhurakousky
818553179a fixing docs
polish
2022-05-02 20:20:49 +02:00
buildmaster
4bfab90f61 Bumping versions 2022-04-27 17:37:53 +00:00
Oleg Zhurakousky
77ee8ef1d3 GH-SCF_856 Fix propper Cloud Event header prefix in StreamBridge 2022-04-26 09:27:18 +02:00
Oleg Zhurakousky
c22651a3b0 GH-2360 Fix trimmimg in multiple function definition
remove leftovers from spring.cloud.streamfunction.definition

Resolves #2360
2022-04-22 15:32:28 +02:00
Oleg Zhurakousky
51cdcc7c37 GH-2340 Fix CCE in extended properties
Upgrade jackson core

Resolves #2340
2022-04-22 15:11:22 +02:00
dependabot[bot]
f272c47e93 Bump jackson-databind from 2.10.0 to 2.12.6.1
Bumps [jackson-databind](https://github.com/FasterXML/jackson) from 2.10.0 to 2.12.6.1.
- [Release notes](https://github.com/FasterXML/jackson/releases)
- [Commits](https://github.com/FasterXML/jackson/commits)

---
updated-dependencies:
- dependency-name: com.fasterxml.jackson.core:jackson-databind
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 12:16:16 +02:00
Chris Bono
3de0ed44e2 Use testcontainers for Rabbit binder integration tests
Fixes #2341

Resolves #2358
2022-04-22 12:15:10 +02:00
Lars Bilger
7d3a846590 KafkaBinderMetrics Improvements
- Calculate Kafka lag metric correctly even if there are no committed offsets for the group
 - Update authors and copyright years
 - Checkstyle fixes
2022-04-20 11:16:18 -04:00
buildmaster
53604e703a Bumping versions 2022-04-16 17:25:40 +00:00
ben-enfuse-io
e983366b8b Change compression level to Integer and only set if not null.
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2328
2022-04-14 10:53:55 -04:00
ben-enfuse-io
a3b9c2f68d Change initialQuorumSize to initialGroupSize in docs.
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2329
2022-04-13 18:07:57 -04:00
matthieu.dupuy
8682417af4 Add setter for Container Customizer
Add setter for Container Customizer on AbstractMessageChannelBinder.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2345
2022-04-08 10:00:21 -04:00
Sid Sam
ad89acf62d Update documentation for ListenerContainerWithDlqAndRetryCustomizer
Based on suggestions in https://github.com/spring-cloud/spring-cloud-stream/issues/2313. Hope the edit helps.
2022-04-04 10:14:43 -04:00
buildmaster
5408935158 Bumping versions 2022-04-02 17:31:25 +00:00
Artem Bilan
d351afe27a GH-2311: Migrate AWS Kinesis binder to core
Fixes https://github.com/spring-cloud/spring-cloud-stream/issues/2311

* Use Tescontainers for Localstack
* Fix tests according new `core` status quo
* Improve `KinesisStreamProvisioner` to wait for stream become active
before moving on to other logic

Disable Kinesis binder LocalstackContainerTest on mac
2022-04-01 16:30:53 -04:00
buildmaster
bf02424d27 Bumping versions 2022-04-01 17:27:39 +00:00
Soby Chacko
b4c6ec8332 Concurrency property issues in KStream binder
In Kafka Streams binder, when using a function with camelcase names,
it causes issues for parsing binding level concurrency properties.

Fixing this issue.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2316
2022-03-31 16:43:17 -04:00
buildmaster
85ffd4d92d Going back to snapshots 2022-03-31 20:05:34 +00:00
buildmaster
a9bd88acce Update SNAPSHOT to 4.0.0-M2 2022-03-31 20:02:59 +00:00
spencergibb
a4d6b2e7a7 disables test 2022-03-31 15:47:39 -04:00
Oleg Zhurakousky
0ff2a4ad6a Remove dependency on old test module 2022-03-31 21:27:45 +02:00
spencergibb
a951837e4e Fixes parent 2022-03-31 14:26:00 -04:00
spencergibb
a7a2b8943c adds relative path 2022-03-31 14:19:43 -04:00
spencergibb
2b053c71b7 Updates mvnw to include milestone release check 2022-03-31 14:07:41 -04:00
spencergibb
158e4b22cf Fixes dependency management now that stream is a monorepo 2022-03-31 14:00:09 -04:00
spencergibb
c6b6d620e2 Moves versions to use project.version now that it is a monorepo 2022-03-31 13:33:20 -04:00
spencergibb
6b9f6a5163 Moves core/docs to root of project for compatibility
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2312
2022-03-30 16:05:21 -04:00
spencergibb
ee50d722a5 formatting 2022-03-30 12:44:56 -04:00
Christian Tzolov
d57b445a62 Add connectionFactory getter
Resolves #2314
2022-03-30 12:09:34 -04:00
Oleg Zhurakousky
f58dcf371d Fix concurrency issue in StreamBridge
Resolves #2300
2022-03-25 14:26:32 +01:00
Sébastien NUSSBAUMER
9f28bcde3d GH-2299 Add test to ensure scst_partition header is always set in concurrent scenarios 2022-03-25 12:03:26 +01:00
Gary Russell
8a8a440c73 GH-2307: Fix Problems with Rabbit Declarables
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2307

- when creating `Declarables` beans for redeclaration after a connetion failure
  2 DLX/DLQ bindings used the same bean name so the second one was never recovered/
- removing consumer `Declarable` beans from the `autoDeclareContext` was incomplete
- removing producer `Declarable` beans was not performed at all

- fix bean names; fix cleanup; add tests for all config scenarios
- check cleanup in all `RabbitBinderTests`

**cherry-pick to 3.2.x when the mono repo is established**
Resolves #2309
2022-03-25 11:21:55 +01:00
Oleg Zhurakousky
1edf4db14e GH-2303 Performance improvements
Most of the work is done in s-c-function though, so here it is very light

Resolves #2303
2022-03-22 13:56:03 +01:00
Oleg Zhurakousky
95ea69f9ac Perf improvement on StreamBridge 2022-03-22 10:05:01 +01:00
Oleg Zhurakousky
bf8b963488 Make s-c-function deployer optioinal dependency in rabbit binder 2022-03-21 18:09:14 +01:00
Soby Chacko
37028f0c90 GH-2302: Remove metrics related components
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2302
2022-03-16 12:02:29 -04:00
Oleg Zhurakousky
17e21cc456 GH-2280 Updated polling documentation
Resolves #2280
2022-03-16 15:00:38 +01:00
Oleg Zhurakousky
3e9fc5152e GH-2280 Add initial support for per-binding poller configuration 2022-03-16 14:38:33 +01:00
Oleg Zhurakousky
972a0ef35a GH-2305 Remove remaning legacy test modules
spring-cloud-stream-integration-tests
spring-cloud-stream-test-support-internal

Resolves #2305
2022-03-16 11:30:27 +01:00
Oleg Zhurakousky
c857339e46 GH-2304 Remove old test support binder
Resolves #2304
2022-03-16 10:30:10 +01:00
Soby Chacko
840933d164 JUnit 5 migration for Kafka Streams binder tests 2022-03-15 18:45:05 -04:00
Gary Russell
6d8be51437 GH-2293: MessageConverter Bean Name
Add test to consume full `ReceiverRecord`.

Resolves #2295
2022-03-15 13:09:45 +01:00
Gary Russell
9ccf9ce48b GH-2293: Cancel Subscription on Stop 2022-03-12 13:16:40 -05:00