Commit Graph

4070 Commits

Author SHA1 Message Date
Oleg Zhurakousky
625f25130d GH-2930 Add configuration metadata
Resolves #2930
2024-05-27 09:10:53 +02:00
Oleg Zhurakousky
7f0021b394 GH-2728 Change the order of the refresh for multicontext 2024-05-27 09:05:50 +02:00
Soby Chacko
13f94d266f ReactorKafkaBinderTests race condition issue
* There seems to be a race condition in ReactorKafkaBinderTests that causes
  tests to fail on CI occasionaly. Trying to address this by single dedicated
  topic per test.
2024-05-17 17:38:53 -04:00
Soby Chacko
fd9fa80055 Test cleanup
* Use `EnableAutoConfiguration` instead of `SpringBootApplication` in tests
2024-05-16 15:28:54 -04:00
Soby Chacko
49b7a8028a Kafka binder test cleanup
* Use `EnableAutoConfiguration` instead of `SpringBootApplication` in tests
2024-05-16 14:25:56 -04:00
Soby Chacko
bd2bf09d1e GH-2951: Batch consumer and DLQ issues
Batch consumer with `ListenerContainerWithDlqAndRetryCustomizer` should disable binder-based DLQ.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2951

* Addressing PR review comments

* Addressing review
2024-05-16 11:56:55 -04:00
Soby Chacko
a3c4364740 GH-2949: KafkaBinderHealthIndicator consumer group.id
* Add a new property in `KafkaBinderConfigurationProperties` to allow
  the users to specify a `group.id` for the metadata consumer used by the
  health indicator.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2949
2024-05-13 20:43:30 -04:00
Soby Chacko
7e20c9efbe Adding docs for ReactorKafkaBinderHealthIndicator
See https://github.com/spring-cloud/spring-cloud-stream/issues/2948
2024-05-13 16:08:11 -04:00
Soby Chacko
a89331c095 GH-2948: Adding configuration for ReactorKafkaBinderHealthIndicator
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2948
2024-05-13 13:49:25 -04:00
kutmk
1f41055917 Add @EnableTestBinder annotation (#2947)
* Add @EnableTestBinder annotation
* Use @EnableTestBinder in tests
* Update copyright and author tag
* Add javadoc
* Update explanation to use @EnableTestBinder

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2931
2024-05-13 11:29:00 -04:00
Oleg Zhurakousky
ee3faf605a GH-2946 Remove spring.binders from TestBinder
Resolves #2946
2024-05-08 18:28:14 +02:00
Soby Chacko
c2754de2ab GH-2943: EmbeddedKafka usage improvements in Kafka binder
* Currently, EmbeddedKafka is initialized as part of the class initialization in a few tests
  in the Kafka binder. This is preventing individual JUnit tests from being executed from an IDE (IntelliJ, for example).
  If we move this initialization to the JUnit  method, then that seems to be working.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2943
2024-05-01 13:46:23 -04:00
Soby Chacko
d534e840dc GH-2942: EmbeddedKafka usage improvements in Kafka Streams binder
* Currently, EmbeddedKafka is initialized as part of the class initialization.
  This is preventing individual JUnit tests from being executed from an IDE (IntelliJ, for example).
  If we move this initialization to the JUnit `BeforeAll` method, then that seems to be working.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2942
2024-05-01 11:52:47 -04:00
Soby Chacko
1d241583c3 GH-2941: Kafka Streams Component beans composition
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2941

* Introduce function composition for Kafka Streams Component beans
2024-04-30 21:00:04 -04:00
Soby Chacko
f230d873c7 Adding Kafka docker-compose script for kraft 2024-04-30 10:53:43 -04:00
Soby Chacko
9cbd45910e GH-2926: Clarify docs on observablity when consuming in batches
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2926

* Clarify docs on Observability when consuming records in batch mode in Kafka binder
2024-04-29 18:33:07 -04:00
Soby Chacko
7845be50ef GH-2932: Sanitize sensitive data on bindings endpoint
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2932

Spring Boot provides `SanitizingFunction` to allow the applicaitons to clear out
sensitive data when using certain actuator endpoints. This feature can be
extended to custom endpoints as well. Enable the bindings actuator endpoint
to sanitze sensitive data based on user-provided logic in `SantizingFuction`
beans in the application.
2024-04-17 17:30:28 -04:00
Chris Bono
3d679c491c Fix custom test PulsarProducerFactory
Spring Pulsar 1.1.x introduced a new method `getPulsarClient`
on `PulsarProducerFactory` and the PulsarBinderIntegrationTests
has a custom factory that must be updated in order to run
on both Pulsar 1.0.x and 1.1.x (i.e. Spring Boot 3.2.x and 3.3.x).
2024-04-15 09:44:38 -04:00
Soby Chacko
3298d0d3c7 SBFM issues with afterSingletonsInstantiated
Related to GH-2935. Ensure that afterSingletonsInstantiated is called
even when autoStartup is not enabled.
2024-04-12 22:09:43 -04:00
Soby Chacko
5fb122e5a9 SBFM changes for Boot 3.2/3.3 compatibility 2024-04-12 17:40:52 -04:00
Soby Chacko
5ab62e1aa1 Fix Kafka binder tests for Boot 3.3.x compatibility 2024-04-12 16:42:17 -04:00
Soby Chacko
24556fd79e GH-2935: Call afterSingletonsInitialized() in SBFM
StreamsBuilderFactoryBean: Call afterSingletonsInitialized() programmatically in StreamsBuilderFactoryManager

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2935
2024-04-10 14:06:12 -04:00
Soby Chacko
b736b4a8fa Remove @AutoConfiguration from TestChannelBinderConfiguration
Backout changes introduced in 4174657a35

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2931
2024-04-09 18:20:00 -04:00
Soby Chacko
a636eec47c GH-2933: Clarify docs on adding global state stores
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2933
2024-04-09 14:44:45 -04:00
buildmaster
99f1f1eb4a Bumping versions to 4.1.2-SNAPSHOT after release 2024-03-27 13:18:07 +00:00
buildmaster
3e7e65f259 Going back to snapshots 2024-03-27 13:18:06 +00:00
buildmaster
71727654ef Update SNAPSHOT to 4.1.1 2024-03-27 13:13:52 +00:00
lazare
5a231df52d fixed typo in configuration-options.adoc 2024-03-25 17:52:10 -04:00
Soby Chacko
70495a00f5 Remove hard-coded reactor version
* Remove hard-coded reactor version in lieu of Boot managed version
2024-03-21 22:18:18 -04:00
Soby Chacko
568c82d889 Fixing typo - consuming batch docs 2024-03-21 16:22:18 -04:00
WOODMARK\r.wiedmann.extern
eab86f81a8 GH-2922: Timestamp extractor - Kafka Streams 3.7.0
* Address immutability changes for the call to `Consumed#withTimestampExtractor`.

 * In 3.7.0, this call returns a new instance of `Consumed` as oppposed to
   mutating the existing instance in the previous versions. Address this
   change in behavior in the Kafka Streams binder.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2922
2024-03-20 17:15:08 -04:00
Soby Chacko
9190e9b835 GH-2921: Output-bindings and RabbitMQ r-k-e issues
* When output-bindings config is explicitly used for StreamBridge
  and the RabbitMQ routing-key-expression is provided, Spring Cloud Stream
  is throwing an exception due to a proper function is not found in
  the catalog. Bypassing this step and letting the bootstrapping continues
  if output-bindings and RabbitMQ routing-key-expression combination is used.
* Adding tests to verify

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2921
2024-03-20 16:14:16 -04:00
Michał Rowicki
f836e1cf54 GH-2923: StreamBridge and Kafka send with virtual threads
* Sending Kafka events via StreamBridge#send using virtual threads causes pinning. 
     Use a ReentrantLock to avoid pinning.
2024-03-19 16:40:10 -04:00
Soby Chacko
e80f53fbe8 Adding rabbitmq docker-compose 2024-03-19 15:28:02 -04:00
Patrik Süli
e03b993c3b GH-2919: Eager loading FunctionConfiguation
* Always eager loading `FunctionConfiguration`

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2919
2024-03-18 17:39:04 -04:00
Chris Bono
fcdaf2fdd8 Fix Pulsar binder for Java 21 (#2918)
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2915

Running the Pulsar binder with Java 21 surfaced a bug where the layered
binder/binding config props are not properly applied to the targeted
consumer/producer builders.

The bug existed before Java 21 and is unrelated.

The binder/binding config props are converted to a Pulsar
ProducerConfigurationData object via Jackson. This conversion process iterates
over a map of config props. The iteration order of the map changed between Java
17 and 21. This results in object setters getting called in different orders, 
which in turn causes cross-field validation errors.

See #2915 for more details
2024-03-14 15:47:21 -04:00
Soby Chacko
a2458f3029 Clarify batch-consuming docs for Kafka binder
Based on this issue: https://github.com/spring-cloud/spring-cloud-stream/issues/2917
2024-03-14 10:54:52 -04:00
Ryan Baxter
d2e66b76a1 Update antora-playbook.yml to 0.4.11 2024-03-12 10:35:33 -04:00
Soby Chacko
fac0c143ad GH-2560: Clarify docs on error handling/DLQ
* Clarify the docs on retry behavior in Kafka binder when max-attempts set to 1 and no DLQ

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2560
2024-03-08 18:20:43 -05:00
Soby Chacko
b08fe14dd7 Move core error handling docs to top-level
Kafka binder error channels docs cleanup
2024-03-08 17:40:12 -05:00
Soby Chacko
05b1eadd78 Docs cleanup 2024-03-08 15:59:56 -05:00
Soby Chacko
b595302f9c Cleanup default properties docs
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2906
2024-03-08 15:51:00 -05:00
Soby Chacko
c7b24a3d3c Pulsar binder integ test issues on JDK 21
* Disable the max-pending-messages in binderAndBindingPropsAreAppliedAndRespected test,
  since it is causing the test to fail on JDK 21. We will investigate why this propery has
  issues on JDK 21.

See this issue for details: https://github.com/spring-cloud/spring-cloud-stream/issues/2915
2024-03-07 11:50:49 -05:00
buildmaster
b0da1a7eec Bumping versions 2024-03-06 10:16:38 +00:00
Soby Chacko
48dcc5dfd7 Fixing Pulsar binder tests
* Fixing Pulsar binder tests for Boot 3.2/3.3 compatibility
2024-03-04 16:18:54 -05:00
Soby Chacko
cabefa74fa Adjust Pulsar binder code for Boot 3.2/3.3 2024-03-04 15:35:49 -05:00
spencergibb
6e168d92e6 formatting 2024-03-04 15:06:58 -05:00
Soby Chacko
650edc180c Fixing Kafka Binder unit test issues 2024-03-04 14:57:04 -05:00
Soby Chacko
fb430ce6bc Remove hard-coded jackson dependency in core 2024-03-04 14:07:49 -05:00
Soby Chacko
5f1611a4aa GH-2884: Docs on Pulsar Binder Config Props
Adding a brief docs section for the Pulsar binder config properties.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2884
2024-03-01 17:19:05 -05:00