Commit Graph

175 Commits

Author SHA1 Message Date
Soby Chacko
7ee3125bc7 Fixing a Kafka binder unit test failure
Latest version of Mockito (5.3.0) used in Spring Boot 3.1.0,
apparently needs the specific Collection type when capturing
values via the ArgumentCaptor. Earlier versisons didn't mandate this.
2023-05-01 18:24:15 -04:00
Gary Russell
c21da59294 GH-2709: Reactive Kafka Binder and Topic Patterns
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2709

Add support for `...destinationIsPattern` as is supported by the message channel
binder.
2023-04-18 10:16:54 -04:00
조찬형[Plasma]
d5e5699f3b Replace duplicate code with existing method
Resolves #2702
2023-04-11 14:36:54 +02:00
Gary Russell
57733739e5 GH-2673: Use Binder Admin Config with Observation
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2673

Also configure observation (if enabled) on DLQ template.
Resolves #2703
2023-04-11 14:33:42 +02:00
Gary Russell
f48523f774 GH-2691: Kafka Reactive Binder Support Multiplex (#2698)
* GH-2691: Kafka Reactive Binder Support Multiplex

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2691

* Add docs.
2023-04-05 15:50:07 -04:00
Gary Russell
92279db2a1 GH-2686: Reactive Kafka Fix Auto Commit
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2686

Due to `.concatMap()`, offsets were committed before passing the records to
the pipeline.
2023-04-05 15:46:54 -04:00
Marcin Zajączkowski
43d3d9c415 Include also topic name is warnings and errors
Here the messages related to unexpected number of partitions.
Prior to that, it could be not trivial to be sure what topic is affected.

checkstyle fix
2023-04-04 10:44:19 -04:00
Gary Russell
64835ef1d7 GH-2685: Reactive Kafka Customizers - Add Generics
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2685

Required to allow customization of serializers/deserializers.
2023-04-03 13:11:34 -04:00
Soby Chacko
b814c0f395 Rely on Boot for reactor-kafka dependency 2023-04-03 12:04:56 -04:00
Soby Chacko
4c78d862eb Update reactor-kafka to 1.3.17
Update reactor-kafka to 1.3.17 in reactive-kafka binder

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2678
2023-03-30 14:27:21 -04:00
buildmaster
ea37eed9be Bumping versions 2023-03-29 17:33:29 +00:00
buildmaster
b2f2b51b90 Bumping versions 2023-03-28 17:27:48 +00:00
buildmaster
58c028f339 Bumping versions to 4.0.3-SNAPSHOT after release 2023-03-28 14:51:23 +00:00
buildmaster
c45f2e3ac7 Going back to snapshots 2023-03-28 14:51:22 +00:00
buildmaster
d932cf990f Update SNAPSHOT to 4.0.2 2023-03-28 14:47:17 +00:00
Oleg Zhurakousky
98051a0a1e GH-2674 Cleanup deprecated and obsolete properties in StreamFunctionProperties
Resolves #2674
2023-03-21 13:41:36 +01:00
Steven PG
e5d4916a4d Stream batch produce consume (#2654)
Kafka Binder-based Batch Producer and Consumer

 - Provide a new sample for batch producer and consumer with the Kafka binder
2023-03-09 20:15:53 -05:00
Soby Chacko
ce371f0bfb KafkaBinderConfigurationProperties metadata
Remove @ConfigurationProperties from KafkaBinderConfigurationProperties
and move it to the respective @Bean methods in regular Kafka binder
and it's reactive counter part.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2640
2023-03-07 17:31:02 -05:00
Fernando Blanch
807f51f175 Support pause/resume for consumer bindings with multiple destinations from BindingsLifecycleController
add test queryng a binding that not exists return empty list

remove unnecessary formatting changes

Resolves #2660
Resolves #2658
2023-03-01 13:33:22 +01:00
Soby Chacko
c875670b73 Test cleanup - Kafka Streams binder 2023-02-27 17:02:31 -05:00
Soby Chacko
47c8adcf99 Remove lingering usage of javax.annotation.PostConstruct
Use jakarta.annotation instead.
2023-02-27 16:04:47 -05:00
Gary Russell
82aa2cf41a GH-2653: Reactor Kafka Binder Fix Offset Commits
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2653

Add support for auto and manual offset commits.
Resolves #2656
2023-02-23 15:24:37 +01:00
spencergibb
cf7c6fc18c Adds httpclient version
apache httpclient 4 dep mgmt was removed in boot 3.1
2023-02-15 15:42:42 -05:00
Soby Chacko
371815806b Supporting DLQ in batch mode (#2649)
* Supporting DLQ in batch mode

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2317

* PR review

Co-authored-by: Gary Russell <grussell@vmware.com>

---------

Co-authored-by: Gary Russell <grussell@vmware.com>
2023-02-13 12:05:28 -05:00
Soby Chacko
4100f27791 KafkaBinderConfigurationProperties metadata
When generating configuration metadata (spring-configuration-metadata.json),
KafkaBinderConfigurationProperties class is missing all the information except
for the constructor bound KafkaProperties. We need to add the @Autowired on the
constructor so that Boot will not do a constructor binding and thus include all
the JavaBeans style properties in the metadata. See this Boot issue for more details.

https://github.com/spring-projects/spring-boot/issues/34031

In addition, this @Autowired is necessary for the properties to be correctly
bound when running in native mode.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2640
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2644
2023-02-07 18:16:45 -05:00
Gary Russell
8411d9c548 GH-2634: Javadoc Polishing 2023-01-31 10:37:43 -05:00
Gary Russell
a325b8b9fd GH-2634: Reactor Kafka Binder Customization
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2634

Allow customization of `ReceiverOptions` and `ProducerOptions`.
2023-01-27 09:51:03 -05:00
Byungjun You
7895025c47 Use 'instanceof' pattern variable
Update authors and copyright years

Fixing checkstyle issue
2023-01-26 11:30:04 -05:00
buildmaster
b49fde97c8 Bumping versions 2023-01-26 16:01:13 +00:00
Soby Chacko
3b1b29e86d Health indicator fixes when topic is pattern (#2635)
When destination is pattern, even when the cluster is down,
health indicator is erroneously reporting the status as UP.
Addressing this issue by calling a simple listTopics on the
consumer when the destination is pattern, and if it throws an
exception, report the status as DOWN. If the call succeeds, we
assume that the cluster is accessible.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2628
2023-01-25 13:23:38 -05:00
buildmaster
7bff24af68 Bumping versions 2023-01-25 17:26:18 +00:00
buildmaster
46bc9c5709 Bumping versions to 4.0.2-SNAPSHOT after release 2023-01-25 14:33:14 +00:00
buildmaster
8c413de78c Going back to snapshots 2023-01-25 14:33:13 +00:00
buildmaster
656469da4f Update SNAPSHOT to 4.0.1 2023-01-25 14:28:45 +00:00
Soby Chacko
0612ea85f7 Event type routing and deserialization issues (#2633)
* Event type routing and deserialization issues

In Kafka Streams binder, deserialization exception handler
does not take effect when event type routing is enabled.
Fixing this issue by allowing the applications to use the
configured or inferred Serde rather than the byte[] Serde
used by the event type router initially.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2613

* Addressing PR review
2023-01-24 21:49:45 -05:00
Byungjun You
02241661a5 fix @return tag comment for retryAndDlqInBinding 2023-01-19 14:00:05 +01:00
Byungjun You
2cd7d07ba8 Replace hardcoded "UTF-8" with StandardCharsets.UTF_8 2023-01-17 15:40:36 +01:00
Soby Chacko
8b0fbe122f Allow fine tuning of StoreQueryParameters (#2618)
Add StoreQueryParametersCustomizer to InteractiveQueryService 
in Kafka Streams binder.

Fixes #2608
2023-01-10 18:11:09 -06:00
Soby Chacko
33e58a0baa Minor code cleanup/deprecation removal etc. 2023-01-10 11:09:25 -05:00
Soby Chacko
005dcfa638 Enable KafkaNull converter tests
Enable a test that uses StreamBridge and KafkaNull together.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2614

Need this PR from Spring Cloud Function merged first:
https://github.com/spring-cloud/spring-cloud-function/pull/981
2023-01-06 10:07:12 +01:00
Byungjun You
3f3d712a84 Fix a message index in kafka binder test 2023-01-03 15:51:40 -05:00
刘鑫
af2df8ba0e some new features of jdk to optimize the code 2023-01-03 14:09:58 +01:00
Oleg Zhurakousky
b8a492bf90 Kotlin cleanup 2022-12-27 15:42:36 +01:00
buildmaster
d40e733221 Bumping versions 2022-12-18 17:27:01 +00:00
buildmaster
f1d4f8a53e Bumping versions 2022-12-16 17:26:47 +00:00
buildmaster
2d9b82fc3f Bumping versions to 4.0.1-SNAPSHOT after release 2022-12-15 20:22:20 +00:00
buildmaster
203e4895b5 Going back to snapshots 2022-12-15 20:22:19 +00:00
buildmaster
b368d681fa Update SNAPSHOT to 4.0.0 2022-12-15 20:18:09 +00:00
spencergibb
e7d2674b1a ignore surefile plugin milestone for release 2022-12-15 09:47:03 -05:00
Soby Chacko
dc2554c83d Fixing checkstyle 2022-12-12 16:33:10 -05:00