Commit Graph

3791 Commits

Author SHA1 Message Date
Gary Russell
92279db2a1 GH-2686: Reactive Kafka Fix Auto Commit
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2686

Due to `.concatMap()`, offsets were committed before passing the records to
the pipeline.
2023-04-05 15:46:54 -04:00
Ilya Serbis
4b7ced0062 Update documentation
fix code and bring it in line with the codebase
2023-04-05 10:29:08 -04:00
Chris Bono
a01bf30d38 GH-2655: AOT support user declared binders
- Adds support for AOT child context generation
  for user-declared binder configurations.

Fixes #2655
2023-04-04 20:50:55 -04:00
Marcin Zajączkowski
43d3d9c415 Include also topic name is warnings and errors
Here the messages related to unexpected number of partitions.
Prior to that, it could be not trivial to be sure what topic is affected.

checkstyle fix
2023-04-04 10:44:19 -04:00
Gary Russell
64835ef1d7 GH-2685: Reactive Kafka Customizers - Add Generics
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2685

Required to allow customization of serializers/deserializers.
2023-04-03 13:11:34 -04:00
Soby Chacko
b814c0f395 Rely on Boot for reactor-kafka dependency 2023-04-03 12:04:56 -04:00
Soby Chacko
4c78d862eb Update reactor-kafka to 1.3.17
Update reactor-kafka to 1.3.17 in reactive-kafka binder

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2678
2023-03-30 14:27:21 -04:00
buildmaster
ea37eed9be Bumping versions 2023-03-29 17:33:29 +00:00
buildmaster
b2f2b51b90 Bumping versions 2023-03-28 17:27:48 +00:00
buildmaster
58c028f339 Bumping versions to 4.0.3-SNAPSHOT after release 2023-03-28 14:51:23 +00:00
buildmaster
c45f2e3ac7 Going back to snapshots 2023-03-28 14:51:22 +00:00
buildmaster
d932cf990f Update SNAPSHOT to 4.0.2 2023-03-28 14:47:17 +00:00
Oleg Zhurakousky
fdbe16929e Update pom.xml 2023-03-28 16:26:38 +02:00
Oleg Zhurakousky
3cb3613ccf Update pom.xml 2023-03-28 16:25:26 +02:00
Marcin Grzejszczak
ce502ddae6 Update pom.xml 2023-03-28 11:55:42 +02:00
Marcin Grzejszczak
b32a701c11 Update pom.xml 2023-03-28 11:51:15 +02:00
Marcin Grzejszczak
d0fe452b88 Update pom.xml 2023-03-28 11:49:28 +02:00
Oleg Zhurakousky
4936cba75b GH-2663 Remove references to deprecated property
Resolves #2663
2023-03-28 08:59:11 +02:00
Soby Chacko
9259d6425e Display binder name in bindings actuator endpoint
- Resolve binder name and type from default binder if they
   are not provided as part of binding properties.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2664
2023-03-27 13:48:14 -04:00
Oleg Zhurakousky
ee7e95de27 Upgrade reactor 2023-03-27 19:12:21 +02:00
Oleg Zhurakousky
948dd2a38a GH-2664 Add support for displaying binder name/type
Resolves #2664

GH-2664 polishing
2023-03-27 09:08:13 +02:00
Soby Chacko
3aa517f11d BiConsumer creates an output binding
Currently, when the user provides a BiConsumer, the framework
creates an output binding and subsequently a target destination
on the middleware. This is unncessary and causes issues for the
application. This commit addresses this issue.

This commit requires changes from the following PR in Spring Cloud Function:
https://github.com/spring-cloud/spring-cloud-function/pull/1016

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2670
Resolves #2676
2023-03-24 11:17:54 +01:00
Oleg Zhurakousky
5aaacb97b7 GH-2672 re-add bridge to global error channel to ensure logging
Resolves #2672
2023-03-22 17:37:26 +01:00
Soby Chacko
693a4a7b60 Migrate StreamFunctionConfigurationProperties
Move StreamFunctionConfigurationProperties from StreamFunctionProperties
and migrate as a top-level class.
2023-03-21 19:44:00 -04:00
buildmaster
8e73b291f0 Bumping versions 2023-03-21 17:26:44 +00:00
Oleg Zhurakousky
98051a0a1e GH-2674 Cleanup deprecated and obsolete properties in StreamFunctionProperties
Resolves #2674
2023-03-21 13:41:36 +01:00
Steven PG
e5d4916a4d Stream batch produce consume (#2654)
Kafka Binder-based Batch Producer and Consumer

 - Provide a new sample for batch producer and consumer with the Kafka binder
2023-03-09 20:15:53 -05:00
Soby Chacko
ce371f0bfb KafkaBinderConfigurationProperties metadata
Remove @ConfigurationProperties from KafkaBinderConfigurationProperties
and move it to the respective @Bean methods in regular Kafka binder
and it's reactive counter part.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2640
2023-03-07 17:31:02 -05:00
Oleg Zhurakousky
fba22efcb2 Remove notable deprecations section 2023-03-01 13:56:06 +01:00
Oleg Zhurakousky
dfcda941aa Fix MessageConverter list in the docs
Resolves #2659
2023-03-01 13:43:15 +01:00
Fernando Blanch
807f51f175 Support pause/resume for consumer bindings with multiple destinations from BindingsLifecycleController
add test queryng a binding that not exists return empty list

remove unnecessary formatting changes

Resolves #2660
Resolves #2658
2023-03-01 13:33:22 +01:00
Soby Chacko
c875670b73 Test cleanup - Kafka Streams binder 2023-02-27 17:02:31 -05:00
Soby Chacko
47c8adcf99 Remove lingering usage of javax.annotation.PostConstruct
Use jakarta.annotation instead.
2023-02-27 16:04:47 -05:00
Soby Chacko
986b54f5d0 Schema Registry Testing Improvements
- Allow Schema Registry to be optional when
   running unit tests.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2641
2023-02-24 17:03:49 -05:00
Simas Joneliunas
092e860d08 Update README.adoc
Fix typo in readme

Resolves #2657
2023-02-23 15:25:49 +01:00
Gary Russell
82aa2cf41a GH-2653: Reactor Kafka Binder Fix Offset Commits
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2653

Add support for auto and manual offset commits.
Resolves #2656
2023-02-23 15:24:37 +01:00
spencergibb
cf7c6fc18c Adds httpclient version
apache httpclient 4 dep mgmt was removed in boot 3.1
2023-02-15 15:42:42 -05:00
Soby Chacko
371815806b Supporting DLQ in batch mode (#2649)
* Supporting DLQ in batch mode

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2317

* PR review

Co-authored-by: Gary Russell <grussell@vmware.com>

---------

Co-authored-by: Gary Russell <grussell@vmware.com>
2023-02-13 12:05:28 -05:00
Soby Chacko
756f02d435 javadocs cleanup in Binding interface 2023-02-08 14:45:43 -05:00
Soby Chacko
4100f27791 KafkaBinderConfigurationProperties metadata
When generating configuration metadata (spring-configuration-metadata.json),
KafkaBinderConfigurationProperties class is missing all the information except
for the constructor bound KafkaProperties. We need to add the @Autowired on the
constructor so that Boot will not do a constructor binding and thus include all
the JavaBeans style properties in the metadata. See this Boot issue for more details.

https://github.com/spring-projects/spring-boot/issues/34031

In addition, this @Autowired is necessary for the properties to be correctly
bound when running in native mode.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2640
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2644
2023-02-07 18:16:45 -05:00
buildmaster
bde556a04b Bumping versions 2023-02-07 17:26:57 +00:00
Soby Chacko
ea5da9011e Kafka binder AOT/Native sample app 2023-02-06 13:59:35 -05:00
Gary Russell
8411d9c548 GH-2634: Javadoc Polishing 2023-01-31 10:37:43 -05:00
Gary Russell
a325b8b9fd GH-2634: Reactor Kafka Binder Customization
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2634

Allow customization of `ReceiverOptions` and `ProducerOptions`.
2023-01-27 09:51:03 -05:00
Soby Chacko
5810ba60a7 Disable deploying test module
Disable deploying spring-cloud-stream-integration-tests.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2636
2023-01-26 12:44:17 -05:00
Byungjun You
7895025c47 Use 'instanceof' pattern variable
Update authors and copyright years

Fixing checkstyle issue
2023-01-26 11:30:04 -05:00
buildmaster
b49fde97c8 Bumping versions 2023-01-26 16:01:13 +00:00
Soby Chacko
3b1b29e86d Health indicator fixes when topic is pattern (#2635)
When destination is pattern, even when the cluster is down,
health indicator is erroneously reporting the status as UP.
Addressing this issue by calling a simple listTopics on the
consumer when the destination is pattern, and if it throws an
exception, report the status as DOWN. If the call succeeds, we
assume that the cluster is accessible.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2628
2023-01-25 13:23:38 -05:00
buildmaster
7bff24af68 Bumping versions 2023-01-25 17:26:18 +00:00
buildmaster
46bc9c5709 Bumping versions to 4.0.2-SNAPSHOT after release 2023-01-25 14:33:14 +00:00