Commit Graph

256 Commits

Author SHA1 Message Date
Gary Russell
ee01cc9e50 GH-2729: Reactor Kafka Binder SenderResult Support (#2730)
* GH-2729: Reactor Kafka Binder SenderResult Support

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2729

Allow configuration of a `FluxMessageChannel` to receive `SenderResult`s.
Add `SenderResultMessageHandler` to consume from that channel.

Remove undocumented `sendResult` header, which has no value without the
sender result correlation metadata.

* Add integration test and polish property docs.

- result channel must be FMC for reactive binder.

* Add documentation.

* Remove SenderResultMessageHandler.
2023-05-22 15:27:00 -04:00
Soby Chacko
acb81954f4 Kafka binder partitioning doc improvements (#2735)
* Kafka binder partitioning doc improvements

* Update docs/src/main/asciidoc/kafka/kafka_partitions.adoc

Co-authored-by: Gary Russell <grussell@vmware.com>

* Update docs/src/main/asciidoc/kafka/kafka_partitions.adoc

Co-authored-by: Gary Russell <grussell@vmware.com>

* Update docs/src/main/asciidoc/kafka/kafka_partitions.adoc

Co-authored-by: Gary Russell <grussell@vmware.com>

---------

Co-authored-by: Gary Russell <grussell@vmware.com>
2023-05-22 15:26:53 -04:00
oliverfuehrer
6e6267fbd0 Dynamic partition improvements in Kafka binder
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2706

  - Update partition count changes in Kafka dynamically during runtime
  - Checkstyle fixes
  - PartitionHandler changes
  - Improved handling of expression with 'payload' in the logic
  - Removed getter/setter for PartitionHandler and use ReflectionUtils within Test
  - Renamed property to 'dynamicPartitionUpdatesEnabled' and improved documentation (also one line per sentence)
  - Improved/renamed test to use embeddedkafka and really test update behaviour
  - Javadoc
2023-05-09 10:46:36 -04:00
Jay Kim
fe5ac0cd55 Correct configuration path for AckMode in the kafka tips document 2023-04-25 09:57:29 -04:00
Gary Russell
8c6854e4f5 GH-2709: Reactive Kafka Binder Pattern Docs 2023-04-19 11:02:18 -04:00
Marc DiPasquale
0cb1c57075 Add Solace updates 2023-04-19 11:02:06 -04:00
Soby Chacko
15fa434b21 Clarify docs for binding keys with special chars
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2699
2023-04-19 11:01:55 -04:00
Soby Chacko
ca89bf4755 Enhancing docs on the usage of test binder
- Docs on mixing test binder and the actual middleware based binder.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2684
2023-04-19 11:01:39 -04:00
Oleg Zhurakousky
34d7927dea GH-2707 Add PostProcessing documentation
Resolves #2707
2023-04-19 11:00:09 -04:00
Soby Chacko
dd8e707e01 Update Kafka Streams binder docs
spring.cloud.stream.function.definition -> spring.cloud.function.definition.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2680
2023-04-05 16:48:35 -04:00
Gary Russell
f48523f774 GH-2691: Kafka Reactive Binder Support Multiplex (#2698)
* GH-2691: Kafka Reactive Binder Support Multiplex

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2691

* Add docs.
2023-04-05 15:50:07 -04:00
Gary Russell
92279db2a1 GH-2686: Reactive Kafka Fix Auto Commit
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2686

Due to `.concatMap()`, offsets were committed before passing the records to
the pipeline.
2023-04-05 15:46:54 -04:00
Ilya Serbis
4b7ced0062 Update documentation
fix code and bring it in line with the codebase
2023-04-05 10:29:08 -04:00
Oleg Zhurakousky
4936cba75b GH-2663 Remove references to deprecated property
Resolves #2663
2023-03-28 08:59:11 +02:00
buildmaster
8e73b291f0 Bumping versions 2023-03-21 17:26:44 +00:00
Steven PG
e5d4916a4d Stream batch produce consume (#2654)
Kafka Binder-based Batch Producer and Consumer

 - Provide a new sample for batch producer and consumer with the Kafka binder
2023-03-09 20:15:53 -05:00
Oleg Zhurakousky
fba22efcb2 Remove notable deprecations section 2023-03-01 13:56:06 +01:00
Oleg Zhurakousky
dfcda941aa Fix MessageConverter list in the docs
Resolves #2659
2023-03-01 13:43:15 +01:00
Soby Chacko
986b54f5d0 Schema Registry Testing Improvements
- Allow Schema Registry to be optional when
   running unit tests.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2641
2023-02-24 17:03:49 -05:00
Gary Russell
82aa2cf41a GH-2653: Reactor Kafka Binder Fix Offset Commits
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2653

Add support for auto and manual offset commits.
Resolves #2656
2023-02-23 15:24:37 +01:00
Soby Chacko
371815806b Supporting DLQ in batch mode (#2649)
* Supporting DLQ in batch mode

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2317

* PR review

Co-authored-by: Gary Russell <grussell@vmware.com>

---------

Co-authored-by: Gary Russell <grussell@vmware.com>
2023-02-13 12:05:28 -05:00
Gary Russell
a325b8b9fd GH-2634: Reactor Kafka Binder Customization
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2634

Allow customization of `ReceiverOptions` and `ProducerOptions`.
2023-01-27 09:51:03 -05:00
Byungjun You
7895025c47 Use 'instanceof' pattern variable
Update authors and copyright years

Fixing checkstyle issue
2023-01-26 11:30:04 -05:00
Soby Chacko
0612ea85f7 Event type routing and deserialization issues (#2633)
* Event type routing and deserialization issues

In Kafka Streams binder, deserialization exception handler
does not take effect when event type routing is enabled.
Fixing this issue by allowing the applications to use the
configured or inferred Serde rather than the byte[] Serde
used by the event type router initially.

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2613

* Addressing PR review
2023-01-24 21:49:45 -05:00
Byungjun You
82a863d0f0 Remove the gitter chat badge in the README 2023-01-23 15:18:03 +01:00
Oleg Zhurakousky
446d066c1d GH-2626 Fix documentation related to explicit binding name change 2023-01-19 15:44:15 +01:00
Byungjun You
02241661a5 fix @return tag comment for retryAndDlqInBinding 2023-01-19 14:00:05 +01:00
Byungjun You
130a295d04 fix the default DLT name in kafka_tips.adoc 2023-01-11 12:08:44 -05:00
Soby Chacko
8b0fbe122f Allow fine tuning of StoreQueryParameters (#2618)
Add StoreQueryParametersCustomizer to InteractiveQueryService 
in Kafka Streams binder.

Fixes #2608
2023-01-10 18:11:09 -06:00
Byungjun You
a8114cee9a Fix typos in kafka_tips.adoc 2023-01-10 11:24:07 -05:00
Soby Chacko
8fb166fc58 Fix test binder docs
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2598
2023-01-04 16:57:45 +01:00
Filip Panovski
9e31e2eae1 Extend docs on default partitioning strategy in Kafka binder
- Resolves GH-2467
2023-01-03 15:50:11 -05:00
Soby Chacko
1edbd4abba Docs cleanup
Remove all references to EnableBinding/StreamListener from the docs

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2589
2022-12-13 17:29:37 -05:00
Soby Chacko
7a3f0f8197 StreamOperations interface for StreamBridge
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2548
2022-12-13 03:54:57 -08:00
Soby Chacko
f500883994 Observation related changes in Kafka binder (#2582)
* Observation related changes in Kafka binder

Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2576

* Follow up to the previous commit on observation changes

* Address PR review

* Addressing PR review

* Addressing PR review
2022-12-12 15:56:01 -05:00
유병준[Plasma1]
764a90720a fix a broken link for kafka transaction reference 2022-12-07 10:47:12 -05:00
sai
3c7c5230c6 Fix typo in ListenerContainerWithDlqAndRetryCustomizer example of kafka binder 2022-12-05 17:27:27 -05:00
Soby Chacko
f54a370eed Remove AWS Kinesis binder from core SCSt 2022-12-02 14:03:00 -05:00
Soby Chacko
8f04c6e9aa Disconnect Kinesis binder docs from ref docs 2022-11-30 22:22:38 -05:00
Oleg Zhurakousky
58ef5b0479 GH-2570 Ensure consistency in error handling
Rework error handling documentation
Remove dependence and usage of global errorChannel

Resolves #2570
2022-11-29 10:04:03 -08:00
Soby Chacko
0357d7f67f Schema Registry Docs Cleanup 2022-10-20 15:35:01 -04:00
Gary Russell
d93a4a0c4a GH-2510: RabbitMQ Super Streams Concurrency
Add support for concurrency.

Use try with resources in stream tests.

Fix Test with Latest Boot

Resolves #2524
2022-10-19 09:36:30 +02:00
Augustine Theodore
72d4c1d428 Made a correction in kinesis doc
Resolves #2529
2022-10-17 16:18:21 +02:00
Chris Bono
a85e66fe48 Update spring-cloud-stream.adoc
Remove `@RunWith(SpringRunner.class)` from sample code in Spring Integration Test Binder section:
1. It is a JUnit4 annotation
2. `@SpringBootTest` composes the JUnit5 counterpart (`@ExtendWith({SpringExtension.class})`)

Resolves #2537
2022-10-17 16:16:07 +02:00
Oleg Zhurakousky
7bd67c7776 Revert "Revert "GH-2510: Rabbit Binder Scale-out on Super Stream""
This reverts commit c28873c870.
2022-10-06 14:01:00 +02:00
Oleg Zhurakousky
c28873c870 Revert "GH-2510: Rabbit Binder Scale-out on Super Stream"
This reverts commit 16c8591ddd.
2022-10-05 21:31:01 +02:00
Oleg Zhurakousky
3fa4b67703 GH-2482 Add docs about reactive vs imperative functions
Resolves #2482
2022-09-28 14:21:03 +02:00
Gary Russell
16c8591ddd GH-2510: Rabbit Binder Scale-out on Super Stream
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2510

New feature on RabbitMQ (Super Stream with Single Active Consumer) enables
scaling out app instances when using this queue type/config.

`RabbitStreamMessageHandler` is now available in Spring Integration.
2022-09-27 12:51:42 -04:00
Soby Chacko
9a645bc43b Migrating schema registry docs
Initial take on migrating the schema registry refrence docs
from the legacy spring-cloud-schema repository.
2022-09-13 19:05:26 -04:00
Nico Heller
de0efcf0a1 GH-2485: Improvements in Kafka Binder Metrics
Resolves https://github.com/spring-cloud/spring-cloud-stream/issues/2485

These improvements are threading related

Initial implementation

Readd missing 'cache' for recent offset lags and general refactoring

Add a test case for the schedule-only variant and externalize scheduling interval

Consistency of configuration property naming and minor cleanup of existing code

Review feedback: documentation, author addition and copyright adjustments

Doc wording changes

Fix checkstyle issues

Adjust reference doc and improve new property names according to review

Move documentation to the correct file
2022-09-02 10:21:11 -04:00