When StreamListener methods are contained in a top level non-public class, Kafka
Streams binder throws an IllegalAccessException. Fixing it by making it accessible.
Resolves#348
Gary caught a grammatical goof and pointed out some content that can be removed, because Kafka now has a feature it didn't use to have. That prompted me to rewrite the leader paragraph above that content, too.
Thanks, Gary.
Now that the abstract binder makes its event publisher available to subclasses,
use it, if present, instead of the application context.
In most cases, they will be the same object, but the user might override the
publisher.
Resolves#336
Resolves https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/issues/330
- allow override of binder-wide `replicationFactor` for each binding
- allow specific partition/replica configuration
- allow setting `NewTopic.configs()` properties, similar to the consumer and producer
- use a new `AdminClient` for provisioning (and `close()` it) instead of keeping a long-lived connection open.
- added KafkaAutoConfiguration to the @Import of KafkaBinderConfiguration
- removed 'optional' flag for KafkaProperties from KafkaBinderConfigurationProperties
- fixed KafkaBinderAutoConfigurationPropertiesTest
Resolves#326Resolves#333
Fixes#67
Spring Kafka currently doesn't support `TPIO.SeekPosition` for initial offsets.
Instead, use 0 and `Long.MAX_VALUE` for `BEGINNING` and `END` respectively.
Resolves#331
Fixes: spring-cloud/spring-cloud-stream-binder-kafka#328
Since we consider a Micrometer dependency as an optional, it would be
better do not expose beans which depends of that library
* Move `KafkaBinderMetrics` to its own `@Configuration` class with
appropriate conditions on the classpath and beans presence
* Add an `ApplicationContextRunner`-based test-case to achieve a
condition when Micrometer is not in classpath via `FilteredClassLoader`
hook
Resolves#328Resolves#332
Fixesspring-cloud/spring-cloud-stream-binder-kafka#318
* Use `ToDoubleFunction`-based `MeterRegistry.gauge()` variant to really
calculate a `lag` at runtime instead of statically defined before
* Add `KafkaBinderActuatorTests` integration test to demonstrate how
`Binder` is declared in the separate child context and how
`KafkaBinderMetrics` is not visible from the parent context.
This test also verify the real `gauge` value for the `consumer lag`
and should be used in the future to verify the `KafkaBinderMetrics`
exposure removing the code after TODO in the `KafkaMetricsTestConfig`
ConfigurationProperties bean provided by Kafka Streams binder
extends from `KafkaBinderConfigurationProperties` used by Kafka binder.
It creates a conflict when autowiring this bean from Kafka binder configuration.
This prevents an application to have both binders in the classpath.
Change the creation of this ConfigurationProperties bean so that it
avoids creating bean using EnbaleConfigurationProperties and then autowiring,
but directly create the Bean using `@Bean`. This prevents the conflict.
Resolves#244Resolves#315
- Rename spring-cloud-stream-binder-kstream to spring-cloud-stream-binder-kafka-streams
- Corresponding changes in maven pom.xml files
- Rename relevant classes to prefix with KafkaStreams instead of KStream
- Corresponding package changes from org.springframework.cloud.stream.kstream to
org.springframework.cloud.stream.kafka.streams
- Organize all the configuration property classes in a properties package
- Remove kstream from all the properties exposed by Apache Kafka Streams binder
- Classes that need not be public are now moved to package access level
- Test changes
- More javadocs to classes
Resolves#246
- In kafka streams applications, it is essential to have multiple bindings for
various target types such as KStream, KTable etc. These changes allow to have
more than one type of target type bindings on a single StreamListenerMethod.
- Currently support KStream and KTable target types
- Refactoring the KStream listener orchestrator strategy
- Input bindings are initiated through a proxy and later on wrapped with the
real target created from a common Kafka Streams StreamsBuilder
- Adding tests to verify multiple input bindings for KStream and KTable
Resolves#298Resolves#303
Polishing
Materializing KTables as state stores
Void return types on kafka streams StreamListener methods
Polishing
Fixes https://github.com/spring-cloud/spring-cloud-stream-binder-kafka/issues/301
For the `AdminClient`, arbitrary Kafka properties (set via the binder `configuration` property) should
supersede any boot properties. There was already special handling for the bootstrap servers, but
other arbitrary properties were ignored.
Add tests, including a test to verify the proper override of boot's broker list if appropriate.
- Add support for KIP-161: streams deserialization exception handlers
- Provide out of the box LogAndContinue and LogAndFail exception handlers
- Introduce a new exception handler that sends records in error on
deserialization to a DLQ
- Ensure that the exception handlers work in both when native decoding
is enabled (Kafka is doing deserialization) and when native decoding
is disabled (Binder is doing deserialization)
- Enhancements on the logic of native decoding in binder.
- General refactoring and cleanup
- Adding more tests
Resolves#275, #281
Introducing multiple StreamListener methods in Kafka Streams apps.
- Multiple stream listener methods now have individual backing
StreamBuilder and configuration.
- Register StreamsBuilderFactoryBean programmatically
Resolves#299, #300
