SpringCloud/spring-cloud-stream-binder-aws-kinesis
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
69 Commits 7 Branches 0 Tags
1.0.x
Commit Graph

69 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Spring Operator
644488d039 URL Cleanup 
This commit updates URLs to prefer the https protocol. Redirects are not followed to avoid accidentally expanding intentionally shortened URLs (i.e. if using a URL shortener).

# Fixed URLs

## Fixed Success
These URLs were switched to an https URL with a 2xx status. While the status was successful, your review is still recommended.

* [ ] http://www.apache.org/licenses/ with 1 occurrences migrated to:
  https://www.apache.org/licenses/ ([https](https://www.apache.org/licenses/) result 200).
* [ ] http://www.apache.org/licenses/LICENSE-2.0 with 23 occurrences migrated to:
  https://www.apache.org/licenses/LICENSE-2.0 ([https](https://www.apache.org/licenses/LICENSE-2.0) result 200).
 2019-03-26 20:40:48 -04:00
Spring Operator
99046f6f38 URL Cleanup 
This commit updates URLs to prefer the https protocol. Redirects are not followed to avoid accidentally expanding intentionally shortened URLs (i.e. if using a URL shortener).

# HTTP URLs that Could Not Be Fixed
These URLs were unable to be fixed. Please review them to see if they can be manually resolved.

* [ ] http://xslthl.sf.net (301) with 1 occurrences could not be migrated:
   ([https](https://xslthl.sf.net) result AnnotatedConnectException).

# Fixed URLs

## Fixed Success
These URLs were switched to an https URL with a 2xx status. While the status was successful, your review is still recommended.

* [ ] http://asciidoctor.org with 1 occurrences migrated to:
  https://asciidoctor.org ([https](https://asciidoctor.org) result 200).
* [ ] http://sourceforge.net/projects/xslthl/ with 14 occurrences migrated to:
  https://sourceforge.net/projects/xslthl/ ([https](https://sourceforge.net/projects/xslthl/) result 200).
* [ ] http://www.w3.org/TR/CSS21/propidx.html with 1 occurrences migrated to:
  https://www.w3.org/TR/CSS21/propidx.html ([https](https://www.w3.org/TR/CSS21/propidx.html) result 200).
* [ ] http://repo.spring.io/libs-milestone-local with 2 occurrences migrated to:
  https://repo.spring.io/libs-milestone-local ([https](https://repo.spring.io/libs-milestone-local) result 302).
* [ ] http://repo.spring.io/libs-snapshot-local with 2 occurrences migrated to:
  https://repo.spring.io/libs-snapshot-local ([https](https://repo.spring.io/libs-snapshot-local) result 302).
* [ ] http://repo.spring.io/release with 1 occurrences migrated to:
  https://repo.spring.io/release ([https](https://repo.spring.io/release) result 302).

# Ignored
These URLs were intentionally ignored.

* http://maven.apache.org/POM/4.0.0 with 6 occurrences
* http://www.w3.org/2001/XMLSchema-instance with 3 occurrences
 2019-03-26 20:39:07 -04:00
Spring Operator
59dd641edb URL Cleanup 
This commit updates URLs to prefer the https protocol. Redirects are not followed to avoid accidentally expanding intentionally shortened URLs (i.e. if using a URL shortener).

# HTTP URLs that Could Not Be Fixed
These URLs were unable to be fixed. Please review them to see if they can be manually resolved.

* [ ] http://xslthl.sf.net (301) with 4 occurrences could not be migrated:
   ([https](https://xslthl.sf.net) result AnnotatedConnectException).
* [ ] http://exslt.org/common (404) with 1 occurrences could not be migrated:
   ([https](https://exslt.org/common) result SSLHandshakeException).

# Fixed URLs

## Fixed But Review Recommended
These URLs were fixed, but the https status was not OK. However, the https status was the same as the http request or http redirected to an https URL, so they were migrated. Your review is recommended.

* [ ] http://compose.docker.io/ (UnknownHostException) with 1 occurrences migrated to:
  https://compose.docker.io/ ([https](https://compose.docker.io/) result UnknownHostException).
* [ ] http://docs.spring.io/spring-cloud-stream-binder-kinesis/docs/ (301) with 1 occurrences migrated to:
  https://docs.spring.io/spring-cloud-stream-binder-kinesis/docs/ ([https](https://docs.spring.io/spring-cloud-stream-binder-kinesis/docs/) result 404).
* [ ] http://docs.spring.io/spring-cloud-stream-binder-kinesis/docs/current-SNAPSHOT/reference/html/ (301) with 1 occurrences migrated to:
  https://docs.spring.io/spring-cloud-stream-binder-kinesis/docs/current-SNAPSHOT/reference/html/ ([https](https://docs.spring.io/spring-cloud-stream-binder-kinesis/docs/current-SNAPSHOT/reference/html/) result 404).

## Fixed Success
These URLs were switched to an https URL with a 2xx status. While the status was successful, your review is still recommended.

* [ ] http://github.com/ with 3 occurrences migrated to:
  https://github.com/ ([https](https://github.com/) result 200).
* [ ] http://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html with 1 occurrences migrated to:
  https://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html ([https](https://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html) result 200).
* [ ] http://plugins.jetbrains.com/plugin/6546 with 1 occurrences migrated to:
  https://plugins.jetbrains.com/plugin/6546 ([https](https://plugins.jetbrains.com/plugin/6546) result 301).
* [ ] http://raw.github.com/ with 1 occurrences migrated to:
  https://raw.github.com/ ([https](https://raw.github.com/) result 301).
* [ ] http://docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.ProvisionedThroughput.html with 4 occurrences migrated to:
  https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.ProvisionedThroughput.html ([https](https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.ProvisionedThroughput.html) result 302).
* [ ] http://eclipse.org with 1 occurrences migrated to:
  https://eclipse.org ([https](https://eclipse.org) result 302).
* [ ] http://eclipse.org/m2e/ with 2 occurrences migrated to:
  https://eclipse.org/m2e/ ([https](https://eclipse.org/m2e/) result 302).
* [ ] http://www.springsource.com/developer/sts with 1 occurrences migrated to:
  https://www.springsource.com/developer/sts ([https](https://www.springsource.com/developer/sts) result 302).

# Ignored
These URLs were intentionally ignored.

* http://docbook.org/ns/docbook with 4 occurrences
* http://docbook.sourceforge.net/xmlns/l10n/1.0 with 2 occurrences
* http://localhost with 2 occurrences
* http://maven.apache.org/POM/4.0.0 with 1 occurrences
* http://www.w3.org/1999/XSL/Format with 2 occurrences
* http://www.w3.org/1999/XSL/Transform with 7 occurrences
* http://www.w3.org/1999/xlink with 1 occurrences
 2019-03-26 20:38:34 -04:00
Spring Operator
871297e07c URL Cleanup 
This commit updates URLs to prefer the https protocol. Redirects are not followed to avoid accidentally expanding intentionally shortened URLs (i.e. if using a URL shortener).

# Fixed URLs

## Fixed Success
These URLs were switched to an https URL with a 2xx status. While the status was successful, your review is still recommended.

* http://docs.spring.io/spring-framework/docs/ with 1 occurrences migrated to:
  https://docs.spring.io/spring-framework/docs/ ([https](https://docs.spring.io/spring-framework/docs/) result 200).
* http://docs.spring.io/spring-shell/docs/current/api/ with 1 occurrences migrated to:
  https://docs.spring.io/spring-shell/docs/current/api/ ([https](https://docs.spring.io/spring-shell/docs/current/api/) result 200).
* http://maven.apache.org/xsd/maven-4.0.0.xsd with 3 occurrences migrated to:
  https://maven.apache.org/xsd/maven-4.0.0.xsd ([https](https://maven.apache.org/xsd/maven-4.0.0.xsd) result 200).
* http://www.apache.org/licenses/LICENSE-2.0 with 2 occurrences migrated to:
  https://www.apache.org/licenses/LICENSE-2.0 ([https](https://www.apache.org/licenses/LICENSE-2.0) result 200).
* http://repo.spring.io/libs-milestone-local with 2 occurrences migrated to:
  https://repo.spring.io/libs-milestone-local ([https](https://repo.spring.io/libs-milestone-local) result 302).
* http://repo.spring.io/libs-release-local with 1 occurrences migrated to:
  https://repo.spring.io/libs-release-local ([https](https://repo.spring.io/libs-release-local) result 302).
* http://repo.spring.io/libs-snapshot-local with 2 occurrences migrated to:
  https://repo.spring.io/libs-snapshot-local ([https](https://repo.spring.io/libs-snapshot-local) result 302).
* http://repo.spring.io/libs-staging-local with 1 occurrences migrated to:
  https://repo.spring.io/libs-staging-local ([https](https://repo.spring.io/libs-staging-local) result 302).
* http://repo.spring.io/release with 1 occurrences migrated to:
  https://repo.spring.io/release ([https](https://repo.spring.io/release) result 302).

# Ignored
These URLs were intentionally ignored.

* http://maven.apache.org/POM/4.0.0 with 6 occurrences
* http://www.w3.org/2001/XMLSchema-instance with 3 occurrences
 2019-03-18 09:37:34 -04:00
Venkat Raman
6b39f8c815 GH:68: Improve documentation 
Fixes spring-cloud/spring-cloud-stream-binder-aws-kinesis#68

* addressed review comments
 2018-10-26 15:08:19 -04:00
Diego Berrueta
8d64f13092 Use default localstack ports 
According to https://github.com/localstack/localstack , Dynamodb listens
at 4569 by default, and Kinesis listens at 4568 by default.
 2018-10-08 10:18:28 -04:00
Soby Chacko
8dfbd606b5 Next version update: 1.0.1.BUILD-SNAPSHOT 2018-08-21 14:44:54 -04:00
Soby Chacko
c3096b955d 1.0.0.RELEASE 2018-08-21 14:27:47 -04:00
Artem Bilan
8b1da120f5 Upgrade to SI-AWS-2.0 GA and SC-2.0.3 2018-08-21 13:45:10 -04:00
Artem Bilan
fdf1a55112 Fix unused imports 2018-08-03 17:21:14 -04:00
Artem Bilan
4272945e2e Remove rawRecords artificial mode 
Utilize an existing `consumer.useNativeDecoding` together with the
`listenerMode = batch` instead of artificial `rawRecords` mode.
Currently it requires `useNativeDecoding = true` anyway to get a
proper `List<Record>` payload downstream
 2018-08-03 17:14:08 -04:00
Soby Chacko
534bf4f286 Next update: 1.0.0.BUILD-SNAPSHOT 2018-07-30 14:30:36 -04:00
Soby Chacko
97e137cf7f 1.0.0.RC1 Release 2018-07-30 14:22:30 -04:00
Artem Bilan
6c23efd241 Add update-version.sh 2018-07-30 13:07:45 -04:00
Artem Bilan
15ac2f3130 Upgrade to SI-AWS-2.0.0.RC1 2018-07-30 10:56:08 -04:00
Artem Bilan
cb562c9173 Fixes according the latest SI-AWS 
* Downgrade to SCSt-2.0.1 to be prepared for the upcoming release
* Improve tests performance
 2018-07-16 13:29:19 -04:00
Artem Bilan
c992858313 Fixes according the latest SI-AWS 2018-07-02 21:03:05 -04:00
Artem Bilan
925587682b Fix Checkstyle violations 2018-07-02 11:52:52 -04:00
Artem Bilan
31b661c6b8 GH-56 Use DynamoDB in KinesisBinderProcessorTests 
Fixes https://github.com/spring-cloud/spring-cloud-stream-binder-aws-kinesis/issues/56

To confirm that Binder integration test works well against Kinesis and
DynamoDB at the same time, add a `LocalDynamoDbResource` and use it
from the `KinesisBinderProcessorTests` to auto-configure a
`DynamoDbMetaDataStore` for checkpoint store
 2018-07-02 11:35:14 -04:00
Artem Bilan
48996618d6 Fix NPE in the KinesisBinderConfiguration for TTL 
Related to https://github.com/spring-projects/spring-integration-aws/issues/90

If we don't set `KinesisBinderConfigurationProperties.Checkpoint.timeToLive`
property, we get a `NullPointerException` on startup from
`KinesisBinderConfiguration.java:129` due to auto-unboxing from a
`null` `Integer` to the `int` required by the `DynamoDbMetaDataStore`.
 2018-06-25 21:01:24 -04:00
Artem Bilan
9d9e4a10e2 Add DynamoDbLockRegistry configuration 
Related to https://github.com/spring-projects/spring-integration-aws/issues/90

Since SI-AWS already added a `LockRegistry` support into the
`KinesisMessageDrivenChannelAdapter` that is going to be a good benefit
for the Kinesis Binder to support it as well and also expose a
`DynamoDbLockRegistry` properties for the external configuration

Also upgrade dependencies to be ready for the upcoming release

Update Docs for new features
 2018-06-19 15:28:49 -04:00
Artem Bilan
6456e0ab9d GH-52: Bypass SCSt partitioning algorithm 
Fixes: spring-cloud-stream-binder-aws-kinesis#52

The AWS Kinesis uses its own, server-side, algorithm to determine the
target shard for the record, therefore we don't need to use SCSt
partitioning functionality and just propagate a provided
`partitionKeyExpression` down to the `KinesisMessageHandler`
 2018-06-08 16:01:12 -04:00
Soby Chacko
ea8d5652f5 Back to 1.0.0.BUILD-SNAPSHOT 2018-04-16 15:30:48 -04:00
Soby Chacko
af52466ce4 Update mvnw to be the same as in core spring-cloud-stream 2018-04-16 15:27:38 -04:00
Soby Chacko
2d590747b0 1.0.0.M2 Release 2018-04-16 15:17:27 -04:00
Artem Bilan
d52464dd5c Upgrade to SI-AWS-2.0.0.M2 2018-04-16 14:15:11 -04:00
Artem Bilan
09880a33b5 Add rawRecords listener mode support 
https://stackoverflow.com/questions/49730808/unable-to-consume-messages-as-batch-mode-in-kinesis-binder
 2018-04-12 18:14:46 -04:00
Artem Bilan
3e0668fc1a Upgrade to the latest SC and SI-AWS 2018-04-06 16:59:23 -04:00
Artem Bilan
8c1c483986 GH-47: A note in Docs about TRIM_HORIZON iterator 
Fixes spring-cloud/spring-cloud-stream-binder-aws-kinesis#47

* Document `headers` binder configuration property
* Mention binder configuration properties prefix
* Some other Docs polishing
 2018-03-30 14:34:28 -04:00
Artem Bilan
060fbd22af Adapt to the latest SI-AWS 2018-03-19 16:02:07 -04:00
Artem Bilan
5127dbeb25 Some project structure refactoring 
* Remove `starter` module as redundant
* Absorb `core` module to the `binder` directly - there is not going to
be some other Kinesis binder implementation
* Fix poms and Docs on the matter
 2018-03-12 14:19:23 -04:00
Artem Bilan
02eef380dc GH-44: Fix injection for extended binding props 
Fixes spring-cloud/spring-cloud-stream-binder-aws-kinesis#44

The `KinesisExtendedBindingProperties` has been missed for injection to
the `KinesisMessageChannelBinder`, therefore we couldn't be able to
overrider `consumer` or `producer` properties for bindings
* Add custom `idleBetweenPolls` and `binder.headers` testing to the
`KinesisBinderProcessorTests`
* Add removal for streams from Kinesis in the
`LocalKinesisResource.cleanupResource()` to have a clean kinesalite
environment in between tests
 2018-03-12 11:52:04 -04:00
Artem Bilan
69ff2f3af7 Add Source binding to KinesisBinderProcessorTests 
Related to https://github.com/spring-cloud/spring-cloud-stream-binder-aws-kinesis/issues/42

And SCSt `Source` binding to the `KinesisBinderProcessorTests` to be
sure that embedded headers work well
 2018-03-05 21:50:28 -05:00
Artem Bilan
3be394c5bd Upgrade dependencies 2018-03-01 15:26:42 -05:00
Artem Bilan
53c478c9ec Add test coverage for consumer errors 2018-02-23 12:41:06 -05:00
Artem Bilan
c1ad6e8a60 Fix link in the README 2018-02-12 21:10:10 -05:00
Artem Bilan
a9532de843 Improve Docs and link from the root README 2018-02-12 21:07:50 -05:00
Soby Chacko
1b210c16e5 Next version: 1.0.0.BUILD-SNAPSHOT 2018-02-12 16:19:57 -05:00
Soby Chacko
d29b27ef16 Update mvnw to sync with core spring cloud stream 2018-02-12 16:15:11 -05:00
Soby Chacko
391f2f3bd1 1.0.0.M1 Release 2018-02-12 16:02:43 -05:00
Soby Chacko
0eaa6f77d6 Add update-version script for release 2018-02-12 16:01:47 -05:00
Artem Bilan
cd7ddc254f Upgrade to SI-AWS-2.0.0.M1 2018-02-12 15:02:18 -05:00
Artem Bilan
50d289a287 Add processor integration test 
* Upgrade dependencies to Milestones to be ready for releasing
* Add `@ConditionalOnMissingBean` for the `amazonKinesis` bean to be
able to override it in the tests, e.g. with mocks or against Kinesalite
* Make default `partitionKey` against `payload.hashCode()`
* Fix typo in the `KinesisStreamProvisioner`
* Fix `KinesisBinderTests` for compatibility with the latest SCSt
* Replace `log4j.properties` with the `logback-test.xml` to get a real
logging in tests
* Mention `Object.hashCode()` for partition key in the Docs
 2018-02-10 19:37:09 -05:00
Artem Bilan
0aeb49050f Fix Checkstyle violations 2018-01-26 14:42:32 -05:00
Artem Bilan
6d7c810e08 Make AC access from the createBindableChannel() 
To let test to interact with conventional beans override
`createBindableChannel()` in the `KinesisBinderTests` to obtain
`MessageConverterConfigurer` from the provided `ApplicationContext`
 2018-01-26 14:22:09 -05:00
Artem Bilan
78143989da GH-34: Add error handling to the consumer 
Fixes spring-cloud/spring-cloud-stream-binder-aws-kinesis#34
 2018-01-25 18:58:53 -05:00
Artem Bilan
aaf7295a97 GH-30: Add ConsumerProperties.shardIteratorType 
Fixes spring-cloud/spring-cloud-stream-binder-aws-kinesis#30
 2018-01-04 13:27:10 -05:00
Artem Bilan
490fc5b1d6 GH-21: Upgrade to Spring Cloud 2.0 
Fixes: spring-cloud/spring-cloud-stream-binder-aws-kinesis#21

* Fix all the compatibility with SI-5.0 and SCSt-2.0
 2017-12-22 09:14:39 -05:00
Jacob Severson
1d46d7a401 GH-10: Error channel configuration 
Provides the error channel to the underlying `KinesisMessageHandler`.

Resolves spring-cloud/spring-cloud-stream-binder-aws-kinesis#10

Adding a test for the error channel

Fixing checkstyle errors

Fixing docs

Forgot a word
 2017-11-29 13:37:15 -05:00
Artem Bilan
d3f0970ea4 Upgrade to SC-AWS-1.2.2 and SI-AWS-1.1.0.RELEASE 2017-11-27 14:44:23 -05:00