SpringCloud/stream-applications
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

GH-249: Add metadata-store to file-supplier (#251)

Browse Source 
Fixes https://github.com/spring-cloud/stream-applications/issues/249

Currently, the metadata store is supported by remote files source (S3, ftp and sftp), but not by file source.
There are cases where it is convenient to be able to use the metadata store with file source as well.

* Add externally configured `ConcurrentMetadataStore` into `FileSupplierConfiguration`
which is based on the auto-configuration provided by the `metadata-store-common` artifact
* Test with an embedded JDBC store
* Remove redundant dependencies in the file-supplier pom - supplied by the parent
* Add `MetadataStoreProperties` to allow-list for dataflow
* Fix typo in the `s3-supplier` README
This commit is contained in:
Artem Bilan
2022-03-30 11:41:34 -04:00
committed by GitHub
parent 3c052b5b22
commit f5451500a7
6 changed files with 87 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
applications/source/file-source/src/main/resources/META-INF/dataflow-configuration-metadata-whitelist.properties
View File

@@ -1,2 +1,10 @@
configuration-properties.classes=org.springframework.cloud.fn.supplier.file.FileSupplierProperties,\
org.springframework.cloud.fn.common.file.FileConsumerProperties
org.springframework.cloud.fn.common.file.FileConsumerProperties, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Gemfire, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Redis, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$DynamoDb, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Jdbc, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Zookeeper, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Mongo

10
applications/source/file-source/src/main/resources/META-INF/dataflow-configuration-metadata.properties
View File

@@ -1,2 +1,10 @@
configuration-properties.classes=org.springframework.cloud.fn.supplier.file.FileSupplierProperties,\
org.springframework.cloud.fn.common.file.FileConsumerProperties
org.springframework.cloud.fn.common.file.FileConsumerProperties, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Gemfire, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Redis, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$DynamoDb, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Jdbc, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Zookeeper, \
org.springframework.cloud.fn.common.metadata.store.MetadataStoreProperties$Mongo