Commit Graph

5378 Commits

Author SHA1 Message Date
Spring Buildmaster
5be1c9af94 [artifactory-release] Next development version 2019-08-03 03:13:47 +00:00
Spring Buildmaster
3336bf7ea8 [artifactory-release] Release version 4.2.0.M3 2019-08-03 03:13:43 +00:00
Michael Minella
117e52bde5 Updates 2019-08-02 22:02:10 -05:00
Michael Minella
4fa15dd53d Still working on the DecisionStepTests#testDecisionAfterSplit 2019-08-02 21:57:50 -05:00
Michael Minella
4287f5a2ce Updated to address DecisionStepTests#testDecisionAfterSplit occasional failure 2019-08-02 21:28:49 -05:00
Michael Minella
a140a9f5a1 Attempting to fix the KafkaItemReaderTests#testReadFromMultiplePartitionsAfterRestart 2019-08-02 17:06:54 -05:00
Michael Minella
683340e23f Updated versions for release 2019-08-02 15:55:56 -05:00
Michael Minella
4b9554fcce Polish 2019-08-02 14:33:45 -05:00
Jay Bryant
85b3e90026 Replacing "master" and "slave"
Per a request from Michael Minella, I replaced "master" with "manager" and "slave" with "worker" in the Spring Batch Reference Guide. I heartily concur with replacing terms that have such dark connotations.
2019-08-02 14:33:37 -05:00
Mahmoud Ben Hassine
3743894fa4 Replace "Master/Slave" with "Manager/Worker"
Resolves BATCH-2834
2019-08-02 13:13:54 -05:00
Jay Bryant
3f126fe0ff Fixed a refresh bug in the document toggle
While working on another feature, I noticed that the document toggle wasn't updating the ToC. I fixed that. (It matters only in the case where entire headings are toggled, but we do have one such case.)
2019-08-01 09:59:19 -05:00
Mahmoud Ben Hassine
f26165e764 Polish bd53168ddb 2019-07-30 18:02:34 +02:00
David Turanski
bd53168ddb Implement AvroItemReader and AvroItemWriter
Resolves BATCH-2833
2019-07-30 17:57:54 +02:00
Mahmoud Ben Hassine
872845cae8 Improve the lookup for running job executions in CommandLineJobRunner
Before this commit, getting the running job executions loaded
all job executions from the database and filtered them in-memory.

This commit uses `JobExplorer#findRunningJobExecutions` which issues
a query that does the filtering on the database side. This change
considerably improves the performance of stopping a job.

Resolves BATCH-2422
2019-07-26 10:24:20 -05:00
Michael Minella
fda70ccbcb Fixed integration test breaking build 2019-07-25 17:31:25 -05:00
Mahmoud Ben Hassine
7c1fbede1b Add new methods to get the last job instance/execution in JobInstance/JobExecution DAOs
Before this commit, getting the last job instance/execution required to
load all job instances/executions from the database and filter them
on the client side in memory.

This commit introduces new methods that use database queries to get
the last job instance/execution without the need to load all job
instances/executions. This change improves memory consumption as well as
the performance of starting the next instance of a job.

Resolves BATCH-1784
2019-07-25 10:56:19 -05:00
Mahmoud Ben Hassine
afc25dc873 Update Spring projects dependencies to latest BUILD-SNAPSHOT 2019-06-14 15:20:26 +02:00
Mahmoud Ben Hassine
cae3f33122 Disable fuzzy matching when distanceLimit = 0
Before this commit, fuzzy matching is performed even though exact
matching is requested (distanceLimit = 0).

This commit bypasses fuzzy matching when distanceLimit = 0 which
improves performance.

Resolves BATCH-1801
2019-05-30 14:22:38 +02:00
Ron Sims II
39f4d71949 Fix typo in error message in JdbcCursorItemReaderBuilder 2019-05-27 12:54:04 +02:00
Mahmoud Ben Hassine
56ef0f35a9 Polish 229fed4e24
- Remove duplicate code
- Add assertions in `testPersist`
- Add integration tests
2019-05-23 15:22:57 +02:00
Chris Cranford
229fed4e24 BATCH-2462 Allow JpaItemWriter to support persist rather than merge for improved performance. 2019-05-23 12:08:05 +02:00
Mahmoud Ben Hassine
4d3090ac02 Show step execution duration in the logs
Resolves BATCH-2823
2019-05-20 16:11:14 +02:00
Mahmoud Ben Hassine
10f2281996 Show job execution duration in the logs
Resolves BATCH-2775
2019-05-16 14:52:21 +02:00
Spring Buildmaster
9135423424 [artifactory-release] Next development version 2019-05-13 21:20:42 +00:00
Spring Buildmaster
84d408a858 [artifactory-release] Release version 4.2.0.M2 2019-05-13 21:20:38 +00:00
Mahmoud Ben Hassine
b2e0d1e209 Add new line in gradle.properties 2019-05-13 23:01:46 +02:00
Mahmoud Ben Hassine
452cfdf0d7 Update dependencies 2019-05-13 22:40:53 +02:00
Mahmoud Ben Hassine
56bd4d651d Update Spring Framework version to 5.2.0.M2 2019-05-13 22:40:23 +02:00
Mahmoud Ben Hassine
e79cb7d55a Update documentation 2019-05-13 18:24:17 +02:00
Mahmoud Ben Hassine
b19998a40a Fix KafkaItemReader
This commit introduces the changes discussed in PR #664:

* Remove `OffsetsProvider`: We only need offsets to be retrieved from
the execution context in a restart scenario
* Make the reader inherit from `AbstractItemStreamItemReader` instead
of `AbstractItemCountingItemStreamItemReader`. With Kafka offsets, item
counting does not make sense
* Remove `assignTimeoutProvider`. A configurable poll timeout with
a default value is enough.
* Update the constructor of the reader to accept consumer properties,
a topic name and a list of partitions instead of leaking Kafka APIs like
`TopicPartition` and `ConsumerFactory`.

Resolves BATCH-2764
2019-05-13 12:30:19 +02:00
Mathieu Ouellet
77c9b74673 Add KafkaItemReader
Resolves BATCH-2764
2019-05-10 18:40:53 +02:00
Mahmoud Ben Hassine
4e7c64a443 Add method to set a custom BufferedReaderFactory in FlatFileItemReaderBuilder
Resolves BATCH-2770
2019-05-09 16:48:53 +02:00
Mahmoud Ben Hassine
e6a84e1ac2 Mark the parameter of LineTokenizer#tokenize as @Nullable
According to the Javadoc of LineTokenizer#tokenize, the parameter `line`
can be null. This commit adds `@Nullable` to that parameter.

Resolves BATCH-2776
2019-05-09 08:58:47 +02:00
Mahmoud Ben Hassine
00ac7c5833 Polish 06556dc97e 2019-05-07 17:14:12 +02:00
Mathieu Ouellet
06556dc97e Add Kafka ItemWriter
This commit adds an ItemWriter implementation for Apache Kafka using
a KafkaTemplate with default topic set. Extending KeyValueItemWriter,
the writer requires a Converter to map the Kafka ProducerRecord's key
from the item.

Resolves BATCH-2765
2019-05-07 17:06:20 +02:00
Mahmoud Ben Hassine
96ec0d0d27 Add metrics sample
Issue BATCH-2774
2019-04-23 14:17:13 -05:00
Spring Buildmaster
4de1a9056e [artifactory-release] Next development version 2019-04-15 20:18:59 +00:00
Spring Buildmaster
691ea2deff [artifactory-release] Release version 4.2.0.M1 2019-04-15 20:18:55 +00:00
Mahmoud Ben Hassine
4ff28bf09b Add new line in gradle.properties 2019-04-15 21:59:37 +02:00
Mahmoud Ben Hassine
9c2aae505c Upgrade SI version to 5.2.0.M1 2019-04-15 21:46:52 +02:00
Mahmoud Ben Hassine
3bc00a7c07 Fix batch metrics test
Micrometer's global registry might contain other metrics than
those from Spring Batch. This commit updates the test to expect
at least those from Spring Batch to be registered.

Issue BATCH-2774
2019-04-15 08:35:01 +02:00
Mahmoud Ben Hassine
b24a05d532 Upgrade dependencies 2019-04-11 18:49:46 +02:00
Mahmoud Ben Hassine
57c8d70ff3 Initial support for batch metrics with Micrometer
Implements BATCH-2774
2019-04-11 15:53:30 +02:00
Jay Bryant
145bacc34a Use spring-doc-resources 2019-04-05 21:48:24 +02:00
Saikat Bhadra
30365edf58 Fix typo in log message
Resolves BATCH-2782
2019-04-02 10:07:06 +02:00
Mahmoud Ben Hassine
b4978231b5 Fix import in BeanValidatingItemProcessor
Resolves BATCH-2802
2019-04-02 09:58:19 +02:00
Mahmoud Ben Hassine
a272327922 Bump Spring AMQP version to 2.2.0.BUILD-SNAPSHOT 2019-03-28 22:58:34 +01:00
Mahmoud Ben Hassine
a9fc6be6be Fix schema location of jsr 352 namespace 2019-03-26 21:53:14 +01:00
Spring Operator
d8fc58338d URL Cleanup
This commit updates URLs to prefer the https protocol. Redirects are not followed to avoid accidentally expanding intentionally shortened URLs (i.e. if using a URL shortener).

# Fixed URLs

## Fixed Success
These URLs were switched to an https URL with a 2xx status. While the status was successful, your review is still recommended.

* [ ] http://www.apache.org/licenses/ with 2 occurrences migrated to:
  https://www.apache.org/licenses/ ([https](https://www.apache.org/licenses/) result 200).
* [ ] http://www.apache.org/licenses/LICENSE-2.0 with 1796 occurrences migrated to:
  https://www.apache.org/licenses/LICENSE-2.0 ([https](https://www.apache.org/licenses/LICENSE-2.0) result 200).
2019-03-22 10:08:19 +01:00
Mahmoud Ben Hassine
b29b789ae9 Polish 758e6f30de
This commit fixes URLs as requested in "HTTP URLs that Could Not Be Fixed"
of PR #695
2019-03-21 19:15:38 +01:00