Commit Graph

299 Commits

Author SHA1 Message Date
Michael Minella
066c59a390 Add job repository polling option to MessageChannelPartitionHandler
When using remote partitioning, each slave worker persists it's current
status in the same job repsository that the master uses.  Because of
this, there is no hard need for the master to wait for each worker to
send a formal response once it's work is complete.  Instead, the master
(at the cost of polling a db periodically) can determine if the workers
are done by looking up each partition's status in the job repository.
This commit removes the requirement for a reply channel and implements
the polling of the job repository to determine if the workers are done.

BATCH-2332
2014-12-23 16:29:41 -06:00
Michael Minella
2fec70d25e Add null check to AsyncItemWriter
The AsyncItemWriter is used in conjunction with the AsyncItemProcessor
to unwrap the Futures that are returned by that processor.
Traditionally when an ItemProcessor returns null, it's considered having
been filtered out and should not be passed to the ItemWriter.  In this
case, the AsyncItemWriter was not checking for nulls so they were being
passed to the delegate ItemWriter.  Most of the OOTB ItemWriters do not
perform a null check prior to doing the write so they were throwing NPEs
when using this paradigm.
2014-09-11 11:53:17 -05:00
Chris Schaefer
4f32f623f0 BATCH-2241 & BATCH-2243 - add namespace support for remote chunking 2014-09-03 01:10:47 -04:00
Michael Minella
deb4c6fb5b BATCH-2283: Updated MessageChannelPartitionHandler to return null when no partitions are specified 2014-08-06 14:52:02 -05:00
Michael Minella
e7a4e348a5 BATCH-2229 & BATCH-2218: Removed OSGi related metadata and Maven POMs 2014-05-12 15:32:02 -05:00
Michael Minella
f6b83167ac XD-1389: Added null check when receiving partitioned messages back to handle timeouts 2014-05-01 09:48:02 -05:00
Michael Minella
5e07b249ad Updated commons-dbcp and commons-pool dependency scopes 2014-04-25 15:30:23 -05:00
Gunnar Hillert
f1d71a06f4 BATCH-2144 Convert Spring Batch to use Gradle
* Use Gradle 1.11
* Remove SpringSource references
* Update JavaDoc overview
* Update Jacoco conf + Add license/manifest files
* Addresses also BATCH-2187
* Update a number of unit tests to not be ignored

Jira: https://jira.springsource.org/browse/BATCH-2144
2014-04-24 12:16:17 -05:00
Michael Minella
9d17a3d088 Updated Spring Batch Integration to use Spring Integration 4.0.0.RC1 2014-04-16 09:44:46 -05:00
Chris Schaefer
4e25560c4d BATCH-2195: Document Spring Batch Integration
* Removed APT files
* General formatting and spelling fixes
* Converted README.md to docbook
* Expanded converted README.md docs to include usable code snippets
2014-04-11 13:02:53 -04:00
Michael Minella
74992367a2 BATCH-2188: Refactored package.html to package-info.java and added package-info.java to all packages that needed one 2014-04-02 16:23:09 -05:00
Chris Schaefer
65f37c170a BATCH-2201: Update URL's to point to spring.io in docs
Update URLs pointing to springframework/springsource to spring.io.
Remove links that have no redirection
2014-03-25 12:24:37 -04:00
Chris Schaefer
1ad8bd803a Add initial 3.0 documentation
* What's new
  * JSR-352
  * Convert Spring Batch Integration apt files into docbook and use as chapter
  * Remove site dir from Spring Batch Integration where converted apt files used
    to live
2014-03-21 13:01:05 -05:00
Michael Minella
ff7793cacf [maven-release-plugin] prepare for next development iteration 2014-02-21 21:42:59 -06:00
Michael Minella
f690c496c4 [maven-release-plugin] prepare release 3.0.0.M3 2014-02-21 21:42:55 -06:00
Chris Schaefer
ef0823938c BATCH-2111: Java 8 / Upgrade to Spring 4
* Upgrade Spring framework to 4.0.2.RELEASE
* Upgrade maven compiler plugin to 3.1
* Use LinkedHashMap to preseve ordering in AbstractFlowParser (found when upgrading to JDK 8)
* Match on EnhancerBySpringCGLIB in StepScopeProxyTargetClassOverrideIntegrationTests (SPR-11398)
2014-02-20 12:53:32 -06:00
Michael Minella
1bb02e4f55 Consolidated Spring Batch Integration into the regular Spring Batch build. Note: There will need to be additional build work done during the release process. That will be addressed then 2014-01-07 16:33:14 -06:00
Gary Russell
7954bbdf9d SPR 4.0.0.RELEASE and SI 4.0.0.M2 Compatibility
Updates to make spring-batch-integration compatible with these releases.
2014-01-07 14:07:28 -06:00
Gary Russell
e5afdf735e @Ignore 2 Tests
Two tests don't run under Spring 4; needs investigation.
2014-01-07 14:07:28 -06:00
Gary Russell
5105f59dd1 Initial SF/SI 4
More
2014-01-07 14:07:28 -06:00
Andrew Eisenberg
c6b804bfe3 Expose Job parameters in JdbcSearchableJobExecutionDao
See https://jira.springsource.org/browse/BATCHADM-176

Must be applied after
https://github.com/spring-projects/spring-batch/pull/231

As part of this, I had to update the dependency on spring-batch to
3.0.0-BUILD_SNAPSHOT.

Because of this dependency change, I had to add two
methods to JobRepositorySupport.  It looks like a stub class, so I
left the two methods implemented as stubs.
2014-01-07 14:07:28 -06:00
Michael Minella
1eb57b9aa1 [maven-release-plugin] prepare for next development iteration 2014-01-07 14:07:28 -06:00
Michael Minella
ad04dfcce4 [maven-release-plugin] prepare release 1.3.0.M1 2014-01-07 14:07:28 -06:00
Michael Minella
2f64582fdf Updated version numbers
Corrected SCM urls
Added release plugin
2014-01-07 14:07:28 -06:00
Gunnar Hillert
dca766c317 * BATCHADM-160 - Update Spring Batch Integration Documentation
- created initial version
  - use README.md for now as the documentation vehicle
  - https://jira.springsource.org/browse/BATCHADM-160
* BATCHADM-163 - Add documentation for namespace support
  - https://jira.springsource.org/browse/BATCHADM-163
2014-01-07 14:07:28 -06:00
Michael Minella
5eb39ca118 BATCHADM-161: Tightened up tests and XML configurations 2014-01-07 14:07:28 -06:00
Gunnar Hillert
143cb4925a BATCHADM-161 - Add Job Launching Gateway
For reference see: https://jira.springsource.org/browse/BATCHADM-161

* Add XML Schema
* Add Namespace Handler
* Add Parser and Gateway classes
* Add tests
2014-01-07 14:06:42 -06:00
Michael Minella
aa099d226c BATCHADM-161: Tightened up tests and XML configurations 2014-01-07 13:35:12 -06:00
Gunnar Hillert
3909b75151 BATCHADM-161 - Add Job Launching Gateway
For reference see: https://jira.springsource.org/browse/BATCHADM-161

* Add XML Schema
* Add Namespace Handler
* Add Parser and Gateway classes
* Add tests
2014-01-07 13:35:12 -06:00
willschipp
f23dd64740 BATCHADM-137 - added optional setting of the replyChannel externally in
the messagechannelparitionhandler
2014-01-07 13:35:12 -06:00
Michael Minella
9c942734e6 BATCHADM-155: Updated to support Spring Batch 2.2.0 2014-01-07 13:35:12 -06:00
dvictor
4dc5dddc16 BATCHADM-125: Version-less URLs for S.I. 2.1
Also changes for deprecation of interval-trigger on poller.

BATCHADM-125 Polishing (garyrussell)

Revert spaces to tabs; fix up some inconsistent newlines.

RemoteChunkFaultTolerantStepJdbcIntegrationTests-context.xml
FileDropJobIntegrationTests-context.xml
AbstractIntegrationViewTests-context.xml
VanillaIntegrationTests-context.xml
RepeatTransactionalPollingIntegrationTests-context.xml
RetryRepeatTransactionalPollingIntegrationTests-context.xml
TransactionalPollingIntegrationTests-context.xml
RetryTransactionalPollingIntegrationTests-context.xml
2014-01-07 13:34:57 -06:00
Dave Syer
4cebb97355 [maven-release-plugin] prepare for next development iteration 2014-01-07 13:34:57 -06:00
Dave Syer
75e984b095 [maven-release-plugin] prepare release 1.2.1.RELEASE 2014-01-07 13:34:57 -06:00
Dave Syer
5779a04cfb Fix tests after upgrade to 2.1.7 2014-01-07 13:34:32 -06:00
Dave Syer
c06c3ec289 JMS tests cannot run in same context 2014-01-07 13:34:02 -06:00
Dave Syer
2397b8bfb5 Fix logging dependencies, and upgrade Spring Integration 2014-01-07 13:34:02 -06:00
Dave Syer
db5d76b239 Rationalise Eclipse meta data - remove everything not strictly needed 2014-01-07 13:34:02 -06:00
Dave Syer
57993c31af BATCHADM-102: Change MessageChannelPartitionHandler to not require a replyChannl 2014-01-07 13:33:50 -06:00
Dave Syer
077a15c640 [maven-release-plugin] prepare for next development iteration 2014-01-07 13:33:50 -06:00
Dave Syer
c2912a1882 [maven-release-plugin] prepare release 1.2.0.RELEASE 2014-01-07 13:33:50 -06:00
Dave Syer
9348ec35a5 Use Central version of Derby for testing 2014-01-07 13:33:50 -06:00
Dave Syer
a5467d1ce6 [maven-release-plugin] prepare for next development iteration 2014-01-07 13:33:50 -06:00
Dave Syer
5ac2c4e988 [maven-release-plugin] prepare release X.1.2.0.RC1DreleaseVersion=1.2.0.RC1 2014-01-07 13:33:50 -06:00
Dave Syer
5b646c4edf BATCHADM-81: add step context manipulation for async processors
- AsyncItemProcessor creates step context for its runnable
 - We also provide StepContextInterceptor for supplying StepExecution to downsteam consumers
2014-01-07 13:33:50 -06:00
dsyer
8b3cd863fa Fix classpath for new git clone 2014-01-07 13:33:49 -06:00
Dave Syer
c5d352bf06 [maven-release-plugin] prepare for next development iteration 2014-01-07 13:33:49 -06:00
Dave Syer
9eef9abcdc [maven-release-plugin] prepare release 1.2.0.M1 2014-01-07 13:33:49 -06:00
Dave Syer
c93eb46a98 Change version in poms to reflect 1.2.0 release 2014-01-07 13:33:49 -06:00
Dave Syer
cfe666f7fe Add retry for in-memory databases in case they lock 2014-01-07 13:33:49 -06:00