Commit Graph

95 Commits

Author SHA1 Message Date
Michael Minella
066c59a390 Add job repository polling option to MessageChannelPartitionHandler
When using remote partitioning, each slave worker persists it's current
status in the same job repsository that the master uses.  Because of
this, there is no hard need for the master to wait for each worker to
send a formal response once it's work is complete.  Instead, the master
(at the cost of polling a db periodically) can determine if the workers
are done by looking up each partition's status in the job repository.
This commit removes the requirement for a reply channel and implements
the polling of the job repository to determine if the workers are done.

BATCH-2332
2014-12-23 16:29:41 -06:00
Michael Minella
2fec70d25e Add null check to AsyncItemWriter
The AsyncItemWriter is used in conjunction with the AsyncItemProcessor
to unwrap the Futures that are returned by that processor.
Traditionally when an ItemProcessor returns null, it's considered having
been filtered out and should not be passed to the ItemWriter.  In this
case, the AsyncItemWriter was not checking for nulls so they were being
passed to the delegate ItemWriter.  Most of the OOTB ItemWriters do not
perform a null check prior to doing the write so they were throwing NPEs
when using this paradigm.
2014-09-11 11:53:17 -05:00
Chris Schaefer
4f32f623f0 BATCH-2241 & BATCH-2243 - add namespace support for remote chunking 2014-09-03 01:10:47 -04:00
Michael Minella
deb4c6fb5b BATCH-2283: Updated MessageChannelPartitionHandler to return null when no partitions are specified 2014-08-06 14:52:02 -05:00
Michael Minella
e7a4e348a5 BATCH-2229 & BATCH-2218: Removed OSGi related metadata and Maven POMs 2014-05-12 15:32:02 -05:00
Michael Minella
f6b83167ac XD-1389: Added null check when receiving partitioned messages back to handle timeouts 2014-05-01 09:48:02 -05:00
Michael Minella
9d17a3d088 Updated Spring Batch Integration to use Spring Integration 4.0.0.RC1 2014-04-16 09:44:46 -05:00
Michael Minella
74992367a2 BATCH-2188: Refactored package.html to package-info.java and added package-info.java to all packages that needed one 2014-04-02 16:23:09 -05:00
Gary Russell
7954bbdf9d SPR 4.0.0.RELEASE and SI 4.0.0.M2 Compatibility
Updates to make spring-batch-integration compatible with these releases.
2014-01-07 14:07:28 -06:00
Gary Russell
5105f59dd1 Initial SF/SI 4
More
2014-01-07 14:07:28 -06:00
Michael Minella
aa099d226c BATCHADM-161: Tightened up tests and XML configurations 2014-01-07 13:35:12 -06:00
Gunnar Hillert
3909b75151 BATCHADM-161 - Add Job Launching Gateway
For reference see: https://jira.springsource.org/browse/BATCHADM-161

* Add XML Schema
* Add Namespace Handler
* Add Parser and Gateway classes
* Add tests
2014-01-07 13:35:12 -06:00
willschipp
f23dd64740 BATCHADM-137 - added optional setting of the replyChannel externally in
the messagechannelparitionhandler
2014-01-07 13:35:12 -06:00
Michael Minella
9c942734e6 BATCHADM-155: Updated to support Spring Batch 2.2.0 2014-01-07 13:35:12 -06:00
Dave Syer
57993c31af BATCHADM-102: Change MessageChannelPartitionHandler to not require a replyChannl 2014-01-07 13:33:50 -06:00
Dave Syer
5b646c4edf BATCHADM-81: add step context manipulation for async processors
- AsyncItemProcessor creates step context for its runnable
 - We also provide StepContextInterceptor for supplying StepExecution to downsteam consumers
2014-01-07 13:33:50 -06:00
Dave Syer
0f10341479 BATCHADM-69: add error rendering to JSON views
+ Make execution the default view after a job launch not from UI
2014-01-07 13:33:49 -06:00
Dave Syer
88638ce05f BATCHADM-72: Improve chunking traceability
- add sequence info to chunks
- Improve logging in ChunkMessageChannelItemWriter
- Add mysql/h2/derby properties to integration project
- Add drop scripts necessary for persistent databases
2014-01-07 13:33:48 -06:00
David Syer
d2f547b2d3 Update for changes to Spring Integration 2014-01-07 13:33:32 -06:00
David Syer
668b6bd270 Add interface for JobLaunchRequestHandler 2014-01-07 13:33:32 -06:00
David Syer
91c2272947 BATCHADM-60: change log level 2014-01-07 13:33:32 -06:00
David Syer
95ab089713 BATCHADM-58: updgrade to Spring 3.0.4 to solve thread scope problem 2014-01-07 13:33:31 -06:00
David Syer
3c88bea0f1 BATCHADM-58: fix some tests after upgrade, ignore others 2014-01-07 13:33:31 -06:00
David Syer
bced2c5595 BATCHADM-58: first cut with all features and SI 2.0 2014-01-07 13:33:31 -06:00
David Syer
6df8e4162b Upgrade Spring and add some JSON services 2014-01-07 13:33:31 -06:00
David Syer
933bb75ee3 BATCHADM-49: Added redelivered flag to ChunkResponse 2014-01-07 13:21:05 -06:00
David Syer
c87d9418f5 BATCHADM-49: Use a ChannelInterceptor to turn a ThreadLocalChannel into a pass-thru channel. Keeps JMS receive in the caller's transaction. 2014-01-07 13:21:04 -06:00
David Syer
e9eae8da7b BATCHADM-49: add some javadocs + look at thread safety in chunk writer 2014-01-07 13:21:04 -06:00
David Syer
442e5f74ad BATCHADM-49: fix build by checking for fault tolerant processor 2014-01-07 13:21:04 -06:00
David Syer
6ca0512753 BATCHADM-49: added JMS integration test 2014-01-07 13:21:04 -06:00
David Syer
001483bcc8 BATCHADM-49: loop back step contributions through writer 2014-01-07 13:21:04 -06:00
David Syer
a775465c67 BATCHADM-48: replace MessageOrientedStep 2014-01-07 13:21:04 -06:00
David Syer
c30a58bfb5 Tidy up some TODOs 2014-01-07 13:21:03 -06:00
David Syer
e031518e94 BATCHADM-18: remove old job factory and replace with unit test 2014-01-07 13:21:03 -06:00
David Syer
a0bc87c3e4 BATCH-1466, BATCHADM-16: move integration project 2014-01-07 13:21:03 -06:00
dsyer
ff42839b01 BATCH-1466: removed integration module 2009-12-29 09:26:07 +00:00
dsyer
f272684152 Add Job with chunked step as test sample 2009-11-28 09:18:55 +00:00
dsyer
db485dbd10 OPEN - issue BATCH-46: Integrate demo project with S2EB webapp
https://jira.springsource.com/browse/BATCH-46
2009-09-07 14:05:23 +00:00
dsyer
a43a4ec623 Added async item processor (could be moved into infrastructure at some point). 2009-05-10 18:51:49 +00:00
dsyer
91cf3c83c3 Add MessageChannelPartitionHandler 2009-05-06 12:22:21 +00:00
dsyer
f7a89aa85f Remove MessageChannelItemWriter in favour of using a MessagingGateway (integration test included as demo) 2009-03-06 07:32:20 +00:00
dsyer
7533f90480 BATCH-1011: Refactor BatchStatus again so that FAILED has the same meaning as before (1.1.x etc.) and ABANDONED is introduced to signify a step that failed but does not need to be replayed on restart (formerly known as INCOMPLETE). 2009-02-15 10:59:44 +00:00
dhgarrette
b04841548e BATCH-1064: Switched the semantics of INCOMPLETE and FAILED. Combined INCOMPLETE with STOPPED. INCOMPLETE jobs and steps can be restarted while COMPLETED and FAILED jobs and steps cannot. 2009-02-13 06:12:28 +00:00
robokaso
f4fa341233 RESOLVED - BATCH-1026: Rename ExitStatus.FINISHED to ExitStatus.COMPLETED 2009-01-27 11:38:26 +00:00
dsyer
5e69b39a97 RESOLVED - issue BATCH-1022: Chunk is not serializable but is wrapped by a Serializable ChunkRequest 2009-01-27 07:43:23 +00:00
robokaso
649abb69e8 RESOLVED - BATCH-983: Remove StepExecutionResourceProxy in favor of late-binding
applied patches
2009-01-13 12:46:04 +00:00
dsyer
df2ef02932 CLOSED - issue BATCH-979: Insert Apache license header in Java sources (where missing) 2009-01-13 11:08:59 +00:00
dsyer
25e456e4f1 Update constructor for Chunk 2009-01-05 12:15:17 +00:00
dsyer
a6479602e2 BATCH-919: reuse ChunkProcessor in integration 2008-12-30 16:32:29 +00:00
dsyer
ce14c590da BATCH-963: new ItemStream interface close() with no args 2008-12-10 13:33:28 +00:00