Commit Graph

1857 Commits

Author SHA1 Message Date
Michael Minella
70875e946a Changed FlowParser to always include a transition for COMPLETED unless a next attribute is present 2014-02-06 13:03:45 -06:00
Michael Minella
b278239751 BATCH-2110: Updated batch to support Spring 4
* Refactored iBatis based readers and writers to not utilize
 SqlMapClientTemplate.
* Depricated all iBatis based readers and writers in favor of MyBatis's
 native Spring support.
* Updated XStream support to 1.4.4 and Jettison to 1.2 to be in
 alignment with Spring 4.
* Added the PooledEmbeddedDataSource to address the issue outlined in
 SPR-11372.
2014-02-06 11:34:33 -06:00
Michael Minella
ed310069fe BATCH-2163: Updated documentation and copyright dates 2014-02-05 16:35:38 -06:00
Luke Taylor
2c007deaf6 BATCH-2163: Add support for SQLite.
Adds a DatabaseType, scripts, a DataFieldMaxValueIncrementer and
a PagingQueryProvider for SQLite.
2014-02-05 16:16:07 -06:00
Michael Minella
cde60fe938 Per JSR-352, restart is a two step process, establishing where to begin
evaluation and then evaluating each state.  This update addresses the
flagging of the point the current job restarted from so that the
evaluation of restart can occur in subsequent states.
2014-01-28 15:04:53 -06:00
Michael Minella
3853088394 Updated to correctly handle state management on restarts per JSR-352
* Added a JSR-352 specific StepHandler implementation
(DefaultStepHandler)
* Added logic to DefaultFlow to correctly lookup where to restart a job
that was previously stopped.
2014-01-17 14:45:47 -06:00
Michael Minella
8f9783f0d4 Created JSR-352 specific SplitState to address resetting the JobExecution's ExitStatus after a split executes 2014-01-16 16:24:19 -06:00
Chris Schaefer
ea7a704299 Add failed transition if none exists when next attribute is used.
Fixes TCK test testStartLimitVariation1
2014-01-13 16:13:44 -05:00
Michael Minella
b0c9af5e8e Fixes for stopping a partitioned step
* StepState now implements StepLocator so that the step it wraps can return slave steps in the case of a partitioned step
* FlowJob and SimpleJob now look for a StepLocator as they look for steps
* The JSR-352 version of PartitionStep implements StepLocator
2014-01-08 13:51:49 -06:00
Michael Minella
589ffdc9b7 Consolidated the calculation for non default ExitStatuses and applied that logic on job stops 2014-01-03 15:11:22 -06:00
Michael Minella
62c541ee42 Implemented the restart functionality for a partitioned step
* Updated parsers to address the allowStartIfComplete flag on
 partitioned steps
* Updated factory beans to address the above flag and injecting a
 JobRepository reference where needed
* Updated how state is restored for a JSR-352 partitioned step
* Fixed the synchronization around the queue used for a
 PartitionCollecotr and PartitionAnalyzer works
2014-01-03 13:13:17 -06:00
Chris Schaefer
6d26e40cc8 Implement onSkipInWrite for delegate to handle
Fixes TCK tests: testChunkSkipWrite and testChunkSkipWriteExceedSkip
2014-01-02 17:07:29 -05:00
Michael Minella
681c1dccd9 Changed the exception being thrown in the ChunkListenerAdatper from BatchRuntimeExcpetion to UncheckedTransactionException so it will be unwrapped by TaskletStep 2014-01-02 14:53:53 -06:00
Chris Schaefer
c46a134539 * Update copyright year
* Move addition of state transition for elements with a next transition to be last
* Move restartable check into run method on restart to avoid NPE in factory bean due to null JobExecution.
* Add tests

Transition shuffle fixes TCK test testInvokeJobWithUncaughtExceptionFailAndRestart, NPE fix contributes to other tests but does not fix completely.
2014-01-02 14:32:24 -05:00
Michael Minella
874b92d4b2 BATCH-2151: Clean up ChunkMonitor offset on chunk boundries 2013-12-30 12:06:43 -06:00
Tobias Flohre
6edc91fcea BATCH-2149 2013-12-30 12:06:43 -06:00
Michael Minella
440e234c58 BATCH-2149: Updated unit tests to demonstrate functionality 2013-12-30 12:06:43 -06:00
Michael Minella
1730206d76 Renamed unit test so it will be executed in the build 2013-12-30 12:06:43 -06:00
Michael Minella
9ec3a4facb BATCH-2149: Updated test to validate both the simple and fault tolerant use cases 2013-12-30 12:06:43 -06:00
Michael Minella
3f0c0cd45d BATCH-2148: Fixed missing commas in schema-mysql.sql 2013-12-30 12:06:43 -06:00
Michael Minella
f75d7fa922 BATCH-2150: Added private constructor to StepExecution for use by Jackson deserialization 2013-12-30 12:06:43 -06:00
Michael Minella
755c75bedb Fixed merge issue from Job scope merge 2013-12-19 10:41:23 -06:00
Michael Minella
0e2edd295f Added new EndState to support JSR behavior for setting the JobExecution#exitStatus 2013-12-18 13:19:42 -06:00
Chris Schaefer
d76209df10 Prevent NPE when checking for a re-runnable continued flow, remove usage of
state transition comparator in FlowParser, ensure custom exit code is set at
job level.

Fixes TCK test testDeciderExitStatusIsSetOnJobContext, contributes but does
not fix decider transition tests that include restart.
2013-12-18 10:36:50 -05:00
Michael Minella
3e5597717e Refactored setting of completion policy to not overwrite JSR defaults 2013-12-17 14:30:36 -06:00
Michael Minella
2f63bd0664 Updated to call PartitionCollector regardless of if the partition completes successfully 2013-12-16 15:40:36 -06:00
Michael Minella
bfd6bccd72 Added synchronization to the setting of partition data 2013-12-16 14:33:24 -06:00
Michael Minella
b9b23e639d Updated the JsrStepExecutionSplitter to provide a copy of the JobExecution per partition 2013-12-16 14:07:44 -06:00
Michael Minella
874a171601 Fixed threading issue in JsrPartitionHandler 2013-12-16 13:10:47 -06:00
Michael Minella
ee30259612 Added double check that all partition data has been processed before ending 2013-12-16 12:59:30 -06:00
Michael Minella
b5d48df0cf Added cleanup code around tests so that StepScope registration was
cleaned up.
2013-12-16 12:09:08 -06:00
Michael Minella
241d9f101f BATCH-1701: Implementation of JobScope
* Updated Job and Step scopes to use common class introduced by jpraet
* Updated Job and Step Synchronization Managers to use common class
 introduced by jpraet
* Updated JobScope related code to not be concerned with Spring 2.5
 (which is what batch was on when the PR was opened).
2013-12-16 09:21:27 -06:00
jpraet
2436d84210 BATCH-1701: Introduce job scope 2013-12-13 16:44:15 -06:00
Chris Schaefer
e5fc0665cc Remove property resolution through the original bean factory post processor and move resolution to
occur during XML pre-processing. JSR-352 allows for property replacement and expressions to be present
on any element and the preprocessing provides the ability to load a well formed XML document into the
context with the intended values already present.
2013-12-13 17:02:19 -05:00
Michael Minella
1f0d5496d1 Updated per code review 2013-12-13 13:50:15 -06:00
Michael Minella
54a5be9eb2 Added the implementation of a post processor to lazily init partition
related artifacts
* Added BeanFactoryPostProcessor
* Fixed StepContext creation (now creates one per thread)
* Fixed StepContext exit status processing (now keeps track of being set
 manualy or not
* Created new Flow implementation to handle JSR-352 state transitions
* Updated flow parsing to not default to completed if no other
 transitions are provided
2013-12-13 13:11:55 -06:00
Chris Schaefer
d8b435e211 Update hsqldb connection string adding the mvcc parameter to avoid serialization exceptions 2013-12-12 16:16:42 -05:00
Michael Minella
b985c52b4d Refactored CheckpointAlgorithmAdapter to be stateful 2013-12-12 14:36:21 -06:00
Michael Minella
7553c383cd Refactored to use the JSR's JobOperator to launch test job 2013-12-09 12:56:57 -06:00
Chris Schaefer
6b4ff3a566 Remove unique transition pattern check per JSR requirements. Transitions are ordered based on their ordering in the job defintion XML document, so for example having an end and stop transition both with a pattern of "foo" is valid. 2013-12-07 13:59:29 -05:00
Michael Minella
074e985b94 Updates per the code review 2013-12-07 12:35:14 -06:00
Michael Minella
78cf001e9e Refactored the JsrJobOperator to start and restart jobs asynchronously
by default.
* Refactored the JsrJobOperator to use SimpleAsyncTaskExecutor by
 default
* Introduced a JobContextFactory to provide a JobContext per thread.
* Updated stop logic to correctly handle stopping jobs running on
 another thread.
2013-12-06 11:37:10 -06:00
Michael Minella
8bee7ac310 Cleaned up merge issues and warnings in POM files 2013-11-22 17:12:22 -06:00
Michael Minella
55753d7da6 BATCH-2124: Updated files to prevent the ability of inserting more than one row by accident into the sequence tables 2013-11-22 16:19:25 -06:00
Michael Minella
e7319c66f8 BATCH-2122: Updated so that offset would be correctly handled at chunk borders 2013-11-22 16:18:46 -06:00
Sanghyuk Jung
bfd6d8d355 BATCH-2096: 'chunk-completion-policy' or 'commit-interval' with '#{jobParameters[...]}' is ignored when 'retry-limit' exists.
* Added a call for a completionPolicy  when creating FaultTolerantStep
* Added an assertion for the chunkCompletionPolicy in the unit test.

JIRA: https://jira.springsource.org/browse/BATCH-2096
2013-11-22 15:40:45 -06:00
Michael Minella
3ea8d3ed65 Updated to remove redundant class 2013-11-20 17:29:34 -06:00
Chris Schaefer
1ef21104ac Fixes for TCK tests: testDeciderNextNormal, testDeciderNextSpecial, testFlowTransitionToDecision, testFlowTransitionToStep, testFlowTransitionToStepOutOfScope, testFlowTransitionWithinFlow, testOneArtifactIsJobAndStepListener, testSimpleFlow, testStartLimitVariation1, testStepInFlowStepExecution
Tests blocked by TCK issues: testOneArtifactIsJobAndStepListener, testStartLimitVariation1

* Expose job level properties to step artifacts and update tests
* Make JobParameterResolvingBeanFactoryPostProcessor HIGHEST_PRECEDENCE to avoid other BFPP's creating bean defs first
* General cleanup and renaming
* Register a bean definition for the JobContext prior to refreshing the beanfactory so it becomes injectable. Set properties and the jobExecution on the JobContext bean after they are initalized.
* Only step scope non-step scoped listeners
* Parse flow elements and transitions
2013-11-20 17:29:34 -06:00
Chris Schaefer
416033299f BATCH-2134: Spring Batch 3.0.0.M2 failed to build in Windows environment 2013-11-19 13:53:29 -05:00
Michael Minella
fb7582a54f BATCH-2003: Updated per code review comments 2013-11-19 10:13:32 -06:00