Configure the amount of time to allow the client to complete the execution of an API call.
This timeout covers the entire client execution except for marshalling. This includes request handler execution,
all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present.
- Add timeout filed to the AbstractBedrockApi, used to initialize the BedrockRuntimeClient and the
BedrockStreamingRuntimeClient. Update all classes that extend the AbstractBedrockApi.
- Keep the previous constructors for backward compatibility using timeout value of 5 min.
- Add a common AWS connection timeout auto-config property and update the documentation.
Defaults to 5 min.
Additional changes:
- Fix Anthropic 3 straming response - add bedrock metrics field.
- Increate the default timeout to 5 min. Update the docs.
- Increase the ITs.
Fix typo in API class name: OpenAiApi -> OllamaApi
This commit fixes a typo in the API class name mentioned in the documentation. The previous sentence "Low-level OpenAiApi Client" now correctly reads "Low-level OllamaApi Client."
- This allows custom ObjectMappers to be used when creating FunctionCallbackWrappers.
- Set the FunctionCallbackWrapper#ObjectMapper default to match the ModelOptionUtils#ObjectMapper config.
- expanded the AnthropicApi to include Tool, facilitating request and response abstractions.
- extended AnthropicChatClient to inherit AbstractFunctionCallSupport, with
implementation of all necessary methods and function registration protocols.
- implemented FunctionCallingOptions interface in AnthropicChatOptions.
- added tools integration tests for AnthropoicApi and AnthropicChatClient.
- extended the auto-configuration with functional calling functionality.
- added ITs for tools auto-config.
- updated documentation on anthropic function calling and relevant pages for comprehensive coverage.
- fix: remove non-sense underscore checking
- fix: check the model is included in request parameters
- fix: refactor, use constant
- fix: add jsonproperty decorator to additional attribute
- feat: allow additional params merging into the default watsonx option
- fix: remove not needed key
- fix: remove default values in watsonx ai options class
- fix: add default property
- Add a new autoconfig property spring.ai.retry.on-http-codes that list status codes (scuh as 429)
for which the retry should be attemptd.
- Updated the docs.
Resolves#433
- Add a new autoconfig property spring.ai.retry.on-http-codes that list status codes (scuh as 429)
for which the retry should be attemptd.
- Updated the docs.
Resolves#433
- Requires LLaVa or Bakllava models.
- Extend the Ollama chat client to support the Spring AI Medi type inputs.
- Add OllamaChatClientMultimodalIT.java
- Add Multimodal section in Ollama's docs.
Resolves#421
I found the .withDefaultOptions() is no longer found with new OpenAiChatClient in the 0.8 snapshot while trying out the sample code.
thank you for the hard work!
