From 4ad76506bf4731dec6b191850fb1aa5a2744a0ab Mon Sep 17 00:00:00 2001 From: 1993heqiang <531364804@qq.com> Date: Mon, 4 Nov 2024 23:29:27 +0800 Subject: [PATCH] Fix etl-pipeline.adoc and prompt.adoc issues. --- .../src/main/antora/modules/ROOT/pages/api/etl-pipeline.adoc | 3 ++- .../src/main/antora/modules/ROOT/pages/api/prompt.adoc | 2 +- 2 files changed, 3 insertions(+), 2 deletions(-) diff --git a/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/etl-pipeline.adoc b/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/etl-pipeline.adoc index 8dd87ba0c..00519349b 100644 --- a/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/etl-pipeline.adoc +++ b/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/etl-pipeline.adoc @@ -515,7 +515,7 @@ The `TextSplitter` an abstract base class that helps divides documents to fit th === TokenTextSplitter -The `TokenTextSplitter` is an implementation of `TextSplitter` that splits text into chunks based on token count, using the `CL100K_BASE encoding. +The `TokenTextSplitter` is an implementation of `TextSplitter` that splits text into chunks based on token count, using the CL100K_BASE encoding. ==== Usage @@ -593,6 +593,7 @@ for (Document doc : splitDocuments) { * Metadata from the original documents is preserved and copied to all chunks derived from that document. * The content formatter (if set) from the original document is also copied to the derived chunks if `copyContentFormatter` is set to `true` (default behavior). * This splitter is particularly useful for preparing text for large language models that have token limits, ensuring that each chunk is within the model's processing capacity. + === ContentFormatTransformer Ensures uniform content formats across all documents. diff --git a/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/prompt.adoc b/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/prompt.adoc index 6a41bacc5..41d9ac67c 100644 --- a/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/prompt.adoc +++ b/spring-ai-docs/src/main/antora/modules/ROOT/pages/api/prompt.adoc @@ -95,7 +95,7 @@ More than just an answer or reaction, it's crucial for maintaining the flow of t By tracking the AI's previous responses (its 'Assistant Role' messages), the system ensures coherent and contextually relevant interactions. The Assistant message may contain Function Tool Call request information as well. It's like a special feature in the AI, used when needed to perform specific functions such as calculations, fetching data, or other tasks beyond just talking. -* Tool/Function Role: The Too/Function Role focuses on returning additional information in response to Tool Call Assistant Messages. +* Tool/Function Role: The Tool/Function Role focuses on returning additional information in response to Tool Call Assistant Messages. Roles are represented as an enumeration in Spring AI as shown below