Separator

The Separator component is a utility in your AI workflow that splits a given text input into multiple segments based on a specified separator. This can be especially useful in scenarios where you need to process or analyze individual parts of a bulk text, such as separating paragraphs, lines, or entries in a list.

What Does the Separator Do?

The primary function of the Separator is to take an input text (for example, a long message, document, or list) and divide it into a list of smaller text chunks using a separator string of your choice (by default, this is a newline character \n). This enables downstream components to process or analyze each segment independently.

Inputs

• Input: Provides the plain text that you want to separate. This can be any message or textual data.
• Separator: Allows you to define the character(s) that will be used to split the input. For instance, use , for comma-separated values, or \n\n to split by paragraphs.

Outputs

The output is a list of text pieces, each representing a segment from the original input, split using the chosen separator.

Why Use the Separator?

• Preprocessing: Break up large texts into manageable pieces for easier processing by other AI components.
• Flexible Splitting: Choose any separator that fits your data (e.g., newlines, commas, custom tokens).
• Workflow Integration: Use the separated segments as individual inputs for summarization, classification, translation, or any other downstream processing.

Example Use Cases

• Splitting a transcript into individual sentences or paragraphs for further analysis.
• Parsing a comma-separated list into individual items.
• Breaking up user input into separate commands or queries.

Summary

The Separator component is a versatile tool for dividing text into usable segments, enhancing the flexibility and efficiency of your AI workflows. By customizing the separator, you can adapt it to a wide range of text formats and processing needs.