The Separator component is a utility in your AI workflow that splits a given text input into multiple segments based on a specified separator. This can be especially useful in scenarios where you need to process or analyze individual parts of a bulk text, such as separating paragraphs, lines, or entries in a list.
What Does the Separator Do?
The primary function of the Separator is to take an input text (for example, a long message, document, or list) and divide it into a list of smaller text chunks using a separator string of your choice (by default, this is a newline character \n). This enables downstream components to process or analyze each segment independently.
Inputs
| Name | Type | Description | Default | Required |
|---|---|---|---|---|
| Input | Message | The text to be split into segments. | (empty) | No |
| Separator | str | The string used to separate the input. | \n | No |
- Input: Provides the plain text that you want to separate. This can be any message or textual data.
- Separator: Allows you to define the character(s) that will be used to split the input. For instance, use
,for comma-separated values, or\n\nto split by paragraphs.
Outputs
| Name | Type | Description |
|---|---|---|
| Data | Message | A list of text segments after separation. |
The output is a list of text pieces, each representing a segment from the original input, split using the chosen separator.
Why Use the Separator?
- Preprocessing: Break up large texts into manageable pieces for easier processing by other AI components.
- Flexible Splitting: Choose any separator that fits your data (e.g., newlines, commas, custom tokens).
- Workflow Integration: Use the separated segments as individual inputs for summarization, classification, translation, or any other downstream processing.
Example Use Cases
- Splitting a transcript into individual sentences or paragraphs for further analysis.
- Parsing a comma-separated list into individual items.
- Breaking up user input into separate commands or queries.
Summary
The Separator component is a versatile tool for dividing text into usable segments, enhancing the flexibility and efficiency of your AI workflows. By customizing the separator, you can adapt it to a wide range of text formats and processing needs.