> For the complete documentation index, see [llms.txt](https://docs.infraon.io/log-management/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.infraon.io/log-management/user-guide/infraon-configuration/log-management/pipeline-configuration.md).

# Pipeline Configuration

Pipeline Configuration allows administrators to create and manage log pipelines that collect, process, and route log data to the appropriate destinations. Administrators can configure input listeners, associate Grok patterns, define output streams, and deploy pipelines to selected log collector hosts.

## How does it work?

A log pipeline receives incoming log data through a configured input protocol and port. The pipeline can process logs using Grok patterns and filters before sending them to an OpenObserve stream or a configured secondary destination.

Pipeline Configuration supports two types of pipelines:

* **Parent Pipeline**: Defines the network listener, including the input protocol, port, and log collector hosts. It can write incoming logs directly to a stream or route them to child pipelines.
* **Child Pipeline**: Uses filters to select specific log events or devices and sends the matching logs to its own output stream. It inherits the collector hosts from its parent and does not have its own input listener.

The pipeline configuration is deployed to the selected log collector hosts. Saving a parent pipeline triggers deployment, while changes to a child pipeline take effect when its parent is deployed again.

## What you see on the screen

The Pipeline Configuration page provides options to search, filter, and manage pipelines. The configuration is divided into two sections: Parent Pipelines and Child Pipelines. The Parent Pipelines section displays the created parent pipelines, while selecting a parent pipeline displays its associated child pipelines in the Child Pipelines section.

Pipeline Configuration | **Basic Options**

<table><thead><tr><th width="123.66668701171875">Label</th><th width="246.166748046875">Action</th><th>Description/Example</th></tr></thead><tbody><tr><td>Search</td><td>Enter a search term in the search field.</td><td>Searches for pipelines matching the entered keywords.</td></tr><tr><td>Filter</td><td>Apply the available filters.</td><td>Narrows down the displayed pipeline records based on the selected criteria.</td></tr><tr><td>Card View</td><td>Click the Card View icon.</td><td>Displays pipelines as cards with their details and available actions.</td></tr><tr><td>Grid View</td><td>Click the Grid View icon.</td><td>Displays pipelines in a tabular format for easier viewing and management.</td></tr><tr><td>Show All Child</td><td>Click Show All Child.</td><td>Displays all child pipelines instead of only the child pipelines associated with the selected parent pipeline. When this option is selected, the child pipelines are displayed in read-only mode.</td></tr></tbody></table>

<figure><img src="https://2594651049-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCD6mgHZ0Xkc8n57NnmFg%2Fuploads%2FRXVzzVVqk1lS16nV5sxf%2Fimage.png?alt=media&amp;token=90e3953c-24c5-45cc-8a1a-b8a65f48d7a6" alt=""><figcaption></figcaption></figure>

### Parent Pipelines

The Parent Pipelines section displays the created parent pipelines. Each pipeline card provides the following details and actions.

Pipeline Configuration | **Parent Pipelines**

<table><thead><tr><th width="172.83331298828125">Label</th><th width="184.5">Action</th><th>Description/Example</th></tr></thead><tbody><tr><td>Parent Pipelines</td><td>View the section.</td><td>Displays the created parent pipelines.</td></tr><tr><td>Pipeline Name</td><td>View the pipeline card.</td><td>Displays the name assigned to the parent pipeline, such as UDP Pipeline.</td></tr><tr><td>Description</td><td>View the pipeline card.</td><td>Displays a brief description of the pipeline's purpose.</td></tr><tr><td>Type</td><td>View the pipeline card.</td><td>Displays the configured input protocol, such as UDP, TCP, Syslog, or Beats.</td></tr><tr><td>Log Device Count</td><td>Click the displayed count for a configured pipeline.</td><td>Opens the Log Device Summary section, which displays details of the log devices associated with the pipeline. The count is available only for configured pipelines.</td></tr><tr><td>Enable/Disable</td><td>Toggle the switch.</td><td>Enables or disables the corresponding parent pipeline.</td></tr><tr><td>Select</td><td>Select multiple parent pipelines.</td><td>Selects pipelines for bulk actions, such as enabling or disabling them.</td></tr><tr><td>Child Pipelines</td><td>Select a parent pipeline.</td><td>Displays the child pipelines associated with the selected parent.</td></tr><tr><td>Search Child Pipeline</td><td>Enter the child pipeline name in the search field under the Child Pipelines section.</td><td>Searches for a specific child pipeline associated with the selected parent pipeline.</td></tr><tr><td>Configuration Status</td><td>View the colored status dot.</td><td>A green dot indicates that the configuration has been completed. A grey dot indicates that the configuration has not yet been completed.</td></tr><tr><td>Edit</td><td>Click Edit on the parent pipeline card.</td><td>Opens the child pipeline configuration for editing.</td></tr><tr><td>Delete</td><td>Click Delete on the parent pipeline card.</td><td>Click the Delete option to delete the required parent pipeline.</td></tr></tbody></table>

When you select a particular parent pipeline, its associated child pipelines are displayed in the Child Pipelines section.

<figure><img src="https://2594651049-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCD6mgHZ0Xkc8n57NnmFg%2Fuploads%2FSpVMihxSnr8rhByxKsbx%2Fimage.png?alt=media&amp;token=d5bc025d-5bf4-4774-b514-60d08a50b0b1" alt=""><figcaption></figcaption></figure>

#### Upload Pipeline Configuration

After creating or updating a parent pipeline, click Upload on the corresponding pipeline card to deploy its configuration to the Log Collector Server.

<table><thead><tr><th width="140.33331298828125">Label</th><th width="178.8333740234375">Action</th><th>Description/Example</th></tr></thead><tbody><tr><td>Upload</td><td>Click Upload on a parent pipeline card.</td><td>Initiates the process of uploading the pipeline configuration to the Log Collector Server.</td></tr><tr><td>Upload Confirmation</td><td>Review the confirmation message.</td><td>Displays: “Configuration will be uploaded to Log Collector Server.”</td></tr><tr><td>Yes, Upload It</td><td>Click the option.</td><td>Confirms the action and starts processing the configuration upload.</td></tr><tr><td>Cancel</td><td>Click the option.</td><td>Cancels the upload operation.</td></tr></tbody></table>

<figure><img src="https://2594651049-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCD6mgHZ0Xkc8n57NnmFg%2Fuploads%2FIYM3JKiOqZ5z5HvtQqeP%2Fimage.png?alt=media&amp;token=f273646f-e5c8-4df6-b68a-0500c489f4d0" alt=""><figcaption></figcaption></figure>

#### Upload Result

After initiating the upload, click the Info icon to view the upload result and deployment messages.

The upload result section displays the progress of the operation, including pipeline preparation, routing configuration, parser availability, connection to the log server, configuration upload, and service restart.

For example, the result may contain the following messages:

<table><thead><tr><th width="132">Label</th><th width="178">Action</th><th>Description/Example</th></tr></thead><tbody><tr><td>Info</td><td>Click the Info icon.</td><td>Opens the upload result section with deployment progress and status messages.</td></tr><tr><td>Upload Status</td><td>View the upload result.</td><td>Displays messages such as Added to Queue, Configuration uploaded successfully, or a deployment failure.</td></tr><tr><td>Parser Status</td><td>Review parser-related messages.</td><td>Identifies parser files that are missing from the Log Collector Server and provides the expected file paths.</td></tr><tr><td>Host Upload Summary</td><td>View the summary.</td><td>Displays the deployment result for each target host, such as Deployed successfully.</td></tr><tr><td>Service Restart Status</td><td>Review the result message.</td><td>Indicates whether the log collector service restarted successfully or failed to restart.</td></tr></tbody></table>

{% hint style="info" %}
A successful configuration upload does not necessarily mean that the pipeline is running. The upload result may report that the configuration was uploaded but the log collector service failed to restart. In this case, the pipeline may not be active, and the system administrator should be contacted.

Similarly, if a parser is skipped because its file is missing, the upload result identifies the missing file and instructs the administrator to copy it to the specified location on the host before redeploying the configuration.
{% endhint %}

<figure><img src="https://2594651049-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCD6mgHZ0Xkc8n57NnmFg%2Fuploads%2FcqQv7orotOB5W03C8sj5%2Fimage.png?alt=media&amp;token=313fe7e1-6548-4434-81f8-fc05fdcd0b21" alt=""><figcaption></figcaption></figure>

### Child Pipelines

The Child Pipelines section displays the child pipelines associated with a selected parent pipeline. Each child pipeline shows its name, description, stream name, configuration status indicator, log device count, and available actions.

Pipeline Configuration | **Child Pipelines**

<table><thead><tr><th width="153.66668701171875">Label</th><th width="245.3333740234375">Action</th><th>Description/Example</th></tr></thead><tbody><tr><td>Name</td><td>View the child pipeline card.</td><td>Displays the name of the child pipeline.</td></tr><tr><td>Description</td><td>View the child pipeline card.</td><td>Displays a brief description of the child pipeline.</td></tr><tr><td>Stream Name</td><td>View the child pipeline card.</td><td>Displays the name of the stream associated with the child pipeline.</td></tr><tr><td>Configuration Status</td><td>View the colored status dot.</td><td>A green dot indicates that the configuration has been completed. A grey dot indicates that the configuration has not yet been completed.</td></tr><tr><td>Log Device Count</td><td>Click the displayed count.</td><td>Opens the Log Device Summary section, which displays details of the log devices associated with the pipeline.</td></tr><tr><td>Edit</td><td>Click Edit on the child pipeline card.</td><td>Opens the child pipeline configuration for editing.</td></tr></tbody></table>
