> For the complete documentation index, see [llms.txt](https://au-dohp.gitbook.io/au-dohp-docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://au-dohp.gitbook.io/au-dohp-docs/au-dohp-user-manual/data-pipeline/customization.md).

# Customization

{% embed url="<https://drive.google.com/file/d/16PSaRRSUfS8SewvKW60Kxw_sdRnzA5nI/view?usp=drive_link>" %}

1. Navigate to "**Data Pipelines**"
2. Click on the Pipeline you want to customize

{% hint style="info" %}
Pipelines outputs a parquet file, which is a column-oriented open source format for data files, designed for efficient storage and retrieval. It provides high performance compression and encoding schemes to handle complex data in bulk
{% endhint %}

3. Click anywhere to add your Transforms, which you will link using Hops by clicking on the created Transform, hitting "**Create hop**" and setting each as the "**Main Output**"

{% hint style="info" %}
**Transforms** are the core operations in a pipeline. Each is specialized to perform a single, optimized task. While individually simple, their combination forms powerful workflows.

**Hops** connect transforms and transfer data in one direction only. They simply buffer and forward data without knowledge of the transforms they link. Some transforms can conditionally read from or write to others.
{% endhint %}

4. Additionally, you can automate failure management on your Transforms to take specific actions, and thus by dragging your hop link onto "**Error handling**" instead of "**Main Output**"


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://au-dohp.gitbook.io/au-dohp-docs/au-dohp-user-manual/data-pipeline/customization.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.