# Pipelines

Ingest real time data streams and load into R2

> Use [Pipelines llms-full.txt](https://developers.cloudflare.com/pipelines/llms-full.txt) for the complete Pipelines documentation in a single file. That file is intended for offline indexing, bulk vectorization, or large-context models.
>
> For other Cloudflare products, see the [Cloudflare documentation directory](https://developers.cloudflare.com/llms.txt).

## Pipelines documentation pages

- [Getting started](https://developers.cloudflare.com/pipelines/getting-started/index.md): Create your first pipeline to ingest streaming data and write to R2 Data Catalog as an Apache Iceberg table.
- [Cloudflare Pipelines](https://developers.cloudflare.com/pipelines/index.md)
- [Pipelines](https://developers.cloudflare.com/pipelines/pipelines/index.md)
- [Manage pipelines](https://developers.cloudflare.com/pipelines/pipelines/manage-pipelines/index.md): Create, configure, and manage SQL transformations between streams and sinks
- [Observability](https://developers.cloudflare.com/pipelines/observability/index.md)
- [Metrics and analytics](https://developers.cloudflare.com/pipelines/observability/metrics/index.md)
- [Platform](https://developers.cloudflare.com/pipelines/platform/index.md)
- [Pricing](https://developers.cloudflare.com/pipelines/platform/pricing/index.md)
- [Reference](https://developers.cloudflare.com/pipelines/reference/index.md): Reference documentation for Cloudflare Pipelines.
- [Limits](https://developers.cloudflare.com/pipelines/platform/limits/index.md)
- [Legacy pipelines](https://developers.cloudflare.com/pipelines/reference/legacy-pipelines/index.md)
- [Sinks](https://developers.cloudflare.com/pipelines/sinks/index.md)
- [Wrangler commands](https://developers.cloudflare.com/pipelines/reference/wrangler-commands/index.md)
- [Manage sinks](https://developers.cloudflare.com/pipelines/sinks/manage-sinks/index.md): Create, configure, and manage sinks for data storage
- [Streams](https://developers.cloudflare.com/pipelines/streams/index.md)
- [Manage streams](https://developers.cloudflare.com/pipelines/streams/manage-streams/index.md): Create, configure, and manage streams for data ingestion
- [Writing to streams](https://developers.cloudflare.com/pipelines/streams/writing-to-streams/index.md): Send data to streams via Worker bindings or HTTP endpoints
- [SQL reference](https://developers.cloudflare.com/pipelines/sql-reference/index.md): Comprehensive reference for SQL syntax, data types, and functions supported in Pipelines.
- [SELECT statements](https://developers.cloudflare.com/pipelines/sql-reference/select-statements/index.md): Query syntax for data transformation in Cloudflare Pipelines SQL
- [SQL data types](https://developers.cloudflare.com/pipelines/sql-reference/sql-data-types/index.md): Supported data types in Cloudflare Pipelines SQL
- [Available sinks](https://developers.cloudflare.com/pipelines/sinks/available-sinks/index.md): Find detailed configuration options for each supported sink type.
- [R2 Data Catalog](https://developers.cloudflare.com/pipelines/sinks/available-sinks/r2-data-catalog/index.md): Write data as Apache Iceberg tables to R2 Data Catalog
- [R2](https://developers.cloudflare.com/pipelines/sinks/available-sinks/r2/index.md): Write data as JSON or Parquet files to R2 object storage
- [Array functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/array/index.md): Scalar functions for manipulating arrays
- [Binary string functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/binary-string/index.md): Scalar functions for manipulating binary strings
- [Conditional functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/conditional/index.md): Scalar functions to implement conditional logic
- [Hashing functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/hashing/index.md): Scalar functions for hashing values
- [Scalar functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/index.md): Scalar functions available in Cloudflare Pipelines SQL.
- [JSON functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/json/index.md): Scalar functions for manipulating JSON
- [Math functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/math/index.md): Scalar functions for mathematical operations
- [Other functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/other/index.md): Miscellaneous scalar functions
- [Regex functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/regex/index.md): Scalar functions for regular expressions
- [String functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/string/index.md): Scalar functions for manipulating strings
- [Struct functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/struct/index.md): Scalar functions for manipulating structs
- [Time and date functions](https://developers.cloudflare.com/pipelines/sql-reference/scalar-functions/time-and-date/index.md): Scalar functions for handling times and dates