Documentation

Apache Airflow

Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation.

Providers packages

Providers packages include integrations with third party integrations. They are updated independently of the Apache Airflow core.

• Airbyte
• Amazon
• Apache Beam
• Apache Cassandra
• Apache Druid
• Apache HDFS
• Apache Hive
• Apache Kylin
• Apache Livy
• Apache Pig
• Apache Pinot
• Apache Spark
• Apache Sqoop
• Celery
• IBM Cloudant
• Kubernetes
• Databricks
• Datadog
• Dingding
• Discord
• Docker
• Elasticsearch
• Exasol
• Facebook
• File Transfer Protocol (FTP)
• Google
• gRPC
• Hashicorp
• Hypertext Transfer Protocol (HTTP)
• Internet Message Access Protocol (IMAP)
• Java Database Connectivity (JDBC)
• Jenkins
• Jira
• Microsoft Azure
• Microsoft SQL Server (MSSQL)
• Windows Remote Management (WinRM)
• MongoDB
• MySQL
• Neo4J
• ODBC
• OpenFaaS
• Opsgenie
• Oracle
• Pagerduty
• Papermill
• Plexus
• PostgreSQL
• Presto
• Qubole
• Redis
• Salesforce
• Samba
• Segment
• Sendgrid
• SFTP
• Singularity
• Slack
• Snowflake
• SQLite
• SSH
• Tableau
• Telegram
• Trino
• Vertica
• Yandex
• Zendesk

Docker stack

Airflow has an official Dockerfile and Docker image published in DockerHub as a convenience package for installation. You can extend and customize the image according to your requirements and use it in your own deployments.

Helm Chart

Airflow has an official Helm Chart that will help you set up your own Airflow on a cloud/on-prem Kubernetes environment and leverage its scalable nature to support a large group of users. Thanks to Kubernetes, we are not tied to a specific cloud provider.