Installing Apache Airflow on CentOS 7

virtualenv airflow
source airflow/bin/activate

Airflow Minimal

sudo yum -y install gcc gcc-c++
pip install airflow

Airflow Common

(MySQL, Celery, Crypto, Password auth)

sudo yum -y install gcc gcc-c++ libffi-devel mariadb-devel
pip install airflow[async,celery,crypto,jdbc,mysql,password,rabbitmq]

Airflow Common + Hadoop

(HDFS, Hive, Druid, Vertica, LDAP and Kerberos Security)

sudo yum -y install gcc gcc-c++ libffi-devel mariadb-devel cyrus-sasl-devel
easy_install -U setuptools
pip install airflow[async,celery,crypto,druid,jdbc,hdfs,hive,kerberos,ldap,mysql,password,rabbitmq,vertica]

--

--

Forging the Everdragons2 NFT. Former security at Pinterest.

Love podcasts or audiobooks? Learn on the go with our new app.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store