Airflow

Components of Apache Airflow

  • Web Server
  • Scheduler
  • Metadata Database
  • Executor

Commandlines 

python3 -m venv env_airflow
source ./env_airflow/bin/activate
airflow db init
cd ~/airflow
mkdir dags
airflow webserver

Create users 

airflow users create --role Admin --username username --email email --firstname firstname --lastname lastname --password password

Start scheduler 

# any folder
airflow scheduler