Questions tagged «airflow-scheduler»

我正在使用 https://github.com/helm/charts/tree/master/stable/airflow掌舵图并puckle/docker-airflow使用安装的Kubernetes构建v1.10.8 图像并在掌舵图中使用该图像，但是我一直在获取 File "/usr/local/bin/airflow", line 37, in <module> args.func(args) File "/usr/local/lib/python3.7/site-packages/airflow/bin/cli.py", line 1140, in initdb db.initdb(settings.RBAC) File "/usr/local/lib/python3.7/site-packages/airflow/utils/db.py", line 332, in initdb dagbag = models.DagBag() File "/usr/local/lib/python3.7/site-packages/airflow/models/dagbag.py", line 95, in __init__ executor = get_default_executor() File "/usr/local/lib/python3.7/site-packages/airflow/executors/__init__.py", line 48, in get_default_executor DEFAULT_EXECUTOR = _get_executor(executor_name) File "/usr/local/lib/python3.7/site-packages/airflow/executors/__init__.py", line 87, in _get_executor …

12 kubernetes  airflow  kubernetes-helm  airflow-scheduler 

我有一个如下的场景： 仅在源表（Athena）中有新数据可用时才触发Task 1和Task 2。一天中进行新的数据分区时，应该触发Task1和Task2。 触发Task 3仅完成Task 1和Task 2 Task 4仅触发完成Task 3 我的密码 from airflow import DAG from airflow.contrib.sensors.aws_glue_catalog_partition_sensor import AwsGlueCatalogPartitionSensor from datetime import datetime, timedelta from airflow.operators.postgres_operator import PostgresOperator from utils import FAILURE_EMAILS yesterday = datetime.combine(datetime.today() - timedelta(1), datetime.min.time()) default_args = { 'owner': 'airflow', 'depends_on_past': False, 'start_date': yesterday, 'email': FAILURE_EMAILS, …

9 python  airflow  amazon-athena  directed-acyclic-graphs  airflow-scheduler