- airflow.models.abstractoperator.DEFAULT_WEIGHT_RULE: airflow.utils.weight_rule.WeightRule¶
- airflow.models.abstractoperator.DEFAULT_TRIGGER_RULE: airflow.utils.trigger_rule.TriggerRule¶
- exception airflow.models.abstractoperator.NotMapped¶
Raise if a task is neither mapped nor has any parent mapped groups.
- class airflow.models.abstractoperator.AbstractOperator(context=None)¶
Common implementation for operators, including unmapped and mapped.
This base class is more about sharing implementations, not defining a common interface. Unfortunately it’s difficult to use this as the common base class for typing due to BaseOperator carrying too much historical baggage.
The union type
from airflow.models.operator import Operatoris easier to use for typing purposes.
- property priority_weight_total: int¶
Total priority weight for the task. It might include all upstream or downstream tasks.
Depending on the weight rule:
WeightRule.ABSOLUTE - only own weight
WeightRule.DOWNSTREAM - adds priority weight of all downstream tasks
WeightRule.UPSTREAM - adds priority weight of all upstream tasks
- abstract get_dag()¶
Fetch a Jinja template environment from the DAG or instantiate empty environment if no DAG.
Hook triggered after the templated fields get replaced by their content.
If you need your operator to alter the content of the file before the template is rendered, it should override this method to do so.
Getting the content of files for template_field / template_ext.
Get direct relative IDs to the current task, upstream or downstream.
- get_flat_relative_ids(upstream=False, found_descendants=None)¶
Get a flat set of relative IDs, upstream or downstream.
Get a flat list of relatives, either upstream or downstream.
Return mapped nodes that depend on the current task the expansion.
For now, this walks the entire DAG to find mapped nodes that has this current task as an upstream. We cannot use
downstream_listsince it only contains operators, not task groups. In the future, we should provide a way to record an DAG node’s all downstream nodes instead.
Return mapped task groups this task belongs to.
Groups are returned from the closest to the outmost.
- abstract unmap(resolve)¶
Get the “normal” operator from current abstract operator.
MappedOperator uses this to unmap itself based on the map index. A non- mapped operator (i.e. BaseOperator subclass) simply returns itself.
Returns dictionary of all extra links for the operator
Returns dictionary of all global extra links
For an operator, gets the URLs that the
extra_linksentry points to.
ValueError – The error message of a ValueError will be passed on through to the fronted to show up as a tooltip on the disabled link.
Number of mapped task instances that can be created on DAG run creation.
This only considers literal mapped arguments, and would return None when any non-literal values are used for mapping.
- get_mapped_ti_count(run_id, *, session)¶
Number of mapped TaskInstances that can be created at run time.
This considers both literal and non-literal mapped arguments, and the result is therefore available when all depended tasks have finished. The return value should be identical to
parse_time_mapped_ti_countif all mapped arguments are literal.
- expand_mapped_task(run_id, *, session)¶
Create the mapped task instances for mapped task.
- abstract render_template_fields(context, jinja_env=None)¶
Template all attributes listed in self.template_fields.
If the operator is mapped, this should return the unmapped, fully rendered, and map-expanded operator. The mapped operator should not be modified. However, context may be modified in-place to reference the unmapped operator for template rendering.
If the operator is not mapped, this should modify the operator in-place.
- render_template(content, context, jinja_env=None, seen_oids=None)¶
Render a templated string.
If content is a collection holding multiple templated strings, strings in the collection will be templated recursively.
content (Any) – Content to template. Only strings can be templated (may be inside a collection).
context (airflow.utils.context.Context) – Dict with values to apply on templated content
jinja_env (jinja2.Environment | None) – Jinja environment. Can be provided to avoid re-creating Jinja environments during recursion.
- Return type