Google Cloud Managed Service for Apache Kafka Operators

The Google Cloud Managed Service for Apache Kafka helps you set up, secure, maintain, and scale Apache Kafka clusters.

Interacting with Apache Kafka Cluster

To create an Apache Kafka cluster you can use ManagedKafkaCreateClusterOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_cluster.py[source]

create_cluster = ManagedKafkaCreateClusterOperator(
    task_id="create_cluster",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster=CLUSTER_CONF,
    cluster_id=CLUSTER_ID,
)

To delete cluster you can use ManagedKafkaDeleteClusterOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_cluster.py[source]

delete_cluster = ManagedKafkaDeleteClusterOperator(
    task_id="delete_cluster",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
    trigger_rule=TriggerRule.ALL_DONE,
)

To get cluster you can use ManagedKafkaGetClusterOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_cluster.py[source]

get_cluster = ManagedKafkaGetClusterOperator(
    task_id="get_cluster",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
)

To get a list of clusters you can use ManagedKafkaListClustersOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_cluster.py[source]

list_clusters = ManagedKafkaListClustersOperator(
    task_id="list_clusters",
    project_id=PROJECT_ID,
    location=LOCATION,
)

To update cluster you can use ManagedKafkaUpdateClusterOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_cluster.py[source]

update_cluster = ManagedKafkaUpdateClusterOperator(
    task_id="update_cluster",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
    cluster=CLUSTER_TO_UPDATE,
    update_mask=CLUSTER_UPDATE_MASK,
)

Interacting with Apache Kafka Topics

To create an Apache Kafka topic you can use ManagedKafkaCreateTopicOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_topic.py[source]

create_topic = ManagedKafkaCreateTopicOperator(
    task_id="create_topic",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
    topic_id=TOPIC_ID,
    topic=TOPIC_CONF,
)

To delete topic you can use ManagedKafkaDeleteTopicOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_topic.py[source]

delete_topic = ManagedKafkaDeleteTopicOperator(
    task_id="delete_topic",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
    topic_id=TOPIC_ID,
    trigger_rule=TriggerRule.ALL_DONE,
)

To get topic you can use ManagedKafkaGetTopicOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_topic.py[source]

get_topic = ManagedKafkaGetTopicOperator(
    task_id="get_topic",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
    topic_id=TOPIC_ID,
)

To get a list of topics you can use ManagedKafkaListTopicsOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_topic.py[source]

list_topics = ManagedKafkaListTopicsOperator(
    task_id="list_topics",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
)

To update topic you can use ManagedKafkaUpdateTopicOperator.

google/tests/system/google/cloud/managed_kafka/example_managed_kafka_topic.py[source]

update_topic = ManagedKafkaUpdateTopicOperator(
    task_id="update_topic",
    project_id=PROJECT_ID,
    location=LOCATION,
    cluster_id=CLUSTER_ID,
    topic_id=TOPIC_ID,
    topic=TOPIC_TO_UPDATE,
    update_mask=TOPIC_UPDATE_MASK,
)

Reference

For further information, look at:

Was this entry helpful?