PineconeIngestOperator¶

Use the PineconeIngestOperator to interact with Pinecone APIs to ingest vectors.

Using the Operator¶

The PineconeIngestOperator requires the vectors as an input ingest into Pinecone. Use the conn_id parameter to specify the Pinecone connection to use to connect to your account. The vectors could also contain metadata referencing the original text corresponding to the vectors that could be ingested into the database.

An example using the operator in this way:

tests/system/providers/pinecone/example_dag_pinecone.py[source]

PineconeIngestOperator(
    task_id="pinecone_vector_ingest",
    index_name=index_name,
    input_vectors=[
        ("id1", [1.0, 2.0, 3.0], {"key": "value"}),
        ("id2", [1.0, 2.0, 3.0]),
    ],
    namespace=namespace,
    batch_size=1,
)