Data sources
Confluent
Use the Pinecone Sink Connector for Confluent Kafka to stream events, embed them with LLMs, and upsert vectors for real-time semantic search and RAG.
Confluent is a cloud-native data streaming platform for connecting and processing your data in real time. Confluent’s Kafka Connect is a tool for streaming data between Apache Kafka and other data systems, and you can use it to define connectors that move large data sets in and out of Kafka.
Use the Pinecone Sink Connector, a Kafka Connect plugin for Pinecone, to take content from Confluent Cloud, convert it into vector embeddings using large language models (LLMs), and then store these embeddings in a Pinecone index.
Was this page helpful?