Understanding context snippets
The context
operation provides a way to retrieve the context snippets that Pinecone Assistant uses to generate its responses. This data includes relevant chunks, relevancy scores, and references.
This feature is in public preview.
Use cases
The context
operation is useful for performing tasks like the following:
- Understanding what relevant data snippets Pinecone Assistant is providing to the LLM for chat generation.
- Using the retrieved snippets with your own LLM.
- Using the retrieved snippets with your own RAG application or agentic workflow.
SDK support
You can use the context
operation directly or via the Pinecone Python SDK.
To interact with Pinecone Assistant using the Python SDK, upgrade the client and install the pinecone-plugin-assistant
package as follows:
Pricing
Usage of the context
operation is measured in tokens, similar to Pinecone Assistant. See Pricing for up-to-date pricing information.
Pricing updates specific to usage of the context
operation will be made as the feature becomes generally available.
Was this page helpful?