Configure an index
This page shows you how to configure an existing index.
Configure a serverless index
Associate an embedding model
Integrated inference lets you upsert and search without extra steps for embedding data and reranking results.
To configure an existing serverless index for an embedding model, use the configure_index
operation as follows:
- Set
embed.model
to one of Pinecone’s hosted embedding models. - Set
embed.field_map
to the name of the field in your source document that contains the data for embedding.
The vector_type
, metric
, and dimension
of the index must be supported by the specified embedding model.
Prevent index deletion
When configuring a serverless or pod-based index, you can protect the index from accidental deletion by setting the deletion_protection
parameter to enabled
. For more details, see Prevent index deletion.
Tag an index
When configuring an index, you can tag the index to help with index organization and management. For more details, see Tag an index.
Configure a pod-based index
You cannot change the pod type of an index. However, you can create a collection from an index and then create a new index with a different pod type from the collection.
Change pod sizes
The default pod size is x1
. After index creation, you can increase the pod size for an index.
Increasing the pod size of your index does not result in downtime. Reads and writes continue uninterrupted during the scaling process. Currently, you cannot reduce the pod size of your indexes. Your number of replicas and your total number of pods remain the same, but each pod changes size. Resizing completes in about 10 minutes.
To change the pod size of an existing index, use the configure_index
operation and append the new size to the pod_type
parameter, separated by a period (.).
Example
The following example assumes that example-index
has size x1
and changes the size to x2
.
Check the status of a pod size change
To check the status of a pod size change, use the describe_index
endpoint. The status
field in the results contains the key-value pair "state":"ScalingUp"
or "state":"ScalingDown"
during the resizing process and the key-value pair "state":"Ready"
after the process is complete.
The index fullness metric provided by describe_index_stats
may be inaccurate until the resizing process is complete.
Example
The following example uses describe_index
to get the index status of the index example-index
. The status
field contains the key-value pair "state":"ScalingUp"
, indicating that the resizing process is still ongoing.
Add replicas
You can increase the number of replicas for your pod-based index to increase throughput (QPS). All pod-based indexes start with replicas=1.
Example
The following example uses the configure_index
endpoint to set the number of replicas for the index example-index
to 4.
See the configure_index API reference for more details.
Selective metadata indexing
For pod-based indexes, Pinecone indexes all metadata fields by default. When metadata fields contains many unique values, pod-based indexes will consume significantly more memory, which can lead to performance issues, pod fullness, and a reduction in the number of possible vectors that fit per pod.
To avoid indexing high-cardinality metadata that is not needed for filtering your queries and keep memory utilization low, specify which metadata fields to index using the metadata_config
parameter.
Since high-cardinality metadata does not cause high memory utilization in serverless indexes, selective metadata indexing is not supported.
The value for the metadata_config
parameter is a JSON object containing the names of the metadata fields to index.
Example
The following example creates a pod-based index that only indexes the genre
metadata field. Queries against this index that filter for the genre
metadata field may return results; queries that filter for other metadata fields behave as though those fields do not exist.
Prevent index deletion
When configuring a serverless or pod-based index, you can protect the index from accidental deletion by setting the deletion_protection
parameter to enabled
. For more details, see Prevent index deletion.
Tag an index
When configuring an index, you can tag the index to help with index organization and management. For more details, see Tag an index.
Was this page helpful?