Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.pinecone.io/llms.txt

Use this file to discover all available pages before exploring further.

This feature is in public preview and available only on Standard and Enterprise plans.
This page shows you how to integrate Pinecone with an Amazon S3 bucket. Once your integration is set up, you can use it to import data from your Amazon S3 bucket into a Pinecone index hosted on AWS, or to export audit logs to your Amazon S3 bucket.

​
Before you begin

Ensure you have the following:

​
1. Create an IAM policy

In the AWS IAM console:
  1. In the navigation pane, click Policies.
  2. Click Create policy.
  3. In Select a service section, select S3.
  4. Select the following actions to allow:
  5. In the Resources section, select Specific.
  6. For the bucket, specify the ARN of the bucket you created. For example: arn:aws:s3:::example-bucket-name
  7. For the object, specify an object ARN as the target resource. For example: arn:aws:s3:::example-bucket-name/*
  8. Click Next.
  9. Specify the name of your policy. For example: “Pinecone-S3-Access”.
  10. Click Create policy.

​
Targeting a subdirectory (optional)

To write audit logs to a specific subdirectory within your S3 bucket (e.g., my-bucket/pinecone-logs/), you need to configure your IAM policy differently for ListBucket vs. object-level actions:
  1. For ListBucket, use a Condition block with StringLike to specify the prefix. Include both the directory path with and without the trailing wildcard: 
    {
    "Sid": "ListBucketWithPrefix",
    "Effect": "Allow",
    "Action": "s3:ListBucket",
    "Resource": "arn:aws:s3:::example-bucket-name",
    "Condition": {
        "StringLike": {
            "s3:prefix": [
                "pinecone-logs/",
                "pinecone-logs/*"
            ]
        }
    }
}
  2. For PutObject and GetObject, use the Resource specifier with the subdirectory path: 
    {
    "Sid": "ObjectActionsInSubdirectory",
    "Effect": "Allow",
    "Action": [
        "s3:PutObject",
        "s3:GetObject"
    ],
    "Resource": "arn:aws:s3:::example-bucket-name/pinecone-logs/*"
}
Complete example policy for subdirectory access: 
{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "ListBucketWithPrefix",
            "Effect": "Allow",
            "Action": "s3:ListBucket",
            "Resource": "arn:aws:s3:::example-bucket-name",
            "Condition": {
                "StringLike": {
                    "s3:prefix": [
                        "pinecone-logs/",
                        "pinecone-logs/*"
                    ]
                }
            }
        },
        {
            "Sid": "ObjectActionsInSubdirectory",
            "Effect": "Allow",
            "Action": [
                "s3:PutObject",
                "s3:GetObject"
            ],
            "Resource": "arn:aws:s3:::example-bucket-name/pinecone-logs/*"
        }
    ]
}
The key difference is that ListBucket operates on the bucket resource and uses conditions to filter by prefix, while object-level actions (PutObject, GetObject) operate directly on object resources specified in the ARN.

​
2. Set up access using an IAM role

In the AWS IAM console:
  1. In the navigation pane, click Roles.
  2. Click Create role.
  3. In the Trusted entity type section, select AWS account.
  4. Select Another AWS account.
  5. Enter the Pinecone AWS VPC account ID: 713131977538
  6. Click Next.
  7. Select the policy you created.
  8. Click Next.
  9. Specify the role name. For example: “Pinecone”.
  10. Click Create role.
  11. Click the role you created.
  12. On the Summary page for the role, find the ARN. For example: arn:aws:iam::123456789012:role/PineconeAccess
  13. Copy the ARN. You will need to enter the ARN into Pinecone later.

​
3. Add a storage integration

This step is required for importing data. It is not required for storing audit logs.
In the Pinecone console, add an integration with Amazon S3..
  1. Select your project.
  2. Go to Manage > Storage integrations.
  3. Click Add integration.
  4. Enter a unique integration name.
  5. Select Amazon S3.
  6. Enter the ARN of the IAM role you created.
  7. Click Add integration.

​
Next steps