Integrate with Amazon S3

To connect your Pinecone project to an Amazon S3 bucket, you need to create a storage integration. This integration allows Pinecone to access the data in your S3 bucket.

Once your integration is set up, you can use it to import data from your S3 bucket into a Pinecone index.

​

Before you begin

Ensure you have the following:

• A Pinecone account.
• An Amazon S3 bucket.

​

Create an IAM policy

In the AWS IAM console:

1. In the navigation pane, click Policies.
2. Click Create policy.
3. In Select a service section, select S3.
4. Select the following actions to allow:
   • ListBucket
   • GetObject
5. In the Resources section, select Specific.
6. For the bucket, specify the ARN of the bucket you created. For example: arn:aws:s3:::example-bucket-name
7. For the object, specify an object ARN as the target resource. For example: arn:aws:s3:::example-bucket-name/*
8. Click Next.
9. Specify the name of your policy. For example: “Pinecone-S3-Access”.
10. Click Create policy.

​

Set up access using an IAM role

In the AWS IAM console:

1. In the navigation pane, click Roles.

2. Click Create role.

3. In the Trusted entity type section, select AWS account.

4. Select Another AWS account.

5. Enter the Pinecone AWS VPC account ID: 713131977538

6. Click Next.

7. Select the policy you created.

8. Click Next.

9. Specify the role name. For example: “Pinecone”.

10. Click Create role.

11. Click the role you created.

12. On the Summary page for the role, find the ARN.

    For example: arn:aws:iam::123456789012:role/PineconeAccess

13. Copy the ARN.

    You need the ARN to add the integration in Pinecone.

​

Add the integration in Pinecone

To add a storage integration through the Pinecone console, take the following steps:

1. Select your project.
2. Go to Storage integrations.
3. Click Add integration.
4. Enter a unique integration name.
5. Select Amazon S3.
6. Enter the ARN of the IAM role you created.
7. Click Add integration.

​

Use the integration

Use the storage integration to import data from your S3 bucket into a Pinecone index. To use the integration, specify the integration ID, found on the Storage integrations page, in the import request.