How to upload files to S3 from Node.js
I had a simple use case.
I was building a job board and it was time to build the form to submit a new job offer.
The recruiter can enter the company details, the job details, and the company logo image.
The data is stored in the database, and at first I tried to store the logo in the database, but after a while I realized that while technically ok, I had some issues with storing the binary data and it was taking too long for the task. So I said, “ok let’s just upload it to S3”.
S3 is one of the wonderful services provided by AWS. Since I already use AWS for other things, adding a S3 bucket is easy.
So I went to create an S3 bucket.
I already had an AWS account. If you don’t, start here: https://aws.amazon.com.
Once you have an account set up, create a IAM user in AWS. Login to AWS, click your name on top and then “My Security Credentials”
On the sidebar click “Users”, and “Add user”. Enable “Programmatic access”.
Move to the next screen via the buttons you find in the bottom of the page (“Next: Permissions”).
Click the “Attach existing policies directly”:
Type “S3” in the filter to show the S3 policies
Select the AmazonS3FullAccess
permission:
Once the user is created, you’ll have a pair of access key ID and secret access key. Copy those to your .env
file in the project you have, or store them somewhere so you can use them later.
Next, go in S3 and create a bucket. From the S3 homepage https://s3.console.aws.amazon.com click the “Create bucket” button.
Set a name, choose an AWS region, disable “Block all public access” (we’ll get to permissions in another post) and click the Create bucket button at the bottom of the page.
Done! Now it’s time to dive into Node.js. I use this code in Next.js, server side, in an API call.
First install the aws-sdk
package with npm install aws-sdk
.
As mentioned, store your AWS access codes in .env
:
AWS_ACCESS_KEY_ID=<the access key>
AWS_SECRET_ACCESS_KEY=<the secret>
AWS_BUCKET_NAME=<the bucket name>
Add
import AWS from 'aws-sdk'
on top.
Then initialize the s3
object with:
const s3 = new AWS.S3({
accessKeyId: process.env.AWS_ACCESS_KEY_ID,
secretAccessKey: process.env.AWS_SECRET_ACCESS_KEY
})
Now when you want to upload a file, load it from the storage
const filename = 'the-file-name'
const fileContent = fs.readFileSync(fileName)
const params = {
Bucket: process.env.AWS_BUCKET_NAME,
Key: `${filename}.jpg`,
Body: fileContent
}
s3.upload(params, (err, data) => {
if (err) {
reject(err)
}
resolve(data.Location)
})
I wrote 17 books to help you become a better developer, download them all at $0 cost by joining my newsletter
JOIN MY CODING BOOTCAMP, an amazing cohort course that will be a huge step up in your coding career - covering React, Next.js - next edition February 2025