Search for a command to run...
Hi! I'm Guille Ojeda, Cloud Architecture Consultant To put it simply, I create simple solutions for complex technical problems.
My focus is on designing scalable, secure, and cost-effective cloud solutions that startups, scaleups and SMBs can lean on to grow.
I lean on years of experience in cloud architecture and consulting to deliver solutions that are easy to understand and manage.
No comments yet. Be the first to comment.
What Are Agentic AI Architectures? I won't waste your time with a long, fluffy introduction about how AI is changing the world. Let's get straight to the point: agentic AI architectures are fundamentally different from the prompt-response pattern you...
Building distributed systems requires putting a lot of attention on communication between components. These components often need to exchange information asynchronously, and that's where message queues and pub/sub systems are the go-to solution. AWS ...
Database failures are inevitable. Even with the most reliable hardware and software, something will eventually break. AWS RDS Multi-AZ deployments promise to handle these failures gracefully, automatically failing over to a standby database when prob...
There are two managed relational database services in AWS: Amazon Relational Database Service (RDS) and Amazon Aurora. Both provide the benefits of a fully managed database solution, but they have distinct features and use cases. In this article, we'...
Containers offer a lightweight, portable, and scalable solution for running software consistently across different environments. But as the number of containers grows, managing them becomes increasingly complex. That's where container orchestration c...
In this guide, we'll discuss how to automate AWS EBS snapshot creation and receive email notifications using Python and Boto3. We will cover the entire process step by step, from setting up the AWS environment to writing and executing the Python script.
Prerequisites
Before we begin, ensure that you have the following:
An active AWS account.
Basic knowledge of AWS services, particularly EBS, Lambda, and SNS.
Familiarity with Python programming and the Boto3 library.
In order to automate EBS snapshots and send email notifications, we need to configure the AWS environment by performing the following steps:
Install the AWS CLI on your local machine by following the official AWS guide.
Configure the AWS CLI by running the command aws configure and entering your AWS Access Key ID, Secret Access Key, and preferred AWS region.
Install the Boto3 library by executing the command pip install boto3.
With the environment set up, we can proceed to create an SNS topic.
Amazon Simple Notification Service (SNS) allows us to send email notifications. To create an SNS topic, follow these steps:
Sign in to the AWS Management Console.
Navigate to the SNS dashboard.
Click on "Topics" in the left menu, and then select "Create topic".
Choose "Standard" as the topic type and enter a name and display name for your topic.
Click "Create topic" to finalize the creation process.
Copy the ARN (Amazon Resource Name) of the newly created topic for later use.
Now, let's move on to writing the Python script.
Stop copying cloud solutions, start understanding them. Join over 45,000 devs, tech leads, and experts learning how to architect cloud solutions, not pass exams, with the Simple AWS newsletter.
Create a new Python file, ebs_snapshot_automation.py, and add the following code:
import boto3
import datetime
# Replace the ARN with your SNS topic ARN
SNS_TOPIC_ARN = 'arn:aws:sns:us-west-2:123456789012:MyEBSSnapshots'
def create_snapshot_and_notify(volume_id):
ec2 = boto3.resource('ec2')
volume = ec2.Volume(volume_id)
snapshot = volume.create_snapshot(
Description=f'Snapshot of {volume_id} on {datetime.datetime.now()}'
)
sns = boto3.client('sns')
response = sns.publish(
TopicArn=SNS_TOPIC_ARN,
Message=f'Snapshot {snapshot.id} created for volume {volume_id}',
Subject='EBS Snapshot Created'
)
return response
def lambda_handler(event, context):
VOLUME_IDS = event['volume_ids']
for volume_id in VOLUME_IDS:
create_snapshot_and_notify(volume_id)
Replace the SNS_TOPIC_ARN variable with the ARN of the SNS topic created earlier. This script takes a list of EBS volume IDs and creates snapshots for each one, then sends an email notification with the snapshot ID.
To schedule the script to run periodically, follow these steps to create an AWS Lambda function and set up an Amazon CloudWatch Events rule:
Sign in to the AWS Management Console.
Navigate to the Lambda dashboard and click on "Create function".
Select "Author from scratch" and enter a name for your function, such as ebs_snapshot_automation.
Choose "Python 3.8" as the runtime, and then configure the function's execution role.
Click "Create function" to finalize the creation process.
In the "Function code" section, upload the ebs_snapshot_automation.py script or copy the script into the inline editor.
Set the lambda_handler as the handler for your Lambda function.
Navigate to the Amazon CloudWatch dashboard and click on "Rules" under the "Events" section.
Click on "Create rule" and select "Schedule" as the event source.
Configure the rule to run at your desired frequency (e.g., daily or weekly).
In the "Targets" section, select the Lambda function you created earlier.
Click "Configure details" and provide a name and description for the rule.
Click "Create rule" to set up the scheduled event.
With the CloudWatch Events rule in place, the Lambda function will execute the Python script at the specified interval, automating EBS snapshot creation and sending email notifications.
In this article, we have demonstrated how to automate AWS EBS snapshot creation and send email notifications using Python and Boto3. We covered setting up the AWS environment, creating an SNS topic, writing the Python script, and scheduling the script using AWS Lambda and Amazon CloudWatch Events.
By following these steps, you can ensure that your EBS volumes are backed up regularly and that you receive timely email notifications. This process will help you maintain data consistency and recover from potential data loss or failures, ensuring the reliability and stability of your AWS infrastructure.
Stop copying cloud solutions, start understanding them. Join over 45,000 devs, tech leads, and experts learning how to architect cloud solutions, not pass exams, with the Simple AWS newsletter.
Real scenarios and solutions
The why behind the solutions
Best practices to improve them
If you'd like to know more about me, you can find me on LinkedIn or at www.guilleojeda.com