Giter Site home page Giter Site logo

cloudformation-iops-utilization's Introduction

Visualizing usage of Provisioned IOPS volumes on Amazon EBS for analysis

This code is part of a blog post

Prerequisites

For this tutorial, you should have the following prerequisites:

  • An AWS account
  • AWS resources: Provisioned IOPS volumes
  • AWS services: Amazon S3, AWS CloudFormation, Amazon CloudWatch, AWS Identity and Access Management (IAM), and AWS Lambda

Code Overview

CloudFormation template deploys a Lambda function. The function, once invoked, captures CloudWatch metrics which are enhanced and transformed for IOPS calculations. The function generates a unique CSV file in S3 containing metrics for the last 7 days for each io1/io2 scanned volumes and can be parameterized for a larger time span. With minimal development effort, the script can be changed to capture metrics that might be relevant to other EBS volume types as well.

Main Files

  • EBSAnalyzer.yaml -> CloudFormation template that deploy the code(index.zip)
  • index.zip -> Zipped file containing the lambda function code written in Python.

Installation instrutions

Detailed instrutions can be found in the blog post.

Considerations and caveats:

The script provided is not production ready and may need changes and enhancements based on your needs.

  • Cross-account Amazon EBS volumes: Function works cross-Region, but is not designed to work cross accounts. If your organization has multiple accounts, it will need to be refactored to support cross account capabilities
  • Lambda timeout: Lambda functions, currently, are restricted to run for 15 minutes and may time out for an account with large number of volumes
  • Error handling: Function contains basic error handling and may need enhancements based on your needs
  • Performance: Performance can be improved mainly in the CSV file writing process
  • Incremental data capture/history tracking: Code can be refactored to write results incrementally to the CSV file and capture metrics on an ongoing basis

Security

See CONTRIBUTING for more information.

License

This library is licensed under the MIT-0 License. See the LICENSE file.

cloudformation-iops-utilization's People

Contributors

amazon-auto avatar ukalaspurkar avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.