Jinesh Varia, Technology Evangelist, Discusses AWS architecture best practices and design patterns at the AWS Enterprise Tour - SF - 2010
http://jineshvaria.s3.amazonaws.com/public/cloudbestpractices-jvaria.pdf
This introductory seminar explains Cloud Computing and Amazon Web Services (AWS) in great detail.
The presenter, Simone Brunozzi (@simon), is an AWS Technology Evangelist.
Recommended for business/technical audiences.
AWS Certified Solutions Architect Professional Course S15-S18Neal Davis
This deck contains the slides from our AWS Certified Solutions Architect Professional video course. It covers:
Section 15 Analytics Services
Section 16 Monitoring, Logging and Auditing
Section 17 Security: Defense in Depth
Section 18 Cost Management
Full course can be found here: https://digitalcloud.training/courses/aws-certified-solutions-architect-professional-video-course/
AWS Summit London 2014 | Options for Hybrid Environments (200)Amazon Web Services
This session is recommended for anyone considering using the AWS Cloud to augment their current IT capabilities. Adoption of cloud computing provides access to the benefits of new deployment models. But for existing enterprises, in many cases, applications deployed to the cloud need to integrate with existing on-premises resources. This session outlines several key factors to consider from the point of view of a large-scale real IT shop executive. Since each company is unique, this session compares the strengths, weaknesses, opportunities, and risks of each model and then helps participants create new hybrid orchestration and deployment options for hybrid enterprise environments.
Cloud Architectures - Jinesh Varia - GrepTheWebjineshvaria
- Cloud computing platforms like Amazon Web Services allow companies to focus on innovation rather than infrastructure maintenance by providing scalable, pay-as-you-go cloud services.
- Amazon's cloud services like EC2, S3, and SQS were used to build GrepTheWeb, a distributed text search service that can quickly search very large datasets by distributing work across elastic compute resources.
- GrepTheWeb coordinates distributed processing using SQS, stores input files in S3, runs jobs on EC2 instances, and stores results in SimpleDB to provide fast, scalable text searches without having to manage physical infrastructure.
VMware CloudTM on AWS brings VMware’s enterprise class Software-Defined Data Center software to Amazon’s public cloud, delivered as an on-demand, elastically scalable, cloud-based VMware sold, operated and supported service for any application and optimized for next-generation, elastic, bare metal AWS infrastructure. This solution enables customers to use a common set of software and tools to manage both their AWS-based and on-premises vSphere resources consistently. Further virtual machines in this environment have seamless access to the broad range of AWS services as well. This session will introduce this exciting new service and examine some of the use cases and benefits. The session will also include a VMware Tech Preview that demonstrates standing up a complete SDDC cluster on AWS and various operations using standard tools like vCenter.
AWS re:Invent 2016: Taking DevOps to the AWS Edge (CTD302)Amazon Web Services
In this session, we dive deep into how you can integrate Amazon CloudFront and related services into your application, be agile in developing and adapting the application, and follow best practices when configuring the services to improve security and performance, all while reducing costs. Attend this session and learn how to avoid needless forwarding of headers and cookies, test your application when making changes to the origin, version your configuration changes, monitor usage and automate security, create templates for new distributions, configure SSL/TLS certificates, and more.
The document provides explanations for multiple choice questions about AWS services. It discusses which AWS Support plan provides architectural and operational reviews as well as 24/7 access to engineers, who is responsible for configuring and performing backups for DynamoDB point-in-time recovery, and which security tasks fall under the customer's responsibility according to the shared responsibility model. The document also addresses questions about services for publishing messages to thousands of subscribers, factors that allow AWS to reduce pricing, migrating large amounts of data to AWS, examples of elasticity, services for reporting dashboards, and restricting access to AWS resources.
This document discusses how enterprises are using Amazon Web Services (AWS) in 2014. It notes that enterprises are using AWS for development and testing to do more work faster at lower costs. Enterprises are also using AWS to prototype new products and workloads like mobile apps, games, and video streaming. Existing enterprise workloads are being supplemented with AWS for things like disaster recovery, web hosting, and exporting data to AWS for analytics processing. The document emphasizes that enterprises are using AWS to reduce infrastructure costs, increase agility, and innovate faster than competitors.
In today’s world, technology changes at a breakneck speed. What was new this morning is outdated at lunch. Working in the AWS Cloud is no different. Every week, AWS announces new features or improvements to current products. As AWS technologists, we must assimilate these new technologies and make decisions to adopt, reject, or defer. These decisions can be overwhelming: we tend to either reject everything and become stagnant, or adopt everything and never get our project out the door. In this session we will discuss the attitude of iteration. The attitude of iteration allows us to face the challenges of change without overwhelming our technical teams with a constant tug-o-war between implementation and improvement. Whether you’re an architect, engineer, developer, or AWS newbie, prepare to laugh, cry, and commiserate as we talk about overcoming these challenges. Session sponsored by Rackspace.
This document discusses best practices for hosting web applications on AWS. It covers availability, static content hosting using S3 and CloudFront, and multi-tier application hosting using EC2, RDS, and auto-scaling. For static content, S3 provides high durability storage and CloudFront provides low-latency content delivery. For dynamic applications, EC2 is used to host instances behind an ELB for availability. RDS manages databases with read replicas and auto-scaling adds instances as needed based on metrics.
AWS Summit London 2014 | Introduction to Amazon EC2 (100)Amazon Web Services
This document is an introduction to Amazon EC2 presented by Ian Massingham on April 30, 2014. It provides an overview of EC2's key functionality and growth over the past 7 years. EC2 allows users to provision compute capacity in the cloud and pay only for what they use. It offers choices for instance types, operating systems, storage options, and pricing models to meet different use cases. EC2 provides scalability, reliability, security, and cost savings compared to on-premises infrastructure.
The document provides information about an AWS workshop on Amazon EC2 and Amazon VPC including:
- The agenda covers Amazon EC2, S3, EBS from 9:30-10:30am and Amazon VPC from 10:45-11:15am with a lab building a VPC and deploying a web server from 11:15-12:15pm.
- The introduction section gives logistics for connecting to WiFi and downloading the lab guide and signing up for an AWS account.
- Amazon EC2 allows launching virtual server instances with options to choose the operating system, configure storage and networking, and scale capacity up or down as needed.
In this presentation, we provide an overview of Cloud Computing and provide some details on the wide range of services that Amazon Web Services offers today. This presentation is intended for people new to cloud computing or experienced cloud developers who have not yet used AWS.
- AWS provides startups with a vast array of cloud infrastructure services and platform capabilities to help them build and scale their applications quickly and cost effectively. These services include compute, storage, databases, analytics and more.
- AWS aims to continually innovate and introduce new services at a rapid pace based on customer feedback, with over 100 significant services or features launched since 2008. This allows startups to focus on their core business without having to manage infrastructure.
- Emerging technologies like containers, serverless computing (AWS Lambda) and API Gateway make it easier for startups to build dynamic and scalable applications on AWS.
How do you do continuous delivery when using Docker and Amazon ECS?
In this session, we’ll explore basic continuous integration and delivery concepts and how they can be applied to Docker and Amazon ECS. We will discuss how you can use AWS CodePipeline to monitor a GitHub repository for new commits, AWS CodeBuild to create a new Docker container image and to push it into Amazon ECR, and AWS CloudFormation to deploy the new container image to production on Amazon ECS. We will end with a demo of this entire toolchain.
Webinar aws 101 a walk through the aws cloud- introduction to cloud computi...Amazon Web Services
Whether you are running applications that share photos or support critical operations of your business, you need rapid access to flexible and low cost IT resources. The term "cloud computing" refers to the on-demand delivery of IT resources via the Internet with pay-as-you-go pricing. Whether you are a start-up who wants to accelerate growth without a big upfront investment in cash or time for technology or an Enterprise looking for IT innovation, agility and resiliency while reducing costs, the AWS Cloud provides a complete set of web services at zero upfront costs which are available with a few clicks and within minutes. Join this webinar to learn more about the benefits of Cloud Computing and:
- The history of AWS and how a global online retailer got into cloud computing
- The concepts of utility computing and elasticity and why these are important to a cost-effective, scalable and reliable IT architecture
- The AWS service portfolio and the global footprint on which it is delivered
- The value proposition of the AWS Cloud
- Use cases to help you relate cloud based infrastructure to your own needs
- Busting the myths around cloud computing
- No prior experience is necessary, so join us for an overview of the AWS cloud services, and a discussion on how cloud computing can help accelerate innovation in your company.
Today, it is critical that IT teams are able to easily, consistently deploy to production. Running Docker containers on Amazon Web Services makes it possible to engineer a compliant and DevOps-friendly environment from the ground up. Spring Venture Group successfully migrated to AWS with Docker containers and leveraged Logicworks to migrate to AWS and automate infrastructure build-out and deployment. Join our webinar to learn how Spring Venture Group, an innovative insurance brokerage, reduced risk and improved deployment velocity with Logicworks, AWS, and Docker.
Azure vs AWS Best Practices: What You Need to KnowRightScale
Azure is now the clear #2 in public cloud behind AWS. While some cloud users are evaluating Azure vs. AWS, many enterprises are planning to use both cloud providers. But there are some notable differences between how the two clouds operate and the best practices for deploying workloads in each.
The Azure vs. AWS Best Practices: What You Need to Know webinar will cover:
Recent and coming enhancements for Azure.
Azure vs. AWS differences for compute, networking, and storage.
Best practices for cloud deployments in Azure and AWS.
How to use both Azure and AWS.
This document provides an overview of Amazon Web Services (AWS) and its cloud computing infrastructure and services. It describes AWS's global footprint including regions and availability zones. It then discusses various AWS computing, storage, database, deployment/administration and application services like EC2, S3, RDS, IAM, Elastic Beanstalk and more. The document concludes with a proposed example application architecture using several AWS services.
AWS Cloud Design Patterns (a.k.a. CDP) are generally repeatable solutions to commonly occurring problems in cloud architecting. In this session, we introduce CDP and explain how you can apply CDPs in practical scenarios such as photo sharing, e-commerce, and web site campaigns.
This document provides an overview of architecting applications for the AWS cloud. It discusses key AWS cloud computing attributes like scalability, on-demand provisioning, and efficiency of experts. It also outlines best practices like designing for failure, loose coupling, dynamism, and security. Specific AWS services are mapped to common application needs like compute, storage, content delivery, databases, and more. Overall the document aims to educate readers on how to leverage AWS architectural principles and services.
AWS re:Invent 2016: Design Patterns for High Availability: Lessons from Amazo...Amazon Web Services
This document discusses design patterns for high availability used by Amazon CloudFront. It describes four key patterns: 1) FoodTasting which involves deploying changes incrementally to a small subset of servers first, 2) handling flash crowds by caching content, serving only necessary content, and using scheduled auto scaling, 3) implementing defense in depth strategies like multi-implementation and sharding to reduce the blast radius of failures, and 4) protecting against time bombs by jittering deployments and configurations across servers to avoid homogeneous outages. The document provides examples of how these patterns have been implemented in CloudFront and AWS services.
AWS Lambda is a new compute service that runs your code in response to events and automatically manages compute resources for you. In this session, you learn what you need to get started quickly, including a review of key features, a live demonstration, guidelines on how to use AWS Lambda with Amazon S3 event notifications and Amazon DynamoDB streams, and tips on getting the most out of Lambda functions.
AWS Summit 2014 Perth - Breakout 3
The AWS Cloud infrastructure has been architected to be one of the most flexible and secure cloud computing environments available today. In this session, we’ll provide a practical understanding of the assurance programs that AWS provides; such as HIPAA, FedRAMP(SM), PCI DSS Level 1, MPAA, and many others. We’ll also address the types of business solutions that these certifications enable you to deploy on the AWS Cloud, as well as the tools and services AWS makes available to customers to secure and manage their resources.
Presenter: James Bromberger, Solutions Architect, Amazon Web Services
The document discusses five key principles for architecting applications on AWS: elasticity, designing for failure, loose coupling, security, and performance. It provides examples and services for each principle such as using Amazon EC2 for elasticity, designing with fault tolerance using services like RDS and Route 53, loosely coupling components with services like SQS and SWF, leveraging security services like IAM, and scaling vertically with cluster compute or horizontally using services like ElastiCache for performance.
S3 cassandra or outer space? dumping time series data using sparkDemi Ben-Ari
Vast volume of our processed data is Time Series data and once you start working with distributed systems, you start tackling many scale and performance problems, many questions arise:
How to handle missing data?
Should my system handle both serving and backed process or separating them out?
Which one of the solutions will be cheaper? Best Performance for Money?
In the talk we will tell the tale of all of the transformations we’ve made to our data model @Windward, show some of the problems we’ve handled, review the multiple data persistency layers like: S3, MongoDB, Apache Cassandra, MySQL.
And I’ll try my best NOT to answer the question “Which one of them is the Best?”
Sharing our Pain and Lessons learned is promised!
Bio:
Demi Ben-Ari, Sr. Data Engineer @Windward,
I have over 9 years of experience in building various systems both from the field of near real time applications and Big Data distributed systems.
Co-Founder of the “Big Things” Big Data community: http://somebigthings.com/big-things-intro/
I’m a software development groupie, Interested in tackling cutting edge technologies.
A RAM Disk is a software layer that enables applications to transparently use RAM, often a segment of main memory, as if it were a hard disk or other secondary storage.
The general purpose computing and storage environment of Amazon Web Services integrates perfectly into your existing ecosystem. Join customers who have taken advantage of this environment in parallel to their on-premise infrastructure to hear tales, tips, and tricks of best practices of integrating AWS with existing resources securely using services such as Amazon Virtual Private Cloud, AWS Direct Connect, and AWS Storage Gateway.
Developing for Hybrid Cloud with BluemixRoberto Pozzi
This document discusses two ways to integrate an IBM i program with a Bluemix application using REST services. The first way uses WebSphere Application Server Liberty Profile to expose a REST service that calls the IBM i program. The second way uses Cast Iron Live to expose an API that calls a REST service behind the firewall, which is then consumed by a Cloud Integration Service in Bluemix. Both options allow developers to integrate existing IBM i assets with new applications in Bluemix.
Bluemix presentation IBM Cloud Briefing in San JoseSergio Loza
IBM Bluemix is a cloud platform that allows users to build, run, and manage applications. It provides tools and services like containers, data services, APIs, and more to help developers rapidly build and deploy applications. Bluemix supports both agile development methods and DevOps practices to enable continuous delivery. It also offers hybrid deployment options and layered security features to meet enterprise needs.
You will learn how to create file archives, upload them to Amazon S3, and manage permissions and lifetimes, giving you the ability to back up any amount of data and to retain it for as long as you'd like. A number of open source and commercial backup and archiving tools will be demonstrated, as time permits.
You will also learn how to use built-in AWS facilities to quickly and easily create and restore snapshots of entire disk volumes.
This document contains slides from a presentation given at the AWS Government, Education, and Nonprofit Symposium on June 25-26, 2015 in Washington, DC. The presentation discusses how to architect applications on AWS for high availability using services like Auto Scaling, Elastic Load Balancing, Route 53, and multiple Availability Zones. It also provides an overview of AWS global infrastructure and security features.
The document discusses machine learning and artificial immune systems for financial security and fraud detection. It provides an introduction to machine learning meetups and outlines various topics to be covered including the biological immune system, danger theory, artificial immune systems, and applications of immune-inspired machine learning techniques for network security, intrusion detection, and movie recommendation systems. Potential solutions discussed include using distributed storage systems like Hadoop, online learning algorithms inspired by immune systems and genetic algorithms, and building a fraud detection system based on constantly updating user behavior profiles.
Architectural Patterns of Resilient Distributed SystemsInes Sombra
This document contains the slides from a presentation given by Ines Sombra at Strangeloop 2015 about architectural patterns for building resilient distributed systems. The presentation discusses defining resilience, models of resilience from literature like probabilistic availability and decomposition/orthogonality. It also discusses insights from industry systems like Netflix, Google Chubby, Twitter Truce, and resilient architectural patterns like redundancies, gossip protocols, and prioritizing operability and the ability to handle unknown unknowns.
Speed and Reliability at Any Scale: Amazon SQS and Database Services (SVC206)...Amazon Web Services
Amazon Simple Queue Service (Amazon SQS) makes it easy and inexpensive to enhance the scalability and reliability of your cloud application. In this session, we demonstrate design patterns for using Amazon SQS in conjunction with Amazon Simple Storage Service (Amazon S3), Amazon DynamoDB, Amazon Elastic MapReduce, Amazon Relational Database Service, and Amazon Redshift. Shazam will share their experience of combining Amazon SQS with Amazon DynamoDB to support a Super Bowl advertising campaign.
Disaster Recovery of on-premises IT infrastructure with AWSAmazon Web Services
The objective of this session is to enable customers with any level of DR experience to gain actionable guidance to advance their business up the ladder of DR readiness. AWS enables fast disaster recovery of critical on-premises IT systems without incurring the complexity and expense of a second physical site. With 28 availability zones in 11 regions around the world and a broad set of services, AWS can deliver rapid recovery of on-premises IT infrastructure and data. During this session we will walk you through the ascending levels of DR options made possible with AWS and review the technologies and services that help deliver various DR capabilities, starting from cloud backups all the way up to hot site DR. We will also explore various DR architectures and the balance of recovery time and cost.
Realizing Hybrid Cloud: Using IBM Bluemix, APIs, and DataPowerAkana
The document discusses hybrid cloud and how APIs can be used to enable an effective hybrid cloud strategy. It presents three models of hybrid cloud - ad-hoc, bespoke, and API-driven. The API-driven model is identified as optimal for meeting stakeholder needs and making hybrid cloud work. The document also describes a demo using IBM Bluemix, APIs, and DataPower to deliver cloud integration solutions and realize an API-driven hybrid cloud.
NWCloud Cloud Track - Best Practices for Architecting in the Cloudnwcloud
The document discusses best practices for cloud architecture based on lessons learned from Amazon Web Services customers. It provides guidance on designing systems for failure, loose coupling, elasticity, security, leveraging constraints, parallelism, and different storage options. The key lessons are applied to migrating a sample web application architecture to AWS.
This document provides an overview of architecting applications for the Amazon Web Services (AWS) cloud platform. It discusses key cloud computing attributes like abstract resources, on-demand provisioning, scalability, and lack of upfront costs. It then describes various AWS services for compute, storage, messaging, payments, distribution, analytics and more. It provides examples of how to design applications to be scalable and fault-tolerant on AWS. Finally, it discusses best practices for migrating existing web applications to take advantage of AWS capabilities.
Amazon Web Services (AWS) began offering IT infrastructure services to businesses in the form of web services -- now commonly known as cloud computing. One of the key benefits of cloud computing is the opportunity to replace up-front capital infrastructure expenses with low variable costs that scale with your business. With the Cloud, businesses no longer need to plan for and procure servers and other IT infrastructure weeks or months in advance. Instead, they can instantly spin up hundreds or thousands of servers in minutes and deliver results faster.
ARC205 Building Web-scale Applications Architectures with AWS - AWS re: Inven...Amazon Web Services
As both new and established businesses work to increase their customer numbers, revenue and relevance to the market – they are working to deliver software that scales larger than ever before. The challenge of being the "victim of your own success" be it from viral marketing, social media or simply dramatic uptake of a new service; is something that troubles the minds of CIOs and Engineers alike. This session will focus on ways to avoid creating "technical debt" during initial development, and will share well established practices and approaches to building applications that can tolerate and revel in the challenges of scaling to "web scale". Working through a range of architectural dimensions, patterns and pithy examples – attendees will leave this session with useful ideas on how to design new applications, as well as the "retro-fitting" that can be done to existing applications to enable them to scale on AWS.
WKS401 Deploy a Deep Learning Framework on Amazon ECS and EC2 Spot InstancesAmazon Web Services
Deep learning is an implementation of machine learning that uses neural networks to solve difficult and complex problems, such as computer vision, natural language processing, and recommendations. Due to the availability of deep learning libraries and frameworks, developers have the ability to enhance the capabilities of their applications and projects.
In this workshop, you learn how to build and deploy a powerful deep learning framework called MXNet on containers. The portability and resource management benefit of containers means developers can focus less on infrastructure and more on building. The labs start by demonstrating the automation capabilities of AWS CloudFormation to stand up core infrastructure; as an added bonus, you use Spot Fleet to leverage the cost benefits of using Spot Instances, especially for developer environments. Then, you walk through creating an MXNet container in Docker and deploying it with Amazon ECS. Finally, you walk through an image classification demo of MXNet to validate that everything is working as expected.
Pre-reqs: Laptop and AWS account
This document provides an overview of Amazon Elastic Compute Cloud (EC2), a cloud computing service that allows users to launch server instances in Amazon's data centers. EC2 provides templates called Amazon Machine Images (AMIs) that contain pre-configured software. Users can launch instances of AMIs to replicate configurations across multiple servers. EC2 instances can be deployed and terminated on demand, while physical servers require regular maintenance. EC2 offers scalable, on-demand resources that users pay for based on usage, unlike physical servers which incur costs whether used or not. The document also briefly discusses other Amazon cloud services like S3, DynamoDB, and Elastic Beanstalk.
The document discusses Amazon Web Services (AWS) and its cloud computing offerings. It provides an overview of AWS' services and growth, including that it serves hundreds of thousands of customers globally and processes over 200 billion requests per day to Amazon S3 storage. It also summarizes AWS' focus on innovation, expanding its platform of services, growing its partner ecosystem, and priorities for 2011 which include adding more geographic regions and making applications easier to build and manage on AWS.
Dr. Werner Vogels discusses the power of infrastructure as a service provided by Amazon Web Services (AWS). AWS provides on-demand access to computing resources, databases, storage, and other services on a pay-as-you-go basis. This allows customers to avoid upfront costs and scale resources up or down as needed. AWS sees billions of requests per day to services like Amazon S3 storage and continues innovating with new services and lower prices to benefit customers. When choosing a cloud provider, customers should consider requirements around security, performance, cost, flexibility, speed of innovation, and the partner's ability to deliver a reliable cloud platform.
Scaling drupal horizontally and in cloudVladimir Ilic
Vancouver Drupal group presentation for April 25, 2013.
How to deploy Drupal on
- multiple web servers,
- multiple web and database servers, and
- how to join all that together and make site deployed on Amazon Cloud (Virtual Private Cloud) inside
- one availability zone
- multiple availability zones deployment.
Session cover details about what you need in order to get Drupal deployed on separate servers, what are issues/concerns, and how to solve them.
Workshop; Deploy a Deep Learning Framework on Amazon ECS and Spot InstancesAmazon Web Services
This document provides an overview of a workshop on deploying a deep learning framework on Amazon ECS and Spot Instances. The workshop will introduce MXNet, containers, Amazon ECS, Amazon ECR, AWS CloudFormation, Amazon EC2 Spot Fleet and Spot Instances. It will include hands-on labs to build an MXNet Docker image, deploy an MXNet container with ECS, and run an image classification demo using a Spot Fleet on ECS. The overall goal is to learn how to cost-effectively run deep learning workloads on AWS.
The document provides an overview of Amazon Web Services (AWS) and its computing services. It describes Amazon Elastic Compute Cloud (EC2) which allows users to launch virtual servers called instances in AWS data centers. It provides flexibility, cost effectiveness, scalability, security and reliability. EC2 reduces time to obtain servers and allows users to pay only for what they use.
You’re interested in the cloud, and you want to start learning more. In this webcast we will answer the following questions:
• What is Cloud Computing?
• What are the benefits of Cloud Computing?
• What are AWS’s products and what workloads can I run with them?
• Who is using the cloud and what are they using it for?
The Cloud as a Platform - Cloud Connections 2011 Keynote - Jinesh VariaAmazon Web Services
The Cloud as a Platform Keynote Presentation delivered at Cloud Connections Conference (DevConnections) April 19, 2011 by Jinesh Varia, Technology Evangelist, Amazon
Amazon provides infrastructure as a service through its cloud computing platform AWS. AWS offers on-demand access to computing resources, storage, databases, and other services that allow customers to build and host their applications. Some key benefits of AWS include no upfront capital costs, rapid scaling, high reliability, and a fast pace of innovation with new services and features added regularly. AWS has a global network of data centers and is used by hundreds of thousands of customers worldwide across industries.
The document discusses building a mobile application on AWS that is location-centric and connects with the user's mobile device. It describes using AWS services like Elastic Beanstalk, EC2, S3, DynamoDB, SQS, and CloudFront to develop a minimum viable product within 2.5 days that demonstrates key AWS concepts. The core architecture involves using Elastic Beanstalk for application deployment, EC2 and EBS for compute and storage, DynamoDB for session storage, SQS for pushing content, and CloudFront for content delivery. Visual Studio is used to develop and publish the application directly to AWS.
AWS Summit Sydney 2014 | Running your First Application on AWSAmazon Web Services
AWS provides a platform that is ideally suited for deploying highly available and reliable systems that can scale with a minimal amount of human interaction. This talk describes a set of architectural patterns that support highly available services that are also scalable, low cost, low latency and allow for agile development practices. We walk through the various architectural decisions taken for each tier and explain our choices for appropriate AWS services and building blocks to ensure the security, scale, availability and reliability of the application.
The document provides an overview of an AWS 101 presentation. It includes an agenda for the presentation covering AWS concepts and live demonstrations of keypairs, security groups, EC2 instances, autoscaling, Amazon Machine Images, S3, CloudFront, Elastic Load Balancer, and RDS. It also provides background information on Amazon Web Services and an overview of the various AWS services covered in the toolbox section.
AWS Cloud Kata 2014 | Jakarta - 2-1 AWS Intro and Scale 2014Amazon Web Services
This document provides an overview of strategies for building scalable applications on AWS. It recommends starting simply with EC2, RDS, and Route 53, then adding services like S3, DynamoDB, ElastiCache, and CloudFront to optimize performance. Auto Scaling is introduced to automatically scale resources based on demand. The document discusses best practices like separating databases by function, implementing sharding, and leveraging serverless options. The goal is to demonstrate how these techniques can help applications scale to millions of users on AWS.
This document discusses Amazon Web Services (AWS) and how it provides on-demand infrastructure for hosting web-scale solutions. It outlines the various services AWS offers, including compute, storage, databases, analytics, and more. It highlights how AWS allows customers to avoid upfront costs and scale infrastructure quickly. The document also discusses how AWS provides a more flexible system than traditional infrastructure and enables businesses to focus on innovation rather than managing infrastructure.
Similar to AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia (20)
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
1) The document discusses building a minimum viable product (MVP) using Amazon Web Services (AWS).
2) It provides an example of an MVP for an omni-channel messenger platform that was built from 2017 to connect ecommerce stores to customers via web chat, Facebook Messenger, WhatsApp, and other channels.
3) The founder discusses how they started with an MVP in 2017 with 200 ecommerce stores in Hong Kong and Taiwan, and have since expanded to over 5000 clients across Southeast Asia using AWS for scaling.
This document discusses pitch decks and fundraising materials. It explains that venture capitalists will typically spend only 3 minutes and 44 seconds reviewing a pitch deck. Therefore, the deck needs to tell a compelling story to grab their attention. It also provides tips on tailoring different types of decks for different purposes, such as creating a concise 1-2 page teaser, a presentation deck for pitching in-person, and a more detailed read-only or fundraising deck. The document stresses the importance of including key information like the problem, solution, product, traction, market size, plans, team, and ask.
This document discusses building serverless web applications using AWS services like API Gateway, Lambda, DynamoDB, S3 and Amplify. It provides an overview of each service and how they can work together to create a scalable, secure and cost-effective serverless application stack without having to manage servers or infrastructure. Key services covered include API Gateway for hosting APIs, Lambda for backend logic, DynamoDB for database needs, S3 for static content, and Amplify for frontend hosting and continuous deployment.
This document provides tips for fundraising from startup founders Roland Yau and Sze Lok Chan. It discusses generating competition to create urgency for investors, fundraising in parallel rather than sequentially, having a clear fundraising narrative focused on what you do and why it's compelling, and prioritizing relationships with people over firms. It also notes how the pandemic has changed fundraising, with examples of deals done virtually during this time. The tips emphasize being fully prepared before fundraising and cultivating connections with investors in advance.
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
This document discusses Amazon's machine learning services for building conversational interfaces and extracting insights from unstructured text and audio. It describes Amazon Lex for creating chatbots, Amazon Comprehend for natural language processing tasks like entity extraction and sentiment analysis, and how they can be used together for applications like intelligent call centers and content analysis. Pre-trained APIs simplify adding machine learning to apps without requiring ML expertise.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.
What's Next Web Development Trends to Watch.pdfSeasiaInfotech2
Explore the latest advancements and upcoming innovations in web development with our guide to the trends shaping the future of digital experiences. Read our article today for more information.
AC Atlassian Coimbatore Session Slides( 22/06/2024)apoorva2579
This is the combined Sessions of ACE Atlassian Coimbatore event happened on 22nd June 2024
The session order is as follows:
1.AI and future of help desk by Rajesh Shanmugam
2. Harnessing the power of GenAI for your business by Siddharth
3. Fallacies of GenAI by Raju Kandaswamy
MYIR Product Brochure - A Global Provider of Embedded SOMs & SolutionsLinda Zhang
This brochure gives introduction of MYIR Electronics company and MYIR's products and services.
MYIR Electronics Limited (MYIR for short), established in 2011, is a global provider of embedded System-On-Modules (SOMs) and
comprehensive solutions based on various architectures such as ARM, FPGA, RISC-V, and AI. We cater to customers' needs for large-scale production, offering customized design, industry-specific application solutions, and one-stop OEM services.
MYIR, recognized as a national high-tech enterprise, is also listed among the "Specialized
and Special new" Enterprises in Shenzhen, China. Our core belief is that "Our success stems from our customers' success" and embraces the philosophy
of "Make Your Idea Real, then My Idea Realizing!"
In this follow-up session on knowledge and prompt engineering, we will explore structured prompting, chain of thought prompting, iterative prompting, prompt optimization, emotional language prompts, and the inclusion of user signals and industry-specific data to enhance LLM performance.
Join EIS Founder & CEO Seth Earley and special guest Nick Usborne, Copywriter, Trainer, and Speaker, as they delve into these methodologies to improve AI-driven knowledge processes for employees and customers alike.
How Netflix Builds High Performance Applications at Global ScaleScyllaDB
We all want to build applications that are blazingly fast. We also want to scale them to users all over the world. Can the two happen together? Can users in the slowest of environments also get a fast experience? Learn how we do this at Netflix: how we understand every user's needs and preferences and build high performance applications that work for every user, every time.
Performance Budgets for the Real World by Tammy EvertsScyllaDB
Performance budgets have been around for more than ten years. Over those years, we’ve learned a lot about what works, what doesn’t, and what we need to improve. In this session, Tammy revisits old assumptions about performance budgets and offers some new best practices. Topics include:
• Understanding performance budgets vs. performance goals
• Aligning budgets with user experience
• Pros and cons of Core Web Vitals
• How to stay on top of your budgets to fight regressions
The Rise of Supernetwork Data Intensive ComputingLarry Smarr
Invited Remote Lecture to SC21
The International Conference for High Performance Computing, Networking, Storage, and Analysis
St. Louis, Missouri
November 18, 2021
Blockchain and Cyber Defense Strategies in new genre timesanupriti
Explore robust defense strategies at the intersection of blockchain technology and cybersecurity. This presentation delves into proactive measures and innovative approaches to safeguarding blockchain networks against evolving cyber threats. Discover how secure blockchain implementations can enhance resilience, protect data integrity, and ensure trust in digital transactions. Gain insights into cutting-edge security protocols and best practices essential for mitigating risks in the blockchain ecosystem.
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - MydbopsMydbops
This presentation, delivered at the Postgres Bangalore (PGBLR) Meetup-2 on June 29th, 2024, dives deep into connection pooling for PostgreSQL databases. Aakash M, a PostgreSQL Tech Lead at Mydbops, explores the challenges of managing numerous connections and explains how connection pooling optimizes performance and resource utilization.
Key Takeaways:
* Understand why connection pooling is essential for high-traffic applications
* Explore various connection poolers available for PostgreSQL, including pgbouncer
* Learn the configuration options and functionalities of pgbouncer
* Discover best practices for monitoring and troubleshooting connection pooling setups
* Gain insights into real-world use cases and considerations for production environments
This presentation is ideal for:
* Database administrators (DBAs)
* Developers working with PostgreSQL
* DevOps engineers
* Anyone interested in optimizing PostgreSQL performance
Contact info@mydbops.com for PostgreSQL Managed, Consulting and Remote DBA Services
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
Video traffic on the Internet is constantly growing; networked multimedia applications consume a predominant share of the available Internet bandwidth. A major technical breakthrough and enabler in multimedia systems research and of industrial networked multimedia services certainly was the HTTP Adaptive Streaming (HAS) technique. This resulted in the standardization of MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH) which, together with HTTP Live Streaming (HLS), is widely used for multimedia delivery in today’s networks. Existing challenges in multimedia systems research deal with the trade-off between (i) the ever-increasing content complexity, (ii) various requirements with respect to time (most importantly, latency), and (iii) quality of experience (QoE). Optimizing towards one aspect usually negatively impacts at least one of the other two aspects if not both. This situation sets the stage for our research work in the ATHENA Christian Doppler (CD) Laboratory (Adaptive Streaming over HTTP and Emerging Networked Multimedia Services; https://athena.itec.aau.at/), jointly funded by public sources and industry. In this talk, we will present selected novel approaches and research results of the first year of the ATHENA CD Lab’s operation. We will highlight HAS-related research on (i) multimedia content provisioning (machine learning for video encoding); (ii) multimedia content delivery (support of edge processing and virtualized network functions for video networking); (iii) multimedia content consumption and end-to-end aspects (player-triggered segment retransmissions to improve video playout quality); and (iv) novel QoE investigations (adaptive point cloud streaming). We will also put the work into the context of international multimedia systems research.
The DealBook is our annual overview of the Ukrainian tech investment industry. This edition comprehensively covers the full year 2023 and the first deals of 2024.
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
Navigating Post-Quantum Blockchain: Resilient Cryptography in Quantum Threatsanupriti
In the rapidly evolving landscape of blockchain technology, the advent of quantum computing poses unprecedented challenges to traditional cryptographic methods. As quantum computing capabilities advance, the vulnerabilities of current cryptographic standards become increasingly apparent.
This presentation, "Navigating Post-Quantum Blockchain: Resilient Cryptography in Quantum Threats," explores the intersection of blockchain technology and quantum computing. It delves into the urgent need for resilient cryptographic solutions that can withstand the computational power of quantum adversaries.
Key topics covered include:
An overview of quantum computing and its implications for blockchain security.
Current cryptographic standards and their vulnerabilities in the face of quantum threats.
Emerging post-quantum cryptographic algorithms and their applicability to blockchain systems.
Case studies and real-world implications of quantum-resistant blockchain implementations.
Strategies for integrating post-quantum cryptography into existing blockchain frameworks.
Join us as we navigate the complexities of securing blockchain networks in a quantum-enabled future. Gain insights into the latest advancements and best practices for safeguarding data integrity and privacy in the era of quantum threats.
Navigating Post-Quantum Blockchain: Resilient Cryptography in Quantum Threats
AWS Architecting Cloud Apps - Best Practices and Design Patterns By Jinesh Varia
1. Jinesh Varia Technology Evangelist jvaria@amazon.comArchitecturalDesign Patterns in Cloud Computing
2. They have asked me to talkBut I am here to listenPlease Send Feedbackjvaria@amazon.comTwitter: @jinman
3. Cloud Best Practices WhitepaperPrescriptive guidance to Cloud ArchitectsJust Google for “Cloud Best Practices” to find the linkhttp://media.amazonwebservices.com/AWS_Cloud_Best_Practices.pdf
4. Cloud Computing AttributesWhat makes the Cloud so attractiveAbstract ResourcesFocus on your needs, not on hardware specs. As your needs change, so should your resources.On-Demand ProvisioningAsk for what you need, exactly when you need it. Get rid of it when you don’t needScalability in minutesScale out or in depending on usage needs.Pay per consumptionNo contracts or long-term commitments.Pay only for what you use.Efficiency of ExpertsUtilize the skills, knowledge and resources of experts.
6. “At Amazon, Every Day is a Launch Day”The “Living and Evolving” CloudNew Features and Services» Amazon EC2 with Windows Server 2008, Spot Instances,
7. Boot from Amazon EBS» Amazon CloudFront Streaming» Amazon VPC enters Unlimited Beta» AWS Region in Northern California» International Support for AWS Import/Export» AWS Multi-Factor Authentication» Virtual Private Cloud» Lower Reserved Instance Pricing» Reserved Instances in EU Region» Elastic MapReduce» SQS in EU Region» Amazon RDS» High-Memory Instances» Lower EC2 Pricing» New SimpleDB Features» FPS General Availability» Amazon SNS» AWS Security Center2009Jan2010JanJulSepOctDecAugNovFebMarAprJunMayFebMar» Amazon EC2 with Windows» Amazon EC2 in EU Region» AWS Toolkit for Eclipse» Amazon EC2 Reserved Instances» Amazon CloudFront Private Content» SAS70 Type II Audit» AWS SDK for .NET» Amazon Elastic MapReduce in Europe» Amazon EC2 Reserved Instances with Windows, Extra Large High Memory Instances» Amazon S3 Versioning Feature» Consolidated Billing for AWS» Lower pricing for Outbound Data Transfer» AWS Import/Export» New CloudFront Feature» Monitoring, Auto Scaling & Elastic Load Balancing» EBS Shared Snapshots» SimpleDB in EU Region» Monitoring, Auto Scaling & Elastic Load Balancing in EU » Lower pricing tiers for Amazon CloudFront» AWS Management Console
8. ScalabilityBuild Scalable Architecture on AWSA scalable architecture is critical to take advantage of a scalable infrastructureCharacteristics of Truly Scalable ServiceIncreasing resources results in a proportional increase in performanceA scalable service is capable of handling heterogeneityA scalable service is operationally efficientA scalable service is resilientA scalable service becomes more cost effective when it grows
9. Cloud Architecture Lessonsusing Amazon Web Services1. Design for failure and nothing fails2. Loose coupling sets you free3. Implement “Elasticity”4. Build Security in every layer5. Don't fear constraints6. Think Parallel7. Leverage different storage options
10. 1. Design for Failureand nothing will really fail"Everything fails, all the time"Werner Vogels, CTO Amazon.comAvoid single points of failureAssume everything fails, and design backwardsGoal: Applications should continue to function even if the underlying physical hardware fails or is removed or replaced.
11. Design for Failure with AWSTools to make your life easierUse Elastic IP addresses for consistent and re-mappable routesUse multiple Amazon EC2 Availability Zones (AZs)Create multiple database slaves across AZsUse real-time monitoring (Amazon CloudWatch)Use Amazon Elastic Block Store (EBS) for persistent file systems
17. 2. Build Loosely Coupled SystemsThe looser they're coupled, the bigger they scaleIndependent componentsDesign everything as a Black BoxDe-coupling for Hybrid modelsLoad-balance clustersUse Amazon SQS as BuffersTight CouplingController AController BController CQQQLoose Coupling using QueuesController AController BController C
18. MyWebSite.comExterior Firewall Hardware or Software Solution to open standard Ports (80, 443)Web Load BalancerHardware or Software solution to distribute traffic over web serversLBWeb TierFleet of machines handling HTTP requests.Web ServerWeb ServerBackend Firewall Limits access to application tier from web tierLBApp Load BalancerHardware or Software solution to spread traffic over app servers App Server Tier Fleet of machines handling Application specific workloadsCaching server machines can be implemented at this layerApp ServerApp ServerApp serverBackups on Tapes Periodic backups stored on Tapes usually managed by 3rd party at their siteData Tier Database Server machines with master and local running separately, Network storage for Static objects MySQLMasterMySQL(Slave)Tapes
19. MyWebSite.comDNSElastic Load BalancerELB to spread traffic to Web Server Auto-scaling groupsLBELB: Web TierExterior Firewall no longer needed because EC2 instances are controlled with Security GroupsAvailability Zone #1Availability Zone 2Auto-scaling group : Web TierAuto-scaling group : Web TierAvailability Zone #nWeb ServerWeb ServerWeb ServerWeb ServerAuto-scaling Web TierGroup of EC2 instances handling HTTP requests.Edge CachingHigh Volume Static Content is edge cached using CloudFrontBackend Firewall no longer neededSLBApp Server Load BalancerSoftware LB (e.g. HAProxy) on EC2 instance to spread traffic over app server clusterSLBAuto-scaling group : App TierAuto-scaling group : App TierAuto-scaling App Tier Group of EC2 instances running the actual app. Instances belong to Auto-scaling group.Caching servers instances can be implemented at this layerApp ServerApp ServerApp ServerApp ServerTomcatTomcatCloudFrontAmazon S3RDSSlaveRDSMasterRDSSlaveDB Tier MySQL RDS DB Instances (master, local slave, x-AZ slave for failover) , Automated backups to S3 all managed by AWSBackups Amazon S3 used for storing Static Objects and Backups
20. 3. Implement ElasticityElasticity is fundamental property of the CloudDon’t assume healthor fixed location of componentsUse designs that are resilient to reboot and re-launchBootstrapyour instances: Instances on boot will ask a question “Who am I & what is my role?”Enable dynamic configurationUse Auto-scaling (Free)Use Elastic Load Balancing on multiple layersUse configurations in SimpleDB to bootstrap instance
21. 3. Implement ElasticityManaged Development EnvironmentAutomate everythingSaaSPaidAMIWeb 2.0 Marketing CampaignDev/TestAppsProdManaged Development EnvironmentAutomatedDeployment EnvironmentCloud-powered Software Lifecycle managementAWS CloudAWS CloudAWS CloudISV DepartmentEnterprise IT
23. 3. Implement Elasticity3 Approaches to design MDE3 approaches to designing your AMIsEasier to SetupInventory of fully baked AMIs(Frozen Pizza Model)“Golden AMIs” with fetch on boot(Take N’ Bake Papa Murphy Model) AMIs with JeOS and “Chef” Agent (Made to Order Pizza Model)More ControlEasier to maintain
25. 3. Implement Elasticity3 Approaches to design MDE“Golden AMIs” with fetch on boot 2. Take N Bake Pizza ModelIISIISSource ControlFetch on boot timeYour CodeASP.NET MVCAmazon S3Your CodeASP.NET MVCLog4NetnHibernateLog4NetSpring.NET Spring.NET IISIISIISIISIISnHibernateIISIISIISIISIIS.NET .NET .NET .NET .NET .NET WindowsAmazon EC2WindowsWindowsWindowsWindowsWindows.NET AMI.NET Stack
26. 3. Implement Elasticity3 Approaches to design MDE3. Made to Order Pizza Model ApacheMongrelSource ControlRailsYour CodeCookbooks RecipesYour CodeAmazon S3ASP.NET MVCLog4Net.NET IISChef ServernHibernateloggerIISSpring.NET RubyGemsmemcachedRuby RuntimeCHEF AgentCHEF AgentCentosWindowsWindowsAmazon EC2AMI (JeOS)RoR Stack
27. 3. Implement Elasticity3 Approaches to design MDE3 approaches to designing your AMIsEasier to SetupInventory of fully baked AMIs(Frozen/Ready made)“Golden AMIs” with fetch on boot(Take N’ Bake) AMIs with JeOS and “Chef” Agent (Made to Order)More ControlEasier to maintain
28. 4. Build Security in every layerDesign with Security in mindWith cloud, you lose a little bit of physical control but not your ownershipCreate distinct Security Groups for each Amazon EC2 clusterUse group-based rules for controlling access between layersRestrict external access to specific IP rangesEncrypt data “at-rest” in Amazon S3Encrypt data “in-transit” (SSL)Consider encrypted file systems in EC2 for sensitive dataRotate your AWS Credentials, Pass in as arguments encrypted Use MultiFactor Authentication
29. 5. Don't fear constraintsRe-think architectural constraintsMore RAM? Distribute load across machinesShared distributed cacheBetter IOPS on my database? Multiple read-only / sharding / DB clusteringHardware Config does not match?Implement ElasticityYour hardware failed or messed up config?simply throw it away and switch to new hardware with no additional costPerformanceCaching at different levels (Page, Render, DB)
30. 6. Think ParallelSerial and Sequential is now historyExperiment different architectures in parallelMulti-treading and Concurrent requests to cloud servicesRun parallel MapReduce JobsUse Elastic Load Balancing to distribute load across multiple servers Decompose a Job into its simplest form
31. 6. Leverage many storage optionsOne size DOES NOT fit allAmazon S3: large static objectsAmazon Cloudfront: content distributionAmazon SimpleDB: simple data indexing/queryingAmazon EC2 local disc drive : transient dataAmazon EBS: persistent storage for any RDBMS + Snapshots on S3Amazon RDS: RDBMS service - Automated and Managed MySQL
32. 6. Leverage many storage optionsWhich storage option to use when?
33. Cloud Architecture LessonsBest Practices1. Design for failure and nothing fails2. Loose coupling sets you free3. Implement Elasticity4. Build Security in every layer5. Don't fear constraints6. Think Parallel7. Leverage many storage options
34. AWS community and EcosystemFind help, guidance, assistance when you need itAWS EcosystemAWS Community
36. Migrating your Web ApplicationStep by Step towards AWSA typical Web App needs:Compute PowerStorage capacityContent DistributionDatabase storageMessagingLoad balancingMonitoring
37. Migrating your Web Application - 1/8Typical Web App ArchitectureDatabaseApplication Server /Business LogicWeb Server /Presentation LayerClient Browser
38. Migrating your Web Application - 2/8Amazon S3 for StorageStore persistent files in Amazon S3 for lower costs, higher reliabilityClient Browser
39. Migrating your Web Application - 3/8Use Amazon CloudFrontAmazon CloudFront for distributionAmazon CloudFrontis a content delivery network that caches data stored in Amazon S3 across a network of 14 edge locations around the worldClient Browser
40. Migrating your Web Application - 4/8Amazon EC2 for your choice of web serversConfigure Amazon EC2 running your choice of web server to handle all incoming web requests.Client Browser
41. Migrating your Web Application - 4/8Scale out App servers on Amazon EC2Configure multiple Amazon EC2 instances running your choice of application server to process requests.Use Availability Zones and Elastic IPs for greater reliability and resiliency.Utilize Auto-scaling and Elastic LB serviceClient Browser
42. Migrating your Web Application - 5/8Use Amazon EBS for DatabaseEBS for Persistent Storage and S3 for SnapshotsConfigure an Amazon EBS device to host your existing relational database. Snapshots can be automatically backed up to Amazon S3.Client Browser
43. Migrating your Web Application - 6/8Use Amazon SQSAmazon SQS for queuing requestsSQSAmazon SQS makes it easy to coordinate between the web server and application servers.Client Browser
44. Migrating your Web Application - 7/8Use Amazon SimpleDBAmazon SimpleDB for log files, metadataSimpleDBSQSAmazon SimpleDBcan be used to store metadata, logfiles, and other information for your site.Client Browser
45. Migrating your Web Application - 8/8Use Amazon SimpleDBMonitor your Amazon EC2 instances using CloudWatchSimpleDBSQSAmazon CloudWatch to monitoring your Amazon EC2 instancesClient Browser
46. Migrating your Web ApplicationStep by Step towards AWSA typical Web App needs:With AWS:Compute PowerStorage capacityContent DistributionDatabase storageMessagingLoad balancingMonitoringAmazon EC2Amazon S3Amazon CloudFrontAmazon EBSAmazon SQSAmazon EC2Amazon CloudWatch
47. Amazon Web Services toolsThings you needWeb : AWS Management ConsoleIDE : AWS Toolkit for EclipseAWS SDK: .NET SDK, Java SDKTools : 3rd Party tools eg. CAFirefox Plugins : ElasticFox, S3Fox, SDB ToolSeveral libraries:
48. Identify the right candidateWhiteboard DiagramDashboardReportWebSearchDBlogsServiceLDAPAuthCRMEngineOLAPERPList all your IT assetsWhiteboard your IT Assets Identify upward and downward dependencies
49. Identify the right candidatePick one application with lower dependencies to start withIdentify the right candidate for the cloudDashboardCRMSearchDBReportCRMSearchDBlogsServiceLDAPAuthWebEngineOLAPERPSearch for under-utilized IT assetsApplications that has immediate business need to scaleApplications that are running out of capacityLow-hanging fruits (Examples):Web ApplicationsBatch Processing systemsBuild/QA/Test systemsContent Management SystemsDigital Asset Management Systems
50. Identify the right candidateIdentify the right candidate for the cloudDashboardWebSearchDBReportWebSearchDBlogsServiceLDAPAuthCRMEngineOLAPERP
51. ConclusionsMost Important Lesson From Our Customers:Start small with a well-defined proof of concept Experiment with different architectures; Keep one, throw away othersBuild Support and Awareness within your organizationOnce one application is launched others will follow…Photo: Grand Canyon Hopi Point SunSet
52. The day is not too far when applications will cease to be aware of physical hardware. Much like plugging in a microwave in order to power it doesn’t require any knowledge of electricity, one should be able to plug in an application to the cloud in order to receive the power it needs to run, just like a utility. As an architect, you will manage abstract compute, storage and network resources instead of physical servers. Applications will continue to function even if the underlying physical hardware fails or is removed or replaced. Applications will adapt themselves to fluctuating demand patterns by deploying resources instantaneously and automatically, thereby achieving highest utilization levels at all times. Scalability, Security, High availability, Fault-tolerance, Testability and Elasticity will be configurable properties of the application architecture and will be an automated and intrinsic part of the platform on which they are built.The day is not too far….Scalability, Security, High availability, Fault-tolerance, Testability and Elasticity will be configurable properties of the application architecture and will be an automated and intrinsic part of the platform on which they are built.
This is your classic three tier architecture. Incoming requests are fielded by a web server. The web server probably also draws files (such as images, PDFs, music, and so forth) from a file server. The web server farms processing out to a number of servers running an application server. This is where the bulk of your application’s business logic probably resides. You probably maintain a relational database on the back-end as well.
Let’s start our migration project by moving many of our static and large files over to Amazon S3. Things like images, music, PDFs, and the like are best suited for Amazon S3. Amazon S3 provides a low-cost, highly reliable and scalable storage environment for your web applications.
Many times you’ll have a number of users hitting your web application from all over the world. It can be time consuming and slow to serve all of those users’ requests from Amazon S3. That’s why we built Amazon CloudFront. Amazon CloudFront is a content delivery network that takes the data you’ve stored in Amazon S3 and caches it across a worldwide network of edge locations. In this way, the large static files used by your web application are stored as close as possible to the users who are requesting them.
Amazon EC2 enables you to choose the operating system and application platform of your choice to host your web application. Whether it’s Microsoft .NET, IBM WebSphere, JBoss, Oracle Fusion Middleware, PHP, Ruby on Rails, or whatever, you can configure your own virtual environment to run the platform you need for your business. This is where you’ll move your web application, altering it to point to the persistent files you’ve moved to Amazon S3.
A typical web application has a front-end web server to field incoming requests, which then farms out work to a bunch of application servers. You can move these applications ervers to Amazon EC2 as well.
You’ll also want to move your database into the cloud. Amazon Elastic Block Store is a feature of Amazon EC2 that provides a block storage device in the cloud. You’d house your database in Amazon EBS. Amazon EBS can also be setup to periodically snapshot backup images into Amazon S3, so you can always roll back to a version of Amazon EBS if you need to, and you can rest assured that your database will exhibit the same resilient and reliable characteristics as the rest of AWS.
Amazon SQS is a queueing service that provides the glue between your web server and your application server. The most common setup will involve configuring two queues. The first queue will accept messages from the web server hosted on Amazon EC2. Application servers, also hosted on Amazon EC2, will pluck those messages off the queue, process data based on the contents of the message, and then place the equivalent of an “I’m done! Here are the results.” message on the second queue. The web server would then pluck the message off the second queue and return results back to the client that made the initial request. In this way, your Amazon EC2 instances can grow or shrink, startup and fail with impunity, while you can rest assured that all of your data processing happens reliably.
Amazon SimpleDB can be added to the equation to store your access logs, application logfiles, and even indices to data you’re storing in Amazon S3.
Amazon SimpleDB can be added to the equation to store your access logs, application logfiles, and even indices to data you’re storing in Amazon S3.
The day is not too far when applications will cease to be aware of physical hardware. Much like plugging in a microwave in order to power it doesn’t require any knowledge of electricity, one should be able to plug in an application to the cloud in order to receive the power it needs to run, just like a utility. As an architect, you will manage abstract compute, storage and network resources instead of physical servers. Applications will continue to function even if the underlying physical hardware fails or is removed or replaced. Applications will adapt themselves to fluctuating demand patterns by deploying resources instantaneously and automatically, thereby achieving highest utilization levels at all times. Scalability, Security, High availability, Fault-tolerance, Testability and Elasticity will be configurable properties of the application architecture and will be an automated and intrinsic part of the platform on which they are built.However, we are not there yet. Today, you can build applications in the cloud with some of these qualities by implementing the best practices highlighted in the paper. Best practices in cloud computing architectures will continue to evolve and as researchers, we should focus not only on enhancing the cloud but also on building tools, technologies and processes that will make it easier for developers and architects to plug in applications to the cloud easily.