Did you know, in the year 2000, the company Blockbuster LLC had an opportunity to buy Netflix for a mere $50 million? But in 2016, Netflix made a come back and accumulated $8.83 billion in revenue. One would wonder how come a company which was worth $50 million in 2000 is now worth around $87 billion. A layman would guess that the company had a continual impressive growth over 17 years straight. But the fact is that within this time period, in the 2008, Netflix was a victim of a major database corruption.
Netflix’s Stupendous Migration to AWS
Back in 2008, Netflix was majorly working on DVD-by-mail service. Due to the above mentioned database corruption incident, DVD shipping was disrupted for three days. Netflix management decided to move to the cloud, away from relational systems in their data centers. The shift happened from vertical scaling of particular failure points to horizontal scaling of distributed systems which were highly reliable.
The cloud was that of AWS (Amazon Web Services) which offered the company the ability to scale as much as they needed. Previously, Netflix team had to sit with their IT team to implement the scale up whenever their demand increased. Scalability was a huge issue with physical data warehousing. After shifting to AWS, scaling became seamless as petabytes of data could be used to stream videos within minutes, thanks to elasticity of the cloud. Based on user demand and with the help of AWS, Netflix could scale-up or down their data warehousing.
Watch this AWS Tutorial For Beginners Tutorial
Who is a DevOps Engineer?
Netflix itself admitted that it would have been extremely difficult to scale so much on its own data centers. It was in the process of shifting its huge streaming operations to AWS for all these years. In early January 2016, Netflix shut down its last data center which was used by their streaming service. Now, there are eight times more users for Netflix as compared to those present in 2008. This represents the phenomenal growth of Netflix over the years.
The company currently streams about 150,000,000 hours of video content per day. It serves around 86,000,000 members from 190 countries across the world. Have a look at how video is delivered to users by Netflix: It is through Open Connect. It is Netflix’s own Content Delivery Network (CDN) which it manages through Amazon. Videos that stream to a user are located in data centers within the networks of Internet service providers, facilities where traffic is exchanged among most of the network operators.
The traffic is distributed directly to Verizon, AT&T, Comcast, and similar network operators at such exchange points. When a user presses ‘play’ button, from these sites, videos get delivered to him.
Get 100% Hike!
Master Most in Demand Skills Now!
Before a video gets delivered to him, operations like searching for videos and signing up by the user for the service are all handled in AWS cloud. Hence, the business logic, personalization, search, and data processing which gives the streaming experience are all live in AWS. The technology had to maintain Netflix’s employees who were working in streaming business, and this was also housed in Amazon.
Do you know why Netflix took seven years to shift to Amazon? They rebuilt their entire software platform to leverage AWS cloud network to the maximum. ‘Chaos Monkey’ is a series of tools developed by Netflix to reduce damage in the case of disruptions. On the Christmas Eve of 2012, the company suffered a streaming failure and at the time it was on a single Amazon region. Since then, they have invested heavily in disaster recovery. Now, Netflix mainly operates in Oregon, Northern Virginia, and Dublin regions. What if one of these regions goes down? In this case, Netflix redirects the traffic to other available regions within a moment’s notice. The company has enough backups of all data which is stored in Amazon itself.
The distributed database, Cassandra is chosen to store customer data where every data element is replicated many times in production. The primary backups of all data are generated into S3 (Simple Storage Service). Any kind of operator errors, logical errors, software bugs, or other such corruptions can be dealt with by the S3 backups. ‘Armageddon Monkey’ is Netflix’s attempt to recover from failures of all its systems on AWS.
Conclusion
Today, Netflix is the 10th largest Internet company in the world. Are you aware that during the peak traffic hours more than one-third of North American Internet traffic goes through Netflix’s systems? ‘Supporting such rapid growth would have been extremely difficult out of our own data centers; we simply could not have racked the servers fast enough,’ Netflix’s blog post says.
It continues, ‘Elasticity of the cloud allows us to add thousands of virtual servers and petabytes of storage within minutes, making such an expansion possible.’ So, that is the power of Amazon Web Services propelling one of the most ambitious companies on earth, Netflix, into uncharted territory and runaway success!