YouTube stores 357 Petabytes. Instagram is storing 20BN files... others? - PandaWhale
Sign up FAST! Login
Home Profile Create Page

YouTube stores 357 Petabytes. Instagram is storing 20BN files... others?

Mo Data stashed this in Big Data


How much data does X store? https://techexpectations.org/2014/05/17/how-much-data-does-x-store/ 

Being in the tech infrastructure industry, I often get the question, “How big is that service?” or “How much does x store?”

Here is where I will keep track. (updated 5/18/14)

Some interesting tidbits:

  • The NSA is building a facility that will be able to store at least an estimated 2 exabytes
  • EMC claims to have built a single storage system of 880 petabytes - a bit of a mystery named Project Beatle
  • I estimate that Youtube will surpass 400 petabytes of storage this year

Here's what is posted right now:

NSA stores 2000 Petabytes

Beatle Storage Cloud stores 880 Petabytes

Youtube stores 357 Petabytes

Facebook (photos & videos) stores 282 Petabytes

Facebook (data warehouse) stores 250 Petabytes

CERN stores 200 Petabytes

Outlook.com (fka Hotmail) stores 150 Petabytes

Microsoft Azure Storage stores  Petabytes

Amazon Web Services S3 stores  Petabytes

Backblaze stores 100 Petabytes

Mozy stores 90 Petabytes

Shutterfly stores 80 Petabytes

Titan Supercomputer stores 40 Petabytes

Instagram stores  Petabytes

Internet Archives stores 10 Petabytes

Go here for latest: https://techexpectations.org/2014/05/17/how-much-data-does-x-store/

Mo Data
9:54 AM May 24 2014
Post Title (optional):

19

Stashed in: Facebook!, Instagram!, Amazon Web Services, Microsoft, YouTube!, Storage!

To save this post, select a stash from drop-down menu or type in a new one:

Holy smokes that is a LOT of storage.

Internet Archive is relatively tiny!

What is the Beatle storage cloud?

Any idea for Dropbox and Box?

Adam Rifkin
9:57 AM May 24 2014
1
Post Title (optional):

Want to see the “behind the scenes” of one of the world’s largest cloud-scale Object Stores?  How big is big?   think 300,000 spindles.   Think of 1,000,000,000 events daily.   Think of 1,000,000,000,000,000,000 bytes of data (1 EB).   This, BTW – is a pure SDS solution on commodity hardware – and while we won’t name the customer, I would wager thatmany of us touch it every day without even knowing.  BTW – while you see Atmos in the construction phases in the video, note that in the end, it’s running on COTS hardware 

https://youtu.be/0SJogNlMjZ0 

Mo Data
11:51 AM May 24 2014
1
Post Title (optional):

Holy smokes that is HUGE. 

Without the YouTube videos, how big is Google's index of the a Web now?

Adam Rifkin
2:24 PM May 24 2014
0
Post Title (optional):

  • Add image:
  • See Allowed Markup

    We allow the following HTML tags to be used in comments:

    Links
    <a href="http://example.com">Click this link!</a>
    Images
    <img src="http://example.com/photo.jpg" />
    Video
    You can embed <iframe> videos from YouTube and Vimeo.
    Video URLs also "just work" (e.g., http://www.youtube.com/watch?v=oHg5SJYRHA0)
    Formatting
    • strong (<strong>)
    • bold (<b>)
    • emphasis (<em>)
    • italic (<i>)
    • strike (<strike>)
    • teletype (<tt>)
    • underline (<u>)
    • code (<code>)

    You may also use <pre>, <blockquote>, <ol>, <ul>, and <li> tags.

    OK
Enter search terms:
[cancel]

Nevermind

Error
  • Add image:
  • See Allowed Markup

    We allow the following HTML tags to be used in comments:

    Links
    <a href="http://example.com">Click this link!</a>
    Images
    <img src="http://example.com/photo.jpg" />
    Video
    You can embed <iframe> videos from YouTube and Vimeo.
    Video URLs also "just work" (e.g., http://www.youtube.com/watch?v=oHg5SJYRHA0)
    Formatting
    • strong (<strong>)
    • bold (<b>)
    • emphasis (<em>)
    • italic (<i>)
    • strike (<strike>)
    • teletype (<tt>)
    • underline (<u>)
    • code (<code>)

    You may also use <pre>, <blockquote>, <ol>, <ul>, and <li> tags.

    OK
Enter search terms:
[cancel]

Nevermind

Error

You May Also Like:

The Maturation of Mark Zuckerberg -- New York Magazine

Facebook Knows Everything About You, And If You Don't Believe Us Here's Proof from Ubisoft Watch Dogs Digital Shadow

Chromebooks Are Now 21% Of Notebooks And 10% Of All Computers And Tablets

Kutiman Thru You Too Give It Up edits clips of amateur musicians on YouTube together to make a song. The results are gorgeous.


Source:

Remove This Image Use This Image Nevermind

Source:

Remove This Image Use This Image Nevermind