• asjmcguire@kbin.social
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    Reddit has been going for like a billion years, and you only got 80GB - I mean even zipped, that can’t even be a fraction of the data surely?

    • ddnomad@infosec.pub
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      1 year ago

      Depends on what kind of data, if it’s mostly internal documents / dumps of whatever communication systems they use etc, it would not be too large (mostly because of retention policies on that software).

      If it is actually the data straight from Reddit’s production databases, then 80GB does sound questionable. But then what kind of data are we talking about? Is it actually valuable?

      Anyways, this is big (if true).

    • Trebach@kbin.social
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      I could get 80 GB of Reddit data in a day. ArchiveTeam has uploaded 2.97 PB (1PB is 1024 TB or 1048576 GB) so far trying to back up all of Reddit to the Internet Archive and they’re still not finished!