• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • Bear Bibeault
  • Liutauras Vilda
Sheriffs:
  • Jeanne Boyarsky
  • Junilu Lacar
  • Henry Wong
Saloon Keepers:
  • Tim Moores
  • Stephan van Hulst
  • Jj Roberts
  • Tim Holloway
  • Piet Souris
Bartenders:
  • Himai Minh
  • Carey Brown
  • salvin francis

Is it feasible to constantly scale in cases when NoSql dbs receive petabytes of data daily realtime?

 
Ranch Foreman
Posts: 2060
12
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
NoSql databases handle large voiumes of data and are schemaless. In cases when realtime data is received and say petabytes of data is received daily then the capacity will soon become full unless we scale. So in that case it will keep receiving such data daily then it would regularly require scaling from time to time. Is that feasible to keep doing that ? thanks.
 
Marshal
Posts: 71047
291
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Monica Shiralkar wrote:. . . petabytes of data . . . daily . . .

Have you worked out how much that is per second?
 
Marshal
Posts: 3257
487
Android Eclipse IDE TypeScript Redhat MicroProfile Quarkus Java Linux
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Monica Shiralkar wrote:... petabytes of data is received daily


Just a quick reference point: 1PB of storage on Amazon S3 (not including PUT/GET costs) in the US West region would cost $45,166.48 per month.
 
Monica Shiralkar
Ranch Foreman
Posts: 2060
12
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Campbell Ritchie wrote:

Monica Shiralkar wrote:. . . petabytes of data . . . daily . . .

Have you worked out how much that is per second?



Oh yes petabytes of data is too much to talk about. Even the data twitter receives in a day is around 11 TB and not petabytes a day.

Let me talk about a more realistic case say if an application receives say 10 GB of data per day, and this is saved in a NoSql database. With this much data coming the db per day, the capacity will soon become full unless we scale. So in that case it would regularly require scaling from time to time. Is that feasible to keep doing that ? thanks.
 
Then YOU must do the pig's work! Read this tiny ad. READ IT!
Building a Better World in your Backyard by Paul Wheaton and Shawn Klassen-Koop
https://coderanch.com/wiki/718759/books/Building-World-Backyard-Paul-Wheaton
reply
    Bookmark Topic Watch Topic
  • New Topic