• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Bear Bibeault
  • Devaka Cooray
  • Liutauras Vilda
  • Jeanne Boyarsky
Sheriffs:
  • Knute Snortum
  • Junilu Lacar
  • paul wheaton
Saloon Keepers:
  • Ganesh Patekar
  • Frits Walraven
  • Tim Moores
  • Ron McLeod
  • Carey Brown
Bartenders:
  • Stephan van Hulst
  • salvin francis
  • Tim Holloway

Using big data on websites?  RSS feed

 
Greenhorn
Posts: 9
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Heya.

Not sure if this is the correct thread. Could also have placed it in data thread. But since the webappications are run by html, CSS, javascript, I though it would be fitting here too.

I study interaction design. But I've been practicing a lot web development (front-end).

So, I want to know more about data science, how I can use it for my own web applications.

So far I've googled a lot of stuff and asked around, but answers seem to be hard to get on this topic. I've asked around for data science on my study, but I was told to first get good at either R or Python before attending. I've asked on Reddit, but there they're of opinion that data science isn't valuable as a webdeveloper. Which I find very weird, because other sources showed big data can have over 300% conversion rate (marketing term). There's also a lot of companies already collecting data for you! You just gotta pay them 1000$ a year for it. Even though big data is open source. Someone else told me big data is a like a big icecream machine, where you can mix different flavors. You either come with a great new flavor, or a nasty one.

So yes. Is there anyone here who knows more about this topic? Because so far I'm quite in the dark. I don't even know what to google for. I've seen stuff like hadoop, but not its use in context of a website.
 
Saloon Keeper
Posts: 5048
135
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

they're of opinion that data science isn't valuable as a webdeveloper


In so far as "web developer" means a person who creates the web frontend for some application, that would be correct. But the web site may be -at least partially- driven by data, and big data methods. The person in charge of that need not be a web developer (and in most organizations probably isn't).

other sources showed big data can have over 300% conversion rate (marketing term)


Let's be clear about terminology: Big data analysis may inform changes that lead to improvements in conversion rate. But big data itself does not have a conversion rate.

Even though big data is open source.


I don't know where to begin with this statement. Much of the data we're talking about when talking about "big data" is not, in fact, open source, because it's generated inside companies. There are certainly freely available data set that could be characterized as big data, often from government sources.
 
dario sanchez
Greenhorn
Posts: 9
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

In so far as "web developer" means a person who creates the web frontend for some application, that would be correct. But the web site may be -at least partially- driven by data, and big data methods. The person in charge of that need not be a web developer (and in most organizations probably isn't).



Who would be though? I doubt a lot of companies regular companies will actually hire someone especially for that job.

I don't know where to begin with this statement. Much of the data we're talking about when talking about "big data" is not, in fact, open source, because it's generated inside companies. There are certainly freely available data set that could be characterized as big data, often from government sources.



But isn't the problem about big data it's way to massive to be stored in a regular database? Thus therefore, anyone who has the ability to know how to access that raw data can. (Though, turning that data into information might be the problem).  2.5 quintillion bytes of data is created daily, isn't that wat too much to just store somewhere?
 
Tim Moores
Saloon Keeper
Posts: 5048
135
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

I doubt a lot of companies regular companies will actually hire someone especially for that job.


I'm fairly sure they will. In a company large enough to handle big data problems it's highly unlikely that the same person will handle frontend web development and backend data analysis tasks and implementation, IMO.

But isn't the problem about big data it's way to massive to be stored in a regular database?


What is a "regular" database? Standard relational DB servers can store humongous amounts of data. But yes, there are specialized "big data" DB servers. But more importantly, what does the question of where data is stored have to do with whether it's open source? I feel like I'm missing something.

2.5 quintillion bytes of data is created daily


Where does that number come from? The data processing and storage operation at CERN are fairly well documented - they've been grappling with huge amounts of data for decades.
 
Marshal
Posts: 61777
193
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Junaith Petersen wrote:In my opinion . . . .

Is that your opinion? Or have you copied that text from other websites? Always tell us where such quotes come from.
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!