Algorithmic Thinking: (Question) Data Structures in this age of data

[San Raj]

Thanks for taking time to discuss the subject. I am refreshing algorithms after quite some years. And nice to know of a book that would help.

1. One curious question I have is, how much has data structures and more importantly its usage changed in this age of information overload? Have you observed a shift in usage of a particular(few) data structure that wasn’t popular in early 2000’s but now it is to handle the larger volume?

2. Has the algorithms changed to address the information abundance, or is it something like algorithms haven’t changed much but aided/boosted by technology?

Thanks!

[Daniel Zingaro]

Hi San,

Interesting questions! You might want a Big Data book after Algorithmic Thinking

1. I think it's more important than ever that we get our algorithms and data structures right. Computers are faster than in the early 2000s, but data has exploded relative to that speed increase. If we have any hope of processing gigs and gigs of data then we need to take time to make sure we're doing so as efficiently as possible.

2. The core of algorithms hasn't changed, but I think what programmers need these days has. I think more programmers need the formerly "specialized"/"advanced" techniques these days.

Your post made me start thinking of whether my book would be any different had I written it ten years ago. Maybe segment trees wouldn't have been in there. And the challenge level of problems may have been lower -- we keep pushing the envelope on the problems we solve, that's for sure!

Thank you,
Dan

[San Raj]

Thank you, Dan.

Your reply guides me towards right direction, big data book to help after reading data structures. Also specialized role for data processing..

I will take a look at segment trees to know how it is helpful and used now.

Thanks!