• Post Reply Bookmark Topic Watch Topic
  • New Topic

MapReduce fail for more than 3 nodes

 
Filip Zivanovic
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi,
I have a really annoying problem. My Hadoop system works perfectly for 2 or 3 nodes (slaves). But when I rise a number of slaves on 4, or 5, Reduce job freezes on 16%.
Did anyone had a similar problem? Or does anyone maybe know where can be a solution of my problem, in nodes communication, or in Hadoop configuration?
Thanks in advance
Filip
 
Rajit kumar
Greenhorn
Posts: 13
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Make sure all data that you copied to hdfs proper or try cleanup data that was copied to hdfs before and upload it again. This could be data issue or might have reached max thresold.
 
Rajesh Nagaraju
Ranch Hand
Posts: 63
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
This could be data issue or might have reached max thresold.


Can you please elaborate on the max threshold?

Thanks and Regards
Rajesh Nagaraju
 
Happiness is not a goal ... it's a by-product of a life well lived - Eleanor Roosevelt. Tiny ad:
the new thread boost feature: great for the advertiser and smooth for the coderanch user
https://coderanch.com/t/674455/Thread-Boost-feature
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!