Number of Reducers

Ranch Hand

Posts: 119

posted 11 years ago

Number of slices to send:

Optional 'thank-you' note:

Send

Are there any limits to number of Reducers in Hadoop? and what are the best practice to design the mappers and reducers in Hadoop environments?

Regards,
Mohamed

Best Regards, Mohamed El-Refaey
www.egyptcloudforum.com

Arun Vasu

Greenhorn

Posts: 24

I like...

posted 11 years ago

Number of slices to send:

Optional 'thank-you' note:

Send

The best practise is to keep the number of redulers slightly less than the number of available reduce slots in your cluster.
Get more info from Hadoop wiki

Mohamed El-Refaey

Ranch Hand

Posts: 119

posted 11 years ago

Number of slices to send:

Optional 'thank-you' note:

Send

Arun Vasu wrote:The best practise is to keep the number of redulers slightly less than the number of available reduce slots in your cluster.
Get more info from Hadoop wiki

Thanks Arun, I got it!

Best Regards, Mohamed El-Refaey
www.egyptcloudforum.com

Once upon a time there were three bears. And they were visted by a golden haired tiny ad:

a bit of art, as a gift, the permaculture playing cards

https://gardener-gift.com