Skip to content Skip to sidebar Skip to footer
Showing posts with the label Mapreduce

Should I Learn/use Mapreduce, Or Some Other Type Of Parallelization For This Task?

After talking with a friend of mine from Google, I'd like to implement some kind of Job/Worker … Read more Should I Learn/use Mapreduce, Or Some Other Type Of Parallelization For This Task?

Running A Job Using Hadoop Streaming And Mrjob: Pipemapred.waitoutputthreads(): Subprocess Failed With Code 1

Hey I'm fairly new to the world of Big Data. I came across this tutorial on http://musicmachin… Read more Running A Job Using Hadoop Streaming And Mrjob: Pipemapred.waitoutputthreads(): Subprocess Failed With Code 1

Hadoop-streaming : Reduce Task In Pending State Says "no Room For Reduce Task."

My map task completes successfully and I can see the application logs, but reducer stays in pending… Read more Hadoop-streaming : Reduce Task In Pending State Says "no Room For Reduce Task."

Python Udfs In Pig

I've seen the documentatio here, but I confess that I feel it rather lacking. I was wondering … Read more Python Udfs In Pig