hadoop: limit number of concurrent map / reduce tasks per job -


I want to submit a research work to a production cluster. As I do not need this job to finish quickly, and I do not want to delay production jobs, I want to limit the number of tasks that are executing for that job at any time. Can I do this in Hadoop 2?

To limit resources to Hadoop (reducing mappings / slots) proper scheduler can be used, you can create a new mailbiller pool by setting the maximum number of better mappers and the maximum reducer and job can be deposited in that newly built Meleshadular pool.

Comments

Popular posts from this blog

Java - Error: no suitable method found for add(int, java.lang.String) -

c# - passing input text from view to contoller with FacebookContext using Facebook app -

Calling a C++ function from C# by passing a string with variable size to it -