标题: Hadoop的mapreduce无法正常工作？求助 [打印本页] 作者: lxmdmx 时间: 2017-7-11 10:14 标题: Hadoop的mapreduce无法正常工作？求助 hadoop jar hadoop-mapreduce-examples-2.7.3.jar wordcount /input /output
但运行时报错，大家帮忙看一看
17/07/10 22:09:10 INFO client.RMProxy: Connecting to ResourceManager at hadoop01/192.168.231.10:8032
17/07/10 22:09:11 INFO input.FileInputFormat: Total input paths to process : 1
17/07/10 22:09:12 INFO mapreduce.JobSubmitter: number of splits:1
17/07/10 22:09:12 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1499736091765_0003
17/07/10 22:09:12 INFO impl.YarnClientImpl: Submitted application application_1499736091765_0003
17/07/10 22:09:12 INFO mapreduce.Job: The url to track the job: http://hadoop01:8088/proxy/application_1499736091765_0003/
17/07/10 22:09:12 INFO mapreduce.Job: Running job: job_1499736091765_0003
17/07/10 22:09:20 INFO mapreduce.Job: Job job_1499736091765_0003 running in uber mode : false
17/07/10 22:09:20 INFO mapreduce.Job: map 0% reduce 0%
17/07/10 22:09:22 INFO mapreduce.Job: Task Id : attempt_1499736091765_0003_m_000000_0, Status : FAILED
Container launch failed for container_1499736091765_0003_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:375)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
17/07/10 22:09:24 INFO mapreduce.Job: Task Id : attempt_1499736091765_0003_m_000000_1, Status : FAILED
Container launch failed for container_1499736091765_0003_01_000003 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:375)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
17/07/10 22:09:26 INFO mapreduce.Job: Task Id : attempt_1499736091765_0003_m_000000_2, Status : FAILED
Container launch failed for container_1499736091765_0003_01_000004 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.instantiateException(SerializedExceptionPBImpl.java:168)
at org.apache.hadoop.yarn.api.records.impl.pb.SerializedExceptionPBImpl.deSerialize(SerializedExceptionPBImpl.java:106)
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$Container.launch(ContainerLauncherImpl.java:155)
at org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl$EventProcessor.run(ContainerLauncherImpl.java:375)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
17/07/10 22:09:30 INFO mapreduce.Job: map 100% reduce 100%
17/07/10 22:09:30 INFO mapreduce.Job: Job job_1499736091765_0003 failed with state FAILED due to: Task failed task_1499736091765_0003_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
17/07/10 22:09:31 INFO mapreduce.Job: Counters: 13
Job Counters
Failed map tasks=4
Killed reduce tasks=1
Launched map tasks=4
Other local map tasks=3
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=5
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=5
Total time spent by all reduce tasks (ms)=0
Total vcore-milliseconds taken by all map tasks=5
Total vcore-milliseconds taken by all reduce tasks=0
Total megabyte-milliseconds taken by all map tasks=5120
Total megabyte-milliseconds taken by all reduce tasks=0