0


hadoop之JobHistoryServer无法启动的解决方案

最重要的一点就是大家一定要学会看日志,因为我们得报错信息就在日志里面,就算你的问题和我的不一样但是你看日志就一定能看出问题得所在,强调一句用hadoop得话jdk环境最好配8或者11,一定不要用18,问题太多会报空指针异常

这里我们首先打开我们的目录 /opt/module/hadoop-3.1.3/logs ,logs前面的目录看自己安装路径即可,用xftp打开然后查看时间最近的一个日志文件,拉到最下面因为一般的错误信息都在最下面,或者在中间都有可能,你找到之后看它的问题,这是我当时启动的问题:

2022-10-28 08:01:21,072 INFO org.apache.hadoop.service.AbstractService: Service HistoryClientService failed in state STOPPED
org.apache.hadoop.yarn.webapp.WebAppException: java.lang.NullPointerException: guiceFilter
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:102)
    at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService.serviceStop(HistoryClientService.java:179)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
    at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
    at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceStop(JobHistoryServer.java:206)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
    at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.NullPointerException: guiceFilter
    at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:895)
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:99)
    ... 17 more
2022-10-28 08:01:21,073 WARN org.apache.hadoop.service.CompositeService: When stopping the service HistoryClientService
org.apache.hadoop.yarn.webapp.WebAppException: java.lang.NullPointerException: guiceFilter
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:102)
    at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService.serviceStop(HistoryClientService.java:179)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
    at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
    at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceStop(JobHistoryServer.java:206)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
    at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.NullPointerException: guiceFilter
    at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:895)
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:99)
    ... 17 more
2022-10-28 08:01:21,073 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Stopping JobHistory
2022-10-28 08:01:21,073 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Stopping History Cleaner/Move To Done
2022-10-28 08:01:21,074 ERROR org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
2022-10-28 08:01:21,076 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer failed in state STOPPED
org.apache.hadoop.yarn.webapp.WebAppException: java.lang.NullPointerException: guiceFilter
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:102)
    at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService.serviceStop(HistoryClientService.java:179)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
    at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
    at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceStop(JobHistoryServer.java:206)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
    at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.NullPointerException: guiceFilter
    at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:895)
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:99)
    ... 17 more
2022-10-28 08:01:21,077 WARN org.apache.hadoop.service.AbstractService: When stopping the service org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer
org.apache.hadoop.yarn.webapp.WebAppException: java.lang.NullPointerException: guiceFilter
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:102)
    at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService.serviceStop(HistoryClientService.java:179)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:158)
    at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:132)
    at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceStop(JobHistoryServer.java:206)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:220)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:54)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:102)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:67)
    at org.apache.hadoop.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:184)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
    at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.NullPointerException: guiceFilter
    at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:895)
    at org.apache.hadoop.yarn.webapp.WebApp.stop(WebApp.java:99)
    ... 17 more
2022-10-28 08:01:21,081 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG: 

看完这些问题后,我继续网上翻阅出现了下面这段话,显示我的jdk版本是18的,版本冲突了,导致service编译通过(因为有jdk),然后运行失败(版本不兼容),但在次之前我是已经将java的jdk版本改到了8但是我的机子里面确实还装了一个jdk18版本,并且两个都是全局生效export

然后解决办法就是将jdk版本改回来即可

第一步:检查我们的java安装路径,然后我这里显示的是8版本的

[root@hadoop102 ~]# which java
/opt/module/jdk1.8.0_212/bin/java

第二步:检查我们的全局jdk路径,然后发现是18版本的

[root@hadoop102 ~]# echo $JAVA_HOME
/usr/local/java/jdk-18.0.2.1

第三步:确认好了之后我们编辑我们的全局声明 etc/profile

[root@hadoop102 ~]# vim /etc/profile

第四步:将里面的export后面的JAVA_HOME后面的路径改为我们的8即可,wq保存退出

第五步:我们用xsync将profile布置到其他两台hadoop上面,并且用source让命令生效(三台hadoop都要生效即可)

[root@hadoop102 ~]# xsync /etc/profile
[root@hadoop102 ~]# source /etc/profile

第六步:然后我们输入mapred --daemon start historyserver启动server

[root@hadoop102 ~]# mapred --daemon start historyserver

** 第七步:看到这个说明我们启动成功了,完美结束**

标签: hadoop 大数据 java

本文转载自: https://blog.csdn.net/qq_59002046/article/details/127564566
版权归原作者 算法永无止境 所有, 如有侵权,请联系我们删除。

“hadoop之JobHistoryServer无法启动的解决方案”的评论:

还没有评论