spark用yarn提交任务会报
error cluster.yarnclientschedulerbackend: yarn application has exited unexpectedly with state undefined! check the yarn application logs for more details.
error cluster.yarnclientschedulerbackend: diagnostics message: shutdown hook called before final status was reported.
只需要将hadoop集群的yarn-site.xml配置中加入如下两行即可解决:
<property>
<name>yarn.nodemanager.pmem-check-enabled</name>
<value>false</value>
</property>
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>
如果你用的java8,则多会报此错误。
如对本文有疑问, 点击进行留言回复!!
去 HBase,Kylin on Parquet 性能表现如何?
如何找到Hive提交的SQL相对应的Yarn程序的applicationId
如何在 HBase Shell 命令行正常查看十六进制编码的中文?哈哈~
网友评论