spark 提交jar包到集群运行报异常 java.net.UnknownHostException: mycluster

    xiaoxiao2025-12-30  8

    已解决:

    1.复制hdfs-site.xml到spark的配置目录

    2.复制core-site.xml到spark的配置目录

    3.修改spark的配置文件spark-defaults.conf

    加上:

    spark.files   file:///opt/cluster/spark-1.6.1-bin-hadoop2.4/conf/hdfs-site.xml,file:///opt/cluster/spark-1.6.1-bin-hadoop2.4/conf/core-site.xml 配置即可

    转载请注明原文地址: https://ju.6miu.com/read-1305479.html
    最新回复(0)