spark: ERROR Shell: Failed to locate the winutils binary in the hadoop binary path

Myth丶恋晨 2022-09-26 03:49 107阅读 0赞

一、问题

下载spark-2.0.0-bin-hadoop2.7.tgz 后,在C:\spark\bin 运行spark-shell.cmd 时, 报错

  1. ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
  2. java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
  3. at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:318)
  4. at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:333)
  5. at org.apache.hadoop.util.Shell.<clinit>(Shell.java:326)
  6. at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:76)

二、解决办法

  1. 下载 winutils.exe 放到 c:\hadoop\bin
  1. 设置环境变量

HADOOP_HOME=c:\hadoop

PATH=%HADOOP_HOME%\bin

  1. 在C:\spark\bin 右键 以管理员运行 spark-shell.cmd

发表评论

表情:
评论列表 (有 0 条评论,107人围观)

还没有评论,来说两句吧...

相关阅读