scala – sbt – 对象apache不是包org的成员
发布时间:2020-12-16 08:46:23 所属栏目:安全 来源:网络整理
导读:我想使用sbt部署并提交一个spark程序,但是它的抛出错误. 码: package in.goai.sparkimport org.apache.spark.{SparkContext,SparkConf}object SparkMeApp { def main(args: Array[String]) { val conf = new SparkConf().setAppName("First Spark") val sc
我想使用sbt部署并提交一个spark程序,但是它的抛出错误.
码: package in.goai.spark import org.apache.spark.{SparkContext,SparkConf} object SparkMeApp { def main(args: Array[String]) { val conf = new SparkConf().setAppName("First Spark") val sc = new SparkContext(conf) val fileName = args(0) val lines = sc.textFile(fileName).cache val c = lines.count println(s"There are $c lines in $fileName") } } build.sbt name := "First Spark" version := "1.0" organization := "in.goai" scalaVersion := "2.11.8" libraryDependencies += "org.apache.spark" %% "spark-core" % "1.6.1" resolvers += Resolver.mavenLocal 在第一个/项目目录下 build.properties bt.version=0.13.9 当我试图运行sbt包时,它的抛出错误如下所示. [root@hadoop first]# sbt package [info] Loading project definition from /home/training/workspace_spark/first/project [info] Set current project to First Spark (in build file:/home/training/workspace_spark/first/) [info] Compiling 1 Scala source to /home/training/workspace_spark/first/target/scala-2.11/classes... [error] /home/training/workspace_spark/first/src/main/scala/LineCount.scala:3: object apache is not a member of package org [error] import org.apache.spark.{SparkContext,SparkConf} [error] ^ [error] /home/training/workspace_spark/first/src/main/scala/LineCount.scala:9: not found: type SparkConf [error] val conf = new SparkConf().setAppName("First Spark") [error] ^ [error] /home/training/workspace_spark/first/src/main/scala/LineCount.scala:11: not found: type SparkContext [error] val sc = new SparkContext(conf) [error] ^ [error] three errors found [error] (compile:compile) Compilation failed [error] Total time: 4 s,completed May 10,2018 4:05:10 PM 我试过延伸到App也没有改变. 解决方法
请从build.sbt中删除resolvers = Resolver.mavenLocal.由于在Maven上可以使用spark-core,因此我们不需要使用本地解析器.
之后,你可以试试sbt clean package. (编辑:李大同) 【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容! |