用scala-eclipse作为火花
发布时间:2020-12-16 18:35:48 所属栏目:安全 来源:网络整理
导读:有些人可以请教我如何使用 scala– eclipse IDE来获得火花吗? 我遇到了这个链接 – http://syndeticlogic.net/?p=311.但我无法遵循它. 我输入命令–mvn -Phadoop2 eclipse:清理eclipse:在一长串下载后,我在spark目录里面的eclipse给了我一些错误.请帮忙.
有些人可以请教我如何使用
scala–
eclipse IDE来获得火花吗?
我遇到了这个链接 – http://syndeticlogic.net/?p=311.但我无法遵循它. 我输入命令–mvn -Phadoop2 eclipse:清理eclipse:在一长串下载后,我在spark目录里面的eclipse给了我一些错误.请帮忙.谢谢 以下是我收到的错误 Reactor Summary: [INFO] [INFO] Spark Project Parent POM .......................... SUCCESS [5:22.386s] [INFO] Spark Project Core ................................ SUCCESS [17:20.807s] [INFO] Spark Project Bagel ............................... FAILURE [2.159s] [INFO] Spark Project GraphX .............................. SKIPPED [INFO] Spark Project ML Library .......................... SKIPPED [INFO] Spark Project Streaming ........................... SKIPPED [INFO] Spark Project Tools ............................... SKIPPED [INFO] Spark Project Catalyst ............................ SKIPPED [INFO] Spark Project SQL ................................. SKIPPED [INFO] Spark Project Hive ................................ SKIPPED [INFO] Spark Project REPL ................................ SKIPPED [INFO] Spark Project Assembly ............................ SKIPPED [INFO] Spark Project External Twitter .................... SKIPPED [INFO] Spark Project External Kafka ...................... SKIPPED [INFO] Spark Project External Flume ...................... SKIPPED [INFO] Spark Project External ZeroMQ ..................... SKIPPED [INFO] Spark Project External MQTT ....................... SKIPPED [INFO] Spark Project Examples ............................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 25:15.115s [INFO] Finished at: Wed May 07 15:27:51 GMT+05:30 2014 [INFO] Final Memory: 22M/81M [INFO] ------------------------------------------------------------------------ [WARNING] The requested profile "hadoop2" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project spark-bagel_2.10: Failed to resolve dependencies for one or more projects in the reactor. Reason: Missing: [ERROR] ---------- [ERROR] 1) org.apache.spark:spark-core_2.10:jar:1.0.0-SNAPSHOT [ERROR] [ERROR] Try downloading the file manually from the project website. [ERROR] [ERROR] Then,install it using the command: [ERROR] mvn install:install-file -DgroupId=org.apache.spark -DartifactId=spark-core_2.10 -Dversion=1.0.0-SNAPSHOT -Dpackaging=jar -Dfile=/path/to/file [ERROR] [ERROR] Alternatively,if you host your own repository you can deploy the file there: [ERROR] mvn deploy:deploy-file -DgroupId=org.apache.spark -DartifactId=spark-core_2.10 -Dversion=1.0.0-SNAPSHOT -Dpackaging=jar -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id] [ERROR] [ERROR] Path to dependency: [ERROR] 1) org.apache.spark:spark-bagel_2.10:jar:1.0.0-SNAPSHOT [ERROR] 2) org.apache.spark:spark-core_2.10:jar:1.0.0-SNAPSHOT [ERROR] [ERROR] ---------- [ERROR] 1 required artifact is missing. [ERROR] [ERROR] for artifact: [ERROR] org.apache.spark:spark-bagel_2.10:jar:1.0.0-SNAPSHOT [ERROR] [ERROR] from the specified remote repositories: [ERROR] maven-repo (http://repo.maven.apache.org/maven2,releases=true,snapshots=false),[ERROR] apache-repo (https://repository.apache.org/content/repositories/releases,[ERROR] jboss-repo (https://repository.jboss.org/nexus/content/repositories/releases,[ERROR] mqtt-repo (https://repo.eclipse.org/content/repositories/paho-releases,[ERROR] cloudera-repo (https://repository.cloudera.com/artifactory/cloudera-repos,[ERROR] apache.snapshots (http://repository.apache.org/snapshots,releases=false,snapshots=true),[ERROR] central (http://repo.maven.apache.org/maven2,snapshots=false) [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors,re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions,please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems,you can resume the build with the command [ERROR] mvn <goals> -rf :spark-bagel_2.10 解决方法
这是因为pom.xml中没有名为hadoop2的配置文件.最接近的比赛是hadoop-2.2,hadoop-2.3等.
您可以运行以下命令 mvn -Phadoop-2.2 eclipse:clean eclipse:eclipse 或者您可以运行’mvn help:all-profiles’列出所有配置文件并使用其中一个配置文件 (编辑:李大同) 【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容! |