在Mac上安装Hadoop,Zookeeper,AccumuLo


2

编辑

JavaJDK 1.6 Hadoop ZooKeeper AccumuLo

Hadoop正在启动,似乎运行良好。测试了NameNode和JobTracker,它们都可以在localhost html页面中看到。

ZooKeeper服务器启动正常,但我在客户端shell中收到错误。

你可以在下面看到ZooKeeper和AccumuLo的错误。

原版的

我试图在装载Mountain Lion的OS X上安装这些技术以进行测试。该设置是使用“localhost”的单节点设置。

我遇到了几个问题......

1)运行sudo zkCli - > ls /抛出错误

Exception in thread "main" org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
    at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1496)
    at org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:725)
    at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:593)
    at org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:365)
    at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:323)
    at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:282)

2)我尝试运行bin / accumulo init并收到此错误...

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform
Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main
Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)

我的班级似乎有问题,但我不确定我需要做什么。

以下是AccumuLo编译的摘要:

[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Accumulo Project ........................... SUCCESS [17.267s]
[INFO] Trace ............................................. SUCCESS [7.819s]
[INFO] Fate .............................................. SUCCESS [2.638s]
[INFO] Start ............................................. SUCCESS [49.560s]
[INFO] Core .............................................. SUCCESS [2:57.195s]
[INFO] Server ............................................ SUCCESS [23.385s]
[INFO] Examples .......................................... SUCCESS [0.321s]
[INFO] Simple Examples ................................... SUCCESS [19.038s]
[INFO] MiniCluster ....................................... SUCCESS [38.770s]
[INFO] Accumulo Maven Plugin ............................. SUCCESS [20.568s]
[INFO] Testing ........................................... SUCCESS [2:55.802s]
[INFO] Proxy ............................................. SUCCESS [1:36.702s]
[INFO] Assemblies ........................................ SUCCESS [17.033s]
[INFO] Documentation ..................................... SUCCESS [0.282s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 10:49.977s
[INFO] Finished at: Thu Aug 29 15:05:17 EDT 2013
[INFO] Final Memory: 33M/83M
[INFO] ------------------------------------------------------------------------

1
我知道用于测试目的的最简单方法是为您选择的虚拟机获取Hortonworks Sandbox映像并以此方式运行。它不会让您体验从头开始配置集群的经验,但如果您想从用户角度进行测试,那将是一个很好的开始。
Alan Shutko 2013年

欢迎来到Ask Different。我们有一个如何询问的指南 - 看一下它,看看你是否可以添加一个编辑列出你试图解决它的步骤(以及为什么它不起作用)或者至少让我们确切地知道您安装的Java版本java -version或您安装第三方软件的软件包。如果你可以稍微缩小选项范围,那么有人帮助的机会就会增加。
bmike

@AlanShutko - 你应该把它作为一个真正的答案。卸载所有修补,依赖等等...对于刚刚开始测试的人来说是一个有效的答案。即使这个OP真的需要弄清楚基本的安装步骤,它也很有可能帮助其他人。
bmike

Answers:


1

我所知道的最简单的测试方法是获取Hortonworks Sandbox VM映像。它提供了CentOS Linux基础,并附带Hadoop和Zookeeper。他们为将在Mac上运行的VMWare和VirtualBox(免费)提供虚拟机,我将它与Parallels一起使用。(我使用VMWare VM并使用VMWare OVF工具将其从OVF转换为Parallels可以转换的vmware映像。)

它不包含Accumulo,但它为您提供了一个可以使安装更容易的工作基础。

By using our site, you acknowledge that you have read and understand our Cookie Policy and Privacy Policy.
Licensed under cc by-sa 3.0 with attribution required.