Hi,   I tried to install Spark via parcel as stated here: http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/latest/Cloudera-Manager-Installation-Guide/cmig_spark_installation_standalone.html but after adding/saving the repo http://archive.cloudera.com/spark/parcels ClouderaManager doesn't show any Spark parcel to download/install ?!?! I'm using CM4.8.1, any hints what I am missing?   br...Gerd... ... View more

Hi, I just wanted to install Accumulo (1.5.0 from tar.gz) on a Hadoop cluster (latest CDH4.5 parcel) managed by CM (4.8). How do I have to set the HADOOP_HOME, ZOOKEEPER_HOME and HADOOP_CONF_DIR properties accordingly, to be able to start Accumulo in this CM-managed environment.   My current config looks like: HADOOP_PREFIX=/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30 HADOOP_CONF_DIR="/etc/hadoop/conf" ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper   ...but after executing "./bin/accumulo init" I get the following error: " root@hadoop-pg-2:~/accumulo/accumulo-1.5.0# bin/accumulo init Uncaught exception: null java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.accumulo.start.Main.main(Main.java:41) Caused by: java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory at org.apache.commons.vfs2.impl.DefaultFileSystemManager.<init>(DefaultFileSystemManager.java:120) at org.apache.accumulo.start.classloader.vfs.FinalCloseDefaultFileSystemManager.<init>(FinalCloseDefaultFileSystemManager.java:21) at org.apache.accumulo.start.classloader.vfs.AccumuloVFSClassLoader.generateVfs(AccumuloVFSClassLoader.java:227) at org.apache.accumulo.start.classloader.vfs.AccumuloVFSClassLoader.getClassLoader(AccumuloVFSClassLoader.java:201) ... 5 more Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at org.apache.accumulo.start.classloader.AccumuloClassLoader$2.loadClass(AccumuloClassLoader.java:241) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) "   What's going wrong here? I'm trying the install instructions from http://accumulo.apache.org/1.5/accumulo_user_manual.html#_installation   thanks...Gerd... ... View more

Hi, thinking of having two datacenters and the requirement of having a cluster surviving the failure of a whole datacenter, what would be the preferred setup?   a) ONE Hadoop cluster spanned over both data centers, or b) TWO independent Hadoop clusters with (somehow) synced data   Questions: it seems obvious for option a) that the interconnection between the data centers needs to be veeery good, at least 1GBit ?!? is it possible to configure Hadoop to replicate blocks to different data centers, in precedence of replicating to different racks via the rack topology script ? if option b) is chosen, how can an automatic,continous data replication between the two clusters be established (are there tools for this) ? what are the main considerations, recommendations for the initially mentioned requirement ?   many thanks in advance...Gerd... ... View more