Member since
02-07-2014
34
Posts
0
Kudos Received
5
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3296 | 03-01-2014 09:00 AM | |
| 8264 | 02-19-2014 12:49 PM | |
| 8269 | 02-19-2014 11:23 AM | |
| 4711 | 02-19-2014 10:28 AM | |
| 8275 | 02-15-2014 02:23 PM |
12-20-2014
04:38 PM
Ps HortonWorks already does the yum accumulo, but I use cloudera products.
... View more
12-20-2014
04:37 PM
If you could set it up to do so with both Cloudera and Spark QuickStart with yum to install 1.6 that would be awsome. I spend so much time gettign things installed rather than concentrating on solving algorithmic issues. You would so rock!!!! thanks!
... View more
12-13-2014
01:28 PM
I am trying to install accumulo 1.6 in the current quickstart cdh5.2.x distribution (downloaded 12/13/2014) to train folks. I am suprised it is not pre-installed. I want to be able to compile and run accumulo client programs in java and get to apprpriate java docs for accumulo. I tried the instructions at http://www.cloudera.com/content/cloudera/en/documentation/Accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf Install Apache Accumulo from Distribution Packages This section describes how to install Cloudera's packaging of Accumulo from packages (RPM or DEB) instead of using Cloudera Manager. I am not sure to use rpms, repo, .targz. I find the instructions somewhat confusing and would appreciate your assistance. thanks in advance.
... View more
11-19-2014
05:53 AM
Thanks veru much, I am new to Spark and drank the coolade on the communative and assoviative mandate for Cluster-based algorighms I very much appreciate you providing me an accurate view on implementations. I am very interested in the parelization of SNA and ML algorithms on clusters and appreciate any reading/references you can provide me. Thanks again for your time and insignt and I appreciate any further insight you can provide. In short; thanks Mate! Chris
... View more
11-18-2014
01:30 PM
This is what I ment by communative and associative properties Here is a reference: http://www.mathsisfun.com/associative-commutative-distributive.html . I am not being condecending; I like it because it has pictures and it is not boring to read. Yes I mean Hadoop Clusters. Decision Forests yes. Random Forests See ref: http://en.wikipedia.org/wiki/Random_forest and http://www.whrc.org/education/indonesia/pdf/DecisionTrees_RandomForest_v2.pdf I don't know and would like to know of any current approaches and or existing Linraries for Hadoop Clusters (or Spark) All I have seen thus far is bagging of data sets but not features as described in the reference. Thanks for your assistance! Chris
... View more
11-18-2014
07:29 AM
The more I look at ML Libraries for clusters, the more I see limitations because of the need to meet communitive and associative constraints. I had used scikitlearn Random Forests on multi core (not clusters) and found it to be superior to SVMs for non-linear classifications with high dim. Are there any good references on what ML (Supervised/Unsupervised and Hybrid) algorithms can and cannot work on Apache-Like Clusters (Hadoop, Hbase, Spark, Accumulo) and why? Furthermore, are there any good references on what does work well currently and under what conditions? thanks Mate, Chris
... View more
11-16-2014
04:44 PM
Thnaks Mate! Any word on 1.2 Spark ML Random Forests ... are decision forests jsut classification trees with bagging for datasets and not featured? Chris
... View more
11-16-2014
01:06 PM
Does Spark ML and Mahout support Random Forest in clusters? Are there examples. If not why; what would be closest that are currently supported? How about SVMs ... examples Many thnaks mates!
... View more
11-14-2014
01:00 PM
Thanks Mate! Will give it a shot!
... View more
03-01-2014
09:00 AM
Ignore the build instructions for tarball at http://www.cloudera.com/content/cloudera-content/cloudera-docs/Accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf Use the other instructions of go to git hub if you ar building a development environment.
... View more
02-19-2014
12:49 PM
I will do that 1st thing tomorrow ... Thank Josh.
... View more
02-19-2014
11:23 AM
Hi Sean, I modified the I got this message that I believe may have been causes by the attmpted solution in the other thread: [accumulo@localhost bin]$ ./start-all.sh Starting tablet servers and loggers .... done Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Starting logger on localhost.localdomain Starting master on localhost.localdomain Starting tablet server on localhost.localdomain Starting garbage collector on localhost.localdomain Starting monitor on localhost.localdomain Starting tracer on localhost.localdomain [accumulo@localhost bin]$ ./start-all.sh Starting tablet servers and loggers .... done Starting tablet server on localhost.localdomain Starting logger on localhost.localdomain Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Starting master on localhost.localdomain Starting garbage collector on localhost.localdomain Starting monitor on localhost.localdomain Starting tracer on localhost.localdomain [accumulo@localhost bin]$ ls accumulo etc_initd_accumulo start-here.sh stop-here.sh tool.sh check-slaves LogForwarder.sh start-server.sh stop-server.sh tup.sh config.sh start-all.sh stop-all.sh tdown.sh [accumulo@localhost bin]$ ./stop-all.sh Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Invalid password or unable to connect to the master Press Ctrl-C to cancel now, or force shutdown in 15 seconds Utilities and unresponsive servers will be shut down in 5 seconds stopping unresponsive tablet servers (if any) ... stopping unresponsive tablet servers hard (if any) ... Cleaning tablet server and logger entries from zookeeper Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Cleaning all server entries in zookeeper Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. So I can't confirm if its fixed. Regrets, Chris
... View more
02-19-2014
10:28 AM
Cleaned up as Root. As accumulo executed: Test results failed:mvn -Dhadoop.profile=2.0 package ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.accumulo.start.Test Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE! Results : Tests in error: testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory) Tests run: 2, Failures: 0, Errors: 1, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] accumulo .......................................... SUCCESS [3.794s] [INFO] cloudtrace ........................................ SUCCESS [11.847s] [INFO] accumulo-start .................................... FAILURE [1:54.079s] [INFO] accumulo-core ..................................... SKIPPED [INFO] accumulo-server ................................... SKIPPED [INFO] accumulo-examples ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:11.538s [INFO] Finished at: Tue Feb 18 23:24:34 PST 2014 [INFO] Final Memory: 34M/83M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures. [ERROR] [ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :accumulo-start [accumulo@localhost accumulo]$ whoami accumulo [accumulo@localhost accumulo]$
... View more
02-15-2014
02:23 PM
Following is my existing accumulo-site.xml: Should I delete the following from it : $ACCUMULO_HOME/src/server/target/classes/, $ACCUMULO_HOME/src/core/target/classes/, $ACCUMULO_HOME/src/start/target/classes/, $ACCUMULO_HOME/src/examples/target/classes/, to modify it from: <name>general.classpaths</name> <value> $ACCUMULO_HOME/src/server/target/classes/, $ACCUMULO_HOME/src/core/target/classes/, $ACCUMULO_HOME/src/start/target/classes/, $ACCUMULO_HOME/src/examples/target/classes/, $ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar, $ACCUMULO_HOME/lib/[^.].*.jar, $ZOOKEEPER_HOME/zookeeper[^.].*.jar, $HADOOP_CONF_DIR, $HADOOP_CLIENT_HOME/[^.].*.jar, $HADOOP_MAPRED_HOME/[^.].*.jar, $HADOOP_MAPRED_HOME/lib/[^.].*.jar, </value> to : <property>
<name>general.classpaths</name>
<value>
$ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar,
$ACCUMULO_HOME/lib/[^.].*.jar,
$ZOOKEEPER_HOME/zookeeper[^.].*-[0-9].*.jar,
$HADOOP_CONF_DIR,
$HADOOP_CLIENT_HOME/[^.].*-[0-9].*.jar,
$HADOOP_MAPRED_HOME/[^.].*-[0-9].*.jar,
$HADOOP_MAPRED_HOME/lib/[^.].*.jar,
</value>
</property>
... View more
02-14-2014
02:18 PM
Here is what we have; note I did the chmod 777 thing and made cloudera a member of accumulo group for eclipse, netbeans and cmd line development so its wide open I believe. [accumulo@localhost ~]$ ls -lah /usr/lib/accumulo total 192K drwxrwxrwx 11 accumulo accumulo 4.0K Feb 14 11:31 . dr-xr-xr-x. 55 root root 4.0K Feb 10 15:28 .. drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 bin -rwxrwxrwx 1 accumulo accumulo 26K Dec 23 09:34 CHANGES drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 contrib drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 14:43 docs drwxrwxrwx 4 accumulo accumulo 4.0K Feb 14 11:16 lib -rwxrwxrwx 1 accumulo accumulo 56K Dec 23 09:34 LICENSE drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 15:17 logs -rwxrwxrwx 1 accumulo accumulo 2.1K Dec 23 09:34 NOTICE -rwxrwxrwx 1 accumulo accumulo 32K Dec 23 09:34 pom.xml -rwxrwxrwx 1 accumulo accumulo 13K Dec 23 09:34 README drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 src drwxrwxr-x 2 cloudera cloudera 4.0K Feb 11 06:11 target drwxrwxrwx 5 accumulo accumulo 4.0K Dec 23 09:34 test -rw-rw-r-- 1 accumulo accumulo 8.1K Feb 14 11:28 tmp drwxrwxrwx 2 accumulo accumulo 4.0K Feb 12 20:59 walogs [accumulo@localhost ~]$ missing cloudera and config in /usr/lib/accumulo: cloudera is at: ./.m2/repository/com/cloudera [accumulo@localhost ~]$ find -name conf [accumulo@localhost ~]$ ls -la ./.m2/repository/com/cloudera total 12 drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 . drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 .. drwxrwxr-x 4 accumulo accumulo 4096 Feb 14 11:19 cdh [accumulo@localhost ~]$ I BELIEVE conf is: ls -la ./etc/accumulo/conf lrwxrwxrwx 1 root root 31 Feb 10 15:05 ./etc/accumulo/conf -> /etc/alternatives/accumulo-conf ls -lah /usr/lib/accumulo/src/trace/ total 24K drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 19:29 . drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 .. -rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 pom.xml drwxrwxrwx 4 accumulo accumulo 4.0K Dec 23 09:34 src drwxrwxr-x 8 cloudera cloudera 4.0K Feb 10 19:30 target -rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 thrift.sh [accumulo@localhost ~]$ total 24K Checks out drwxr-xr-x 5 accumulo accumulo 4.0K Feb 14 11:31 . drwxr-xr-x. 43 root root 4.0K Feb 10 14:23 .. drwxrwxr-x 2 accumulo accumulo 4.0K Feb 10 16:01 .accumulo -rw------- 1 accumulo accumulo 2.3K Feb 14 11:35 .bash_history -rw-r--r-- 1 accumulo accumulo 18 Feb 10 14:24 .bash_logout -rw-r--r-- 1 accumulo accumulo 176 Feb 10 14:24 .bash_profile -rw-r--r-- 1 accumulo accumulo 246 Feb 10 15:50 .bashrc drwxrwxr-x 3 accumulo accumulo 4.0K Feb 14 11:17 .m2 drwx------ 2 accumulo accumulo 4.0K Feb 10 14:26 .ssh -rw------- 1 accumulo accumulo 5.2K Feb 14 11:31 .viminfo checks out This is where the installation puts it. I am game to change. If I did miss something please tell me at 60 I got no ego 🙂 only appreciation for you assistance!
... View more
02-14-2014
01:35 PM
Hi Sean, I did it 3 times already, But it never hurts to try again ... I will have my wife back check me just in case ...
... View more
02-14-2014
12:25 PM
This seems like an access problem ... Poked around but wuld like the right way to gen a SSH key and set maven so I don't screw up.
... View more
02-14-2014
10:37 AM
Hi Sean, followed your instructions; sudo su - accumulo cd /usr/lib/accumulo mvn -Dhadoop.profile=2.0 package Here are results: ------------------------------------------------------- T E S T S ------------------------------------------------------- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] accumulo .......................................... SUCCESS [43.496s] [INFO] cloudtrace ........................................ FAILURE [35.857s] [INFO] accumulo-start .................................... SKIPPED [INFO] accumulo-core ..................................... SKIPPED [INFO] accumulo-server ................................... SKIPPED [INFO] accumulo-examples ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:21.951s [INFO] Finished at: Fri Feb 14 11:20:15 PST 2014 [INFO] Final Memory: 12M/57M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :cloudtrace [accumulo@localhost accumulo]$ Here is long version I captured: [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:cloudtrace:jar:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-core:jar:1.4.3-cdh4.3.0 [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.accumulo:cloudtrace:jar -> duplicate declaration of version (?) @ line 153, column 17 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-server:jar:1.4.3-cdh4.3.0 [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.mortbay.jetty:jetty:jar -> duplicate declaration of version (?) @ line 103, column 17 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-start:jar:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-examples:pom:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo:pom:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 152, column 15 [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead. [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead. [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead. [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] accumulo [INFO] cloudtrace [INFO] accumulo-start [INFO] accumulo-core [INFO] accumulo-server [INFO] accumulo-examples [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building accumulo 1.4.3-cdh4.3.0 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ accumulo --- [INFO] [INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ accumulo --- [INFO] [INFO] --- exec-maven-plugin:1.2:exec (user-manual) @ accumulo --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building cloudtrace 1.4.3-cdh4.3.0 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ cloudtrace --- [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ cloudtrace --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/main/resources [INFO] [INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ cloudtrace --- [INFO] log4j-1.2.16.jar already exists in destination. [INFO] libthrift-0.6.1.jar already exists in destination. [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ cloudtrace --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloudtrace --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ cloudtrace --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.9:test (default-test) @ cloudtrace --- [INFO] Surefire report directory: /usr/lib/accumulo/src/trace/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] accumulo .......................................... SUCCESS [2.920s] [INFO] cloudtrace ........................................ FAILURE [1.694s] [INFO] accumulo-start .................................... SKIPPED [INFO] accumulo-core ..................................... SKIPPED [INFO] accumulo-server ................................... SKIPPED [INFO] accumulo-examples ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 6.399s [INFO] Finished at: Fri Feb 14 11:28:01 PST 2014 [INFO] Final Memory: 9M/57M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :cloudtrace
... View more
02-14-2014
08:06 AM
Can do! R there any flags you what me to use during the build? thanks! Chris
... View more
02-14-2014
04:53 AM
Thnaks Sean, Not yet ... Accumulo runs, the examples run from the existing jars, BUT, when I try to run or modify example code. I tried mvn -Dhadoop.profile=2.0 package on command line, eclips and netbeans builds and still get the following errors, seems it can't find org.apache.hadoop:hadoop-core: jar:2.0.0-cdh4.3.0 : When building"examples-simple I got the following output:======================== Some dependency artifacts are not in your local repository: your project has dependencies that are not resolved locally. Code completion in the IDE will not include classes from these dependencies or their transitive dependencies (unless they are among the open projects). Please download the dependencies, or install them manually, if not available remotely. The artifacts are: org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0 =================================================== Build however indicated success. I then attempted to to run the project with parameters indicated at:http:// accumulo .apache.org/1.4/examples/helloworld.html newly built org.apache. accumulo .examples.simple.helloworld.ReadData I then got:======================================== ---------------------------------------------------------------------- Building examples-simple 1.4.3-cdh4.3.0 ------------------------------------------------------------------------ The POM for org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0 is missing, no dependency information available ------------------------------------------------------------------------ BUILD FAILURE ------------------------------------------------------------------------ Total time: 10.322s Finished at: Wed Feb 12 21:06:25 PST 2014 Final Memory: 11M/57M ------------------------------------------------------------------------ Failed to execute goal on project examples-simple: Could not resolve dependencies for project org.apache. accumulo :examples-simple:jar:1.4.3-cdh4.3.0: Failure to find org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0 in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] To see the full stack trace of the errors, re-run Maven with the -e switch. Re-run Maven using the -X switch to enable full debug logging. For more information about the errors and possible solutions, please read the following articles: [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException ============================================================== I was asked to try accumulo Accumulo 1.4.4-cdh4.5.0 ; Note the QuickStart VM is 4.4.0, the accumulo release you have for download is 4.5.0 is this a problem (no QuickStart). I appreciate your help. Putting on my snow shoes and be back in 20 minutes 🙂 Chris
... View more
02-12-2014
07:18 PM
My Bad, I set up notifications to go to chris.p.rigano@gmail.com. I am just trying to get a version of the CDH QuickStart with accumulo to run for classes I am teaching and to do work outside the IC doors. I tried both eclipse I have been using for a number of years and got the right setting in netbeans. Still not working as indicated in literature for examples. This is not an ide issue but an environment problem. I would be glad to send you my VM built IAW cloudera guidance. It may make things easier. Give me access to a fast FTP. I used CDH at Meade for a while. I am a cloudera fan. Best regards, Chris
... View more
02-12-2014
12:23 PM
Exactly! I am new to netbeans as well and am not a Maven guy. I'll see if I can use mvn -Dhadoop.profile=2.0 package. I will be starting on my maven book in 20 minutes (sort of a machine learning guy) I was using the examples to be modified during training. I will rebuild using accumulo Accumulo 1.4.4-cdh4.5.0 if not. Can I still use the current QuickStart VM? appreciate your assistance Joey, Chris Ps. First response from Cloudera I have gotten with 4 posts
... View more
02-11-2014
03:40 PM
Greetings to all esteem colleague, Following indicate a build failure for accumulo-examples indicating the failure of Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest. I would very much appreciate advice on actions to take in detail that would resolve this issue. The environment is accumulo-1.4.3, CDH4.3 QuickStart using netbeans to import the maven project accumulo-examples after installing accumulo from the accumulo-1.4.3cdh4.3.tar.gz. The VM is available upon request. Cloudera has not responded in there news groups. In advance thanks for your assistance. The results of executing the build with dependencies option are listed below: cd /usr/lib/accumulo/src/examples/simple; JAVA_HOME=/usr/java/jdk1.6.0_32 /home/cloudera/netbeans-7.4/java/maven/bin/mvn install Scanning for projects... Some problems were encountered while building the effective model for org.apache.accumulo:examples-simple:jar:1.4.3-cdh4.3.0 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 It is highly recommended to fix these problems because they threaten the stability of your build. For this reason, future Maven versions might no longer support building such malformed projects. ------------------------------------------------------------------------ Building examples-simple 1.4.3-cdh4.3.0 ------------------------------------------------------------------------ --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ examples-simple --- --- maven-resources-plugin:2.5:resources (default-resources) @ examples-simple --- [debug] execute contextualize Using 'UTF-8' encoding to copy filtered resources. skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/main/resources --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ examples-simple --- log4j-1.2.16.jar already exists in destination. --- maven-compiler-plugin:2.3.2:compile (default-compile) @ examples-simple --- Compiling 40 source files to /usr/lib/accumulo/src/examples/simple/target/classes --- maven-resources-plugin:2.5:testResources (default-testResources) @ examples-simple --- [debug] execute contextualize Using 'UTF-8' encoding to copy filtered resources. skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/test/resources --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ examples-simple --- Compiling 5 source files to /usr/lib/accumulo/src/examples/simple/target/test-classes --- maven-surefire-plugin:2.9:test (default-test) @ examples-simple --- Surefire report directory: /usr/lib/accumulo/src/examples/simple/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.89 sec <<< FAILURE! Running org.apache.accumulo.examples.simple.filedata.ChunkCombinerTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec Running org.apache.accumulo.examples.simple.filedata.ChunkInputStreamTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec Running org.apache.accumulo.examples.simple.filedata.KeyUtilTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec Running org.apache.accumulo.examples.simple.dirlist.CountTest Max depth : 3 Time to find max depth : 2 ms Time to compute counts : 7 ms Entries scanned : 30 Counts inserted : 4 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec Results : Tests in error: test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected testInfoWithoutChunks(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected Tests run: 15, Failures: 0, Errors: 3, Skipped: 0 ------------------------------------------------------------------------ BUILD FAILURE ------------------------------------------------------------------------ Total time: 17.620s Finished at: Tue Feb 11 14:34:18 PST 2014 Final Memory: 20M/57M ------------------------------------------------------------------------ Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project examples-simple: There are test failures. Please refer to /usr/lib/accumulo/src/examples/simple/target/surefire-reports for the individual test results. -> [Help 1] To see the full stack trace of the errors, re-run Maven with the -e switch. Re-run Maven using the -X switch to enable full debug logging. For more information about the errors and possible solutions, please read the following articles: [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException -> [Help 1] ============================================================================== Following is: The results of the failed report in "/usr/lib/accumulo/src/examples/simple/target/surefire-reports" ------------------------------------------------------------------------------- Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest ------------------------------------------------------------------------------- Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 2.297 sec <<< FAILURE! test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest) Time elapsed: 1.542 sec <<< ERROR! java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.test(ChunkInputFormatTest.java:95) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:232) at junit.framework.TestSuite.run(TestSuite.java:227) at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:81) at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110) at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172) at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70) testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest) Time elapsed: 0.084 sec <<< ERROR! java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.testErrorOnNextWithoutClose(ChunkInputFormatTest.java:146) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:232)
... View more
- Tags:
- Accumulo
02-08-2014
08:44 AM
I would like to build and test, deploy and make available a "special" accumulo Iterator.
I an not sure where to start, e.g. do I download a git project, do I create a jar to test, how do I make it available.
I am good at my algebras, but new to this 🙂
My environment is accumulo 1.4.3 on CDH4 QuickStart.
Used maven to import accumulo simple examples into netbeans.
Thanks,
Chris
... View more
- Tags:
- Accumulo
Labels:
- Labels:
-
Accumulo
02-07-2014
01:47 PM
I have just sucessfuly installed accumulo-1.4.3 on cloudera CDH4 QuickStart.
Each time I log in to the accumulo shell I get the following warning:
SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/lib/hadoop/client-0.20/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/hadoop/client-0.20/slf4j-log4j12.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
The website states:
SLF4J warning or error messages and their meanings The method o.a.commons.logging.impl.SLF4FLogFactory#release was invoked.
Given the structure of the commons-logging API, in particular as implemented by SLF4J, the o.a.commons.logging.impl.SLF4FLogFactory#release() method should never be called. However, depending on the deployment of commons-logging.jar files in your servlet container, release() method may be unexpectedly invoked by a copy of org.apache.commons.logging.LogFactory class shipping with commons-logging.jar.
This is a relatively common occurrence with recent versions of Tomcat, especially if you place jcl-over-slf4j.jar in WEB-INF/lib directory of your web-application instead of $TOMCAT_HOME/common/lib, where $TOMCAT_HOME stands for the directory where Tomcat is installed. In order to fully benefit from the stability offered by jcl-over-slf4j.jar, we recommend that you place jcl-over-slf4j.jar in $TOMCAT_HOME/common/lib without placing a copy in your web-applications.
Please also see bug #22.
I don't want to break anything; how do I fix this?
thanks,
Chris
... View more
- Tags:
- Accumulo
- QuickStart
Labels:
- Labels:
-
Accumulo
02-07-2014
06:16 AM
I followed the instructions at http://www.cloudera.com/content/cloudera-content/cloudera-docs/Accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf. I used the accumulo-1.4.3-cdh4.3.0-dist.tar.gz
When I ran the hellow world example to determine if the installation was correct I got the following errors.
./ bin / accumulo org . apache . accumulo . examples . simple . helloworld . InsertWithOutputFormat "instance" localhost : 2181 "username" "password" hellotable
Thread "org.apache.accumulo.examples.simple.helloworld.InsertWithOutputFormat" died nulljava . lang . reflect . InvocationTargetException at sun . reflect . NativeMethodAccessorImpl . invoke0 ( Native Method ) at sun . reflect . NativeMethodAccessorImpl . invoke ( NativeMethodAccessorImpl . java : 39 ) at sun . reflect . DelegatingMethodAccessorImpl . invoke ( DelegatingMethodAccessorImpl . java : 25 ) at java . lang . reflect . Method . invoke ( Method . java : 597 ) at org . apache . accumulo . start . Main$1 . run ( Main . java : 89 ) at java . lang . Thread . run ( Thread . java : 662 )
Caused by: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected at org.apache.accumulo.core.util.ContextFactory.createTaskAttemptContext(ContextFactory.java:131) at org.apache.accumulo.examples.simple.helloworld.InsertWithOutputFormat.run(InsertWithOutputFormat.java:56) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.accumulo.examples.simple.helloworld.InsertWithOutputFormat.main(InsertWithOutputFormat.java:76) ... 6 more
These problems were identified by an accumulo group as as hadoop 2.0 – accumulo 1.4.3 compatibility issues.
I really want to use the cloudera CDH4 quick start. Here is a link to my error posting on stack: http://stackoverflow.com/questions/21563143/issues-with-accumulo-1-4-3-helloworld-example-on-cdh4-3- things happen …
I would appreciate your advice!
Chris.
... View more
- Tags:
- Accumulo
Labels:
- Labels:
-
Accumulo
