Member since
02-07-2014
34
Posts
0
Kudos Received
5
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2491 | 03-01-2014 09:00 AM | |
| 5845 | 02-19-2014 12:49 PM | |
| 5850 | 02-19-2014 11:23 AM | |
| 3072 | 02-19-2014 10:28 AM | |
| 5856 | 02-15-2014 02:23 PM |
01-02-2015
09:36 AM
Design patterns for efficient graph algorithms. Such an algorithm that involves a graph where each vertex has multiple edges and the edges can be of multiple types that may (or may not!) have a timestamp. I believe that GraphX in Spark (RDDs) or MapReduce may be the answer. I am wedded to accumulo, but could use Apache Spark + Accumulo. I am trying to discover communities continuously. I would not rule out an edge, common vertex approach. Please make my New Year 🙂 Thnaks Mates, Chris
... View more
12-20-2014
04:38 PM
Ps HortonWorks already does the yum accumulo, but I use cloudera products.
... View more
12-20-2014
04:37 PM
If you could set it up to do so with both Cloudera and Spark QuickStart with yum to install 1.6 that would be awsome. I spend so much time gettign things installed rather than concentrating on solving algorithmic issues. You would so rock!!!! thanks!
... View more
12-20-2014
04:34 PM
My goal is to perform line graphs link partitions and overlapping communities using a multiplicity of techniques and am looking for related cluster algorithms, techniques, and practices. I am attempting to realize techniques in http://arxiv.org/pdf/0903.3178.pdf. I am looking at Petabyte to Exabytes of data. I am also open to Apache Spark which reduces disk I/O and a Storm NOSQL hybrid. I am constrained to these environments. Could you provide me further guidance? Thanks very much! I may also overlay Spark with accumulo 1.6. Thanks and regards, Chris
... View more
12-13-2014
01:28 PM
I am trying to install accumulo 1.6 in the current quickstart cdh5.2.x distribution (downloaded 12/13/2014) to train folks. I am suprised it is not pre-installed. I want to be able to compile and run accumulo client programs in java and get to apprpriate java docs for accumulo. I tried the instructions at http://www.cloudera.com/content/cloudera/en/documentation/Accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf Install Apache Accumulo from Distribution Packages This section describes how to install Cloudera's packaging of Accumulo from packages (RPM or DEB) instead of using Cloudera Manager. I am not sure to use rpms, repo, .targz. I find the instructions somewhat confusing and would appreciate your assistance. thanks in advance.
... View more
11-19-2014
05:53 AM
Thanks veru much, I am new to Spark and drank the coolade on the communative and assoviative mandate for Cluster-based algorighms I very much appreciate you providing me an accurate view on implementations. I am very interested in the parelization of SNA and ML algorithms on clusters and appreciate any reading/references you can provide me. Thanks again for your time and insignt and I appreciate any further insight you can provide. In short; thanks Mate! Chris
... View more
11-18-2014
01:30 PM
This is what I ment by communative and associative properties Here is a reference: http://www.mathsisfun.com/associative-commutative-distributive.html . I am not being condecending; I like it because it has pictures and it is not boring to read. Yes I mean Hadoop Clusters. Decision Forests yes. Random Forests See ref: http://en.wikipedia.org/wiki/Random_forest and http://www.whrc.org/education/indonesia/pdf/DecisionTrees_RandomForest_v2.pdf I don't know and would like to know of any current approaches and or existing Linraries for Hadoop Clusters (or Spark) All I have seen thus far is bagging of data sets but not features as described in the reference. Thanks for your assistance! Chris
... View more
11-18-2014
07:29 AM
The more I look at ML Libraries for clusters, the more I see limitations because of the need to meet communitive and associative constraints. I had used scikitlearn Random Forests on multi core (not clusters) and found it to be superior to SVMs for non-linear classifications with high dim. Are there any good references on what ML (Supervised/Unsupervised and Hybrid) algorithms can and cannot work on Apache-Like Clusters (Hadoop, Hbase, Spark, Accumulo) and why? Furthermore, are there any good references on what does work well currently and under what conditions? thanks Mate, Chris
... View more
11-16-2014
04:44 PM
Thnaks Mate! Any word on 1.2 Spark ML Random Forests ... are decision forests jsut classification trees with bagging for datasets and not featured? Chris
... View more
11-16-2014
01:12 PM
How do I get Spark and Accumulo 1.6 to work together? Is there a Spark Quick start VM I can practice on. Thnaks, Chris
... View more
11-16-2014
01:06 PM
Does Spark ML and Mahout support Random Forest in clusters? Are there examples. If not why; what would be closest that are currently supported? How about SVMs ... examples Many thnaks mates!
... View more
11-14-2014
01:00 PM
Thanks Mate! Will give it a shot!
... View more
09-16-2014
08:35 AM
Looking for Open Source Machine Learning capabilities a integrated with Hadoop and Accumulo that take advantage of the architecture. Will make list available onece I get one. In Java, Python, anything. Thnaks folks, Chris
... View more
08-11-2014
07:39 PM
I am looking at using QuickStart CDH 5 and Cloudera Manager 5 as a platform to test changes to Accumulo 1.6 (http://blog.cloudera.com/blog/2013/12/accumulo-comes-to-cdh/) I want to build bot 1.6 and Sparc as Maven projects in netbeans. 1) Any guidelines on using netbeans and 1.6 built from maven? 2) Thanks, Chris
... View more
Labels:
08-11-2014
07:36 PM
I am looking at using QuickStart CDH 5 and Cloudera Manager 5 as a platform to test changes toApache Sparc. I want to build Sparc as Maven projects in netbeans. What version of Sparc is compatable with CDH 5? Any guidelines on using netbeans and Apache Sparc built from maven? Thanks, Chris
... View more
03-01-2014
09:00 AM
Ignore the build instructions for tarball at http://www.cloudera.com/content/cloudera-content/cloudera-docs/Accumulo/latest/PDF/Apache-Accumulo-Installation-Guide.pdf Use the other instructions of go to git hub if you ar building a development environment.
... View more
02-19-2014
12:49 PM
I will do that 1st thing tomorrow ... Thank Josh.
... View more
02-19-2014
11:23 AM
Hi Sean, I modified the I got this message that I believe may have been causes by the attmpted solution in the other thread: [accumulo@localhost bin]$ ./start-all.sh Starting tablet servers and loggers .... done Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Starting logger on localhost.localdomain Starting master on localhost.localdomain Starting tablet server on localhost.localdomain Starting garbage collector on localhost.localdomain Starting monitor on localhost.localdomain Starting tracer on localhost.localdomain [accumulo@localhost bin]$ ./start-all.sh Starting tablet servers and loggers .... done Starting tablet server on localhost.localdomain Starting logger on localhost.localdomain Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Starting master on localhost.localdomain Starting garbage collector on localhost.localdomain Starting monitor on localhost.localdomain Starting tracer on localhost.localdomain [accumulo@localhost bin]$ ls accumulo etc_initd_accumulo start-here.sh stop-here.sh tool.sh check-slaves LogForwarder.sh start-server.sh stop-server.sh tup.sh config.sh start-all.sh stop-all.sh tdown.sh [accumulo@localhost bin]$ ./stop-all.sh Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Invalid password or unable to connect to the master Press Ctrl-C to cancel now, or force shutdown in 15 seconds Utilities and unresponsive servers will be shut down in 5 seconds stopping unresponsive tablet servers (if any) ... stopping unresponsive tablet servers hard (if any) ... Cleaning tablet server and logger entries from zookeeper Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. Cleaning all server entries in zookeeper Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Platform Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Platform at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Platform. Program will exit. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/accumulo/start/Main Caused by: java.lang.ClassNotFoundException: org.apache.accumulo.start.Main at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) Could not find the main class: org.apache.accumulo.start.Main. Program will exit. So I can't confirm if its fixed. Regrets, Chris
... View more
02-19-2014
10:28 AM
Cleaned up as Root. As accumulo executed: Test results failed:mvn -Dhadoop.profile=2.0 package ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.accumulo.start.Test Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE! Results : Tests in error: testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory) Tests run: 2, Failures: 0, Errors: 1, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] accumulo .......................................... SUCCESS [3.794s] [INFO] cloudtrace ........................................ SUCCESS [11.847s] [INFO] accumulo-start .................................... FAILURE [1:54.079s] [INFO] accumulo-core ..................................... SKIPPED [INFO] accumulo-server ................................... SKIPPED [INFO] accumulo-examples ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:11.538s [INFO] Finished at: Tue Feb 18 23:24:34 PST 2014 [INFO] Final Memory: 34M/83M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures. [ERROR] [ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :accumulo-start [accumulo@localhost accumulo]$ whoami accumulo [accumulo@localhost accumulo]$
... View more
02-15-2014
02:23 PM
Following is my existing accumulo-site.xml: Should I delete the following from it : $ACCUMULO_HOME/src/server/target/classes/, $ACCUMULO_HOME/src/core/target/classes/, $ACCUMULO_HOME/src/start/target/classes/, $ACCUMULO_HOME/src/examples/target/classes/, to modify it from: <name>general.classpaths</name> <value> $ACCUMULO_HOME/src/server/target/classes/, $ACCUMULO_HOME/src/core/target/classes/, $ACCUMULO_HOME/src/start/target/classes/, $ACCUMULO_HOME/src/examples/target/classes/, $ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar, $ACCUMULO_HOME/lib/[^.].*.jar, $ZOOKEEPER_HOME/zookeeper[^.].*.jar, $HADOOP_CONF_DIR, $HADOOP_CLIENT_HOME/[^.].*.jar, $HADOOP_MAPRED_HOME/[^.].*.jar, $HADOOP_MAPRED_HOME/lib/[^.].*.jar, </value> to : <property>
<name>general.classpaths</name>
<value>
$ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar,
$ACCUMULO_HOME/lib/[^.].*.jar,
$ZOOKEEPER_HOME/zookeeper[^.].*-[0-9].*.jar,
$HADOOP_CONF_DIR,
$HADOOP_CLIENT_HOME/[^.].*-[0-9].*.jar,
$HADOOP_MAPRED_HOME/[^.].*-[0-9].*.jar,
$HADOOP_MAPRED_HOME/lib/[^.].*.jar,
</value>
</property>
... View more
02-14-2014
02:18 PM
Here is what we have; note I did the chmod 777 thing and made cloudera a member of accumulo group for eclipse, netbeans and cmd line development so its wide open I believe. [accumulo@localhost ~]$ ls -lah /usr/lib/accumulo total 192K drwxrwxrwx 11 accumulo accumulo 4.0K Feb 14 11:31 . dr-xr-xr-x. 55 root root 4.0K Feb 10 15:28 .. drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 bin -rwxrwxrwx 1 accumulo accumulo 26K Dec 23 09:34 CHANGES drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 contrib drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 14:43 docs drwxrwxrwx 4 accumulo accumulo 4.0K Feb 14 11:16 lib -rwxrwxrwx 1 accumulo accumulo 56K Dec 23 09:34 LICENSE drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 15:17 logs -rwxrwxrwx 1 accumulo accumulo 2.1K Dec 23 09:34 NOTICE -rwxrwxrwx 1 accumulo accumulo 32K Dec 23 09:34 pom.xml -rwxrwxrwx 1 accumulo accumulo 13K Dec 23 09:34 README drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 src drwxrwxr-x 2 cloudera cloudera 4.0K Feb 11 06:11 target drwxrwxrwx 5 accumulo accumulo 4.0K Dec 23 09:34 test -rw-rw-r-- 1 accumulo accumulo 8.1K Feb 14 11:28 tmp drwxrwxrwx 2 accumulo accumulo 4.0K Feb 12 20:59 walogs [accumulo@localhost ~]$ missing cloudera and config in /usr/lib/accumulo: cloudera is at: ./.m2/repository/com/cloudera [accumulo@localhost ~]$ find -name conf [accumulo@localhost ~]$ ls -la ./.m2/repository/com/cloudera total 12 drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 . drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 .. drwxrwxr-x 4 accumulo accumulo 4096 Feb 14 11:19 cdh [accumulo@localhost ~]$ I BELIEVE conf is: ls -la ./etc/accumulo/conf lrwxrwxrwx 1 root root 31 Feb 10 15:05 ./etc/accumulo/conf -> /etc/alternatives/accumulo-conf ls -lah /usr/lib/accumulo/src/trace/ total 24K drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 19:29 . drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 .. -rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 pom.xml drwxrwxrwx 4 accumulo accumulo 4.0K Dec 23 09:34 src drwxrwxr-x 8 cloudera cloudera 4.0K Feb 10 19:30 target -rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 thrift.sh [accumulo@localhost ~]$ total 24K Checks out drwxr-xr-x 5 accumulo accumulo 4.0K Feb 14 11:31 . drwxr-xr-x. 43 root root 4.0K Feb 10 14:23 .. drwxrwxr-x 2 accumulo accumulo 4.0K Feb 10 16:01 .accumulo -rw------- 1 accumulo accumulo 2.3K Feb 14 11:35 .bash_history -rw-r--r-- 1 accumulo accumulo 18 Feb 10 14:24 .bash_logout -rw-r--r-- 1 accumulo accumulo 176 Feb 10 14:24 .bash_profile -rw-r--r-- 1 accumulo accumulo 246 Feb 10 15:50 .bashrc drwxrwxr-x 3 accumulo accumulo 4.0K Feb 14 11:17 .m2 drwx------ 2 accumulo accumulo 4.0K Feb 10 14:26 .ssh -rw------- 1 accumulo accumulo 5.2K Feb 14 11:31 .viminfo checks out This is where the installation puts it. I am game to change. If I did miss something please tell me at 60 I got no ego 🙂 only appreciation for you assistance!
... View more
02-14-2014
01:35 PM
Hi Sean, I did it 3 times already, But it never hurts to try again ... I will have my wife back check me just in case ...
... View more
02-14-2014
12:25 PM
This seems like an access problem ... Poked around but wuld like the right way to gen a SSH key and set maven so I don't screw up.
... View more
02-14-2014
10:37 AM
Hi Sean, followed your instructions; sudo su - accumulo cd /usr/lib/accumulo mvn -Dhadoop.profile=2.0 package Here are results: ------------------------------------------------------- T E S T S ------------------------------------------------------- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] accumulo .......................................... SUCCESS [43.496s] [INFO] cloudtrace ........................................ FAILURE [35.857s] [INFO] accumulo-start .................................... SKIPPED [INFO] accumulo-core ..................................... SKIPPED [INFO] accumulo-server ................................... SKIPPED [INFO] accumulo-examples ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:21.951s [INFO] Finished at: Fri Feb 14 11:20:15 PST 2014 [INFO] Final Memory: 12M/57M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :cloudtrace [accumulo@localhost accumulo]$ Here is long version I captured: [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:cloudtrace:jar:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-core:jar:1.4.3-cdh4.3.0 [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.accumulo:cloudtrace:jar -> duplicate declaration of version (?) @ line 153, column 17 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-server:jar:1.4.3-cdh4.3.0 [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.mortbay.jetty:jetty:jar -> duplicate declaration of version (?) @ line 103, column 17 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-start:jar:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-examples:pom:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 [WARNING] [WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo:pom:1.4.3-cdh4.3.0 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ line 81, column 15 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 152, column 15 [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead. [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead. [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead. [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] ------------------------------------------------------------------------ [INFO] Reactor Build Order: [INFO] [INFO] accumulo [INFO] cloudtrace [INFO] accumulo-start [INFO] accumulo-core [INFO] accumulo-server [INFO] accumulo-examples [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building accumulo 1.4.3-cdh4.3.0 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ accumulo --- [INFO] [INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ accumulo --- [INFO] [INFO] --- exec-maven-plugin:1.2:exec (user-manual) @ accumulo --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building cloudtrace 1.4.3-cdh4.3.0 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ cloudtrace --- [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ cloudtrace --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/main/resources [INFO] [INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ cloudtrace --- [INFO] log4j-1.2.16.jar already exists in destination. [INFO] libthrift-0.6.1.jar already exists in destination. [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ cloudtrace --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloudtrace --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ cloudtrace --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.9:test (default-test) @ cloudtrace --- [INFO] Surefire report directory: /usr/lib/accumulo/src/trace/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] accumulo .......................................... SUCCESS [2.920s] [INFO] cloudtrace ........................................ FAILURE [1.694s] [INFO] accumulo-start .................................... SKIPPED [INFO] accumulo-core ..................................... SKIPPED [INFO] accumulo-server ................................... SKIPPED [INFO] accumulo-examples ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 6.399s [INFO] Finished at: Fri Feb 14 11:28:01 PST 2014 [INFO] Final Memory: 9M/57M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :cloudtrace
... View more
02-14-2014
08:06 AM
Can do! R there any flags you what me to use during the build? thanks! Chris
... View more
02-14-2014
04:53 AM
Thnaks Sean, Not yet ... Accumulo runs, the examples run from the existing jars, BUT, when I try to run or modify example code. I tried mvn -Dhadoop.profile=2.0 package on command line, eclips and netbeans builds and still get the following errors, seems it can't find org.apache.hadoop:hadoop-core: jar:2.0.0-cdh4.3.0 : When building"examples-simple I got the following output:======================== Some dependency artifacts are not in your local repository: your project has dependencies that are not resolved locally. Code completion in the IDE will not include classes from these dependencies or their transitive dependencies (unless they are among the open projects). Please download the dependencies, or install them manually, if not available remotely. The artifacts are: org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0 =================================================== Build however indicated success. I then attempted to to run the project with parameters indicated at:http:// accumulo .apache.org/1.4/examples/helloworld.html newly built org.apache. accumulo .examples.simple.helloworld.ReadData I then got:======================================== ---------------------------------------------------------------------- Building examples-simple 1.4.3-cdh4.3.0 ------------------------------------------------------------------------ The POM for org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0 is missing, no dependency information available ------------------------------------------------------------------------ BUILD FAILURE ------------------------------------------------------------------------ Total time: 10.322s Finished at: Wed Feb 12 21:06:25 PST 2014 Final Memory: 11M/57M ------------------------------------------------------------------------ Failed to execute goal on project examples-simple: Could not resolve dependencies for project org.apache. accumulo :examples-simple:jar:1.4.3-cdh4.3.0: Failure to find org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0 in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] To see the full stack trace of the errors, re-run Maven with the -e switch. Re-run Maven using the -X switch to enable full debug logging. For more information about the errors and possible solutions, please read the following articles: [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException ============================================================== I was asked to try accumulo Accumulo 1.4.4-cdh4.5.0 ; Note the QuickStart VM is 4.4.0, the accumulo release you have for download is 4.5.0 is this a problem (no QuickStart). I appreciate your help. Putting on my snow shoes and be back in 20 minutes 🙂 Chris
... View more
02-12-2014
07:18 PM
My Bad, I set up notifications to go to chris.p.rigano@gmail.com. I am just trying to get a version of the CDH QuickStart with accumulo to run for classes I am teaching and to do work outside the IC doors. I tried both eclipse I have been using for a number of years and got the right setting in netbeans. Still not working as indicated in literature for examples. This is not an ide issue but an environment problem. I would be glad to send you my VM built IAW cloudera guidance. It may make things easier. Give me access to a fast FTP. I used CDH at Meade for a while. I am a cloudera fan. Best regards, Chris
... View more
02-12-2014
12:23 PM
Exactly! I am new to netbeans as well and am not a Maven guy. I'll see if I can use mvn -Dhadoop.profile=2.0 package. I will be starting on my maven book in 20 minutes (sort of a machine learning guy) I was using the examples to be modified during training. I will rebuild using accumulo Accumulo 1.4.4-cdh4.5.0 if not. Can I still use the current QuickStart VM? appreciate your assistance Joey, Chris Ps. First response from Cloudera I have gotten with 4 posts
... View more
02-11-2014
03:40 PM
Greetings to all esteem colleague, Following indicate a build failure for accumulo-examples indicating the failure of Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest. I would very much appreciate advice on actions to take in detail that would resolve this issue. The environment is accumulo-1.4.3, CDH4.3 QuickStart using netbeans to import the maven project accumulo-examples after installing accumulo from the accumulo-1.4.3cdh4.3.tar.gz. The VM is available upon request. Cloudera has not responded in there news groups. In advance thanks for your assistance. The results of executing the build with dependencies option are listed below: cd /usr/lib/accumulo/src/examples/simple; JAVA_HOME=/usr/java/jdk1.6.0_32 /home/cloudera/netbeans-7.4/java/maven/bin/mvn install Scanning for projects... Some problems were encountered while building the effective model for org.apache.accumulo:examples-simple:jar:1.4.3-cdh4.3.0 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15 It is highly recommended to fix these problems because they threaten the stability of your build. For this reason, future Maven versions might no longer support building such malformed projects. ------------------------------------------------------------------------ Building examples-simple 1.4.3-cdh4.3.0 ------------------------------------------------------------------------ --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ examples-simple --- --- maven-resources-plugin:2.5:resources (default-resources) @ examples-simple --- [debug] execute contextualize Using 'UTF-8' encoding to copy filtered resources. skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/main/resources --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ examples-simple --- log4j-1.2.16.jar already exists in destination. --- maven-compiler-plugin:2.3.2:compile (default-compile) @ examples-simple --- Compiling 40 source files to /usr/lib/accumulo/src/examples/simple/target/classes --- maven-resources-plugin:2.5:testResources (default-testResources) @ examples-simple --- [debug] execute contextualize Using 'UTF-8' encoding to copy filtered resources. skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/test/resources --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ examples-simple --- Compiling 5 source files to /usr/lib/accumulo/src/examples/simple/target/test-classes --- maven-surefire-plugin:2.9:test (default-test) @ examples-simple --- Surefire report directory: /usr/lib/accumulo/src/examples/simple/target/surefire-reports ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.89 sec <<< FAILURE! Running org.apache.accumulo.examples.simple.filedata.ChunkCombinerTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec Running org.apache.accumulo.examples.simple.filedata.ChunkInputStreamTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec Running org.apache.accumulo.examples.simple.filedata.KeyUtilTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec Running org.apache.accumulo.examples.simple.dirlist.CountTest Max depth : 3 Time to find max depth : 2 ms Time to compute counts : 7 ms Entries scanned : 30 Counts inserted : 4 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec Results : Tests in error: test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected testInfoWithoutChunks(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected Tests run: 15, Failures: 0, Errors: 3, Skipped: 0 ------------------------------------------------------------------------ BUILD FAILURE ------------------------------------------------------------------------ Total time: 17.620s Finished at: Tue Feb 11 14:34:18 PST 2014 Final Memory: 20M/57M ------------------------------------------------------------------------ Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project examples-simple: There are test failures. Please refer to /usr/lib/accumulo/src/examples/simple/target/surefire-reports for the individual test results. -> [Help 1] To see the full stack trace of the errors, re-run Maven with the -e switch. Re-run Maven using the -X switch to enable full debug logging. For more information about the errors and possible solutions, please read the following articles: [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException -> [Help 1] ============================================================================== Following is: The results of the failed report in "/usr/lib/accumulo/src/examples/simple/target/surefire-reports" ------------------------------------------------------------------------------- Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest ------------------------------------------------------------------------------- Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 2.297 sec <<< FAILURE! test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest) Time elapsed: 1.542 sec <<< ERROR! java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.test(ChunkInputFormatTest.java:95) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:232) at junit.framework.TestSuite.run(TestSuite.java:227) at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:81) at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110) at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172) at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70) testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest) Time elapsed: 0.084 sec <<< ERROR! java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47) at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.testErrorOnNextWithoutClose(ChunkInputFormatTest.java:146) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:232)
... View more
- Tags:
- Accumulo
