Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest

[#1]

Greetings to all esteem colleague,

Following indicate a build failure for accumulo-examples indicating  the failure of Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.

I would very much appreciate advice on actions to take in detail that would resolve this issue.

The environment is accumulo-1.4.3, CDH4.3 QuickStart using netbeans to import the maven project  accumulo-examples after installing accumulo from the accumulo-1.4.3cdh4.3.tar.gz.

The VM is available upon request.

Cloudera has not responded in there news groups.

In advance thanks for your assistance.

The results of executing the build with dependencies option are listed below:

cd /usr/lib/accumulo/src/examples/simple; JAVA_HOME=/usr/java/jdk1.6.0_32 /home/cloudera/netbeans-7.4/java/maven/bin/mvn install

Scanning for projects...

Some problems were encountered while building the effective model for org.apache.accumulo:examples-simple:jar:1.4.3-cdh4.3.0

'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15

'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15

It is highly recommended to fix these problems because they threaten the stability of your build.

For this reason, future Maven versions might no longer support building such malformed projects.

------------------------------------------------------------------------

Building examples-simple 1.4.3-cdh4.3.0

------------------------------------------------------------------------

--- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ examples-simple ---

--- maven-resources-plugin:2.5:resources (default-resources) @ examples-simple ---

[debug] execute contextualize

Using 'UTF-8' encoding to copy filtered resources.

skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/main/resources

--- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ examples-simple ---

log4j-1.2.16.jar already exists in destination.

--- maven-compiler-plugin:2.3.2:compile (default-compile) @ examples-simple ---

Compiling 40 source files to /usr/lib/accumulo/src/examples/simple/target/classes

--- maven-resources-plugin:2.5:testResources (default-testResources) @ examples-simple ---

[debug] execute contextualize

Using 'UTF-8' encoding to copy filtered resources.

skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/test/resources

--- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ examples-simple ---

Compiling 5 source files to /usr/lib/accumulo/src/examples/simple/target/test-classes

--- maven-surefire-plugin:2.9:test (default-test) @ examples-simple ---

Surefire report directory: /usr/lib/accumulo/src/examples/simple/target/surefire-reports

-------------------------------------------------------

 T E S T S

-------------------------------------------------------

Running org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest

Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.89 sec <<< FAILURE!

Running org.apache.accumulo.examples.simple.filedata.ChunkCombinerTest

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec

Running org.apache.accumulo.examples.simple.filedata.ChunkInputStreamTest

Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec

Running org.apache.accumulo.examples.simple.filedata.KeyUtilTest

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec

Running org.apache.accumulo.examples.simple.dirlist.CountTest

Max depth              : 3

Time to find max depth : 2 ms

Time to compute counts : 7 ms

Entries scanned        : 30 

Counts inserted        : 4 

Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec

Results :

Tests in error: 

  test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected

  testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected

  testInfoWithoutChunks(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected

Tests run: 15, Failures: 0, Errors: 3, Skipped: 0

------------------------------------------------------------------------

BUILD FAILURE

------------------------------------------------------------------------

Total time: 17.620s

Finished at: Tue Feb 11 14:34:18 PST 2014

Final Memory: 20M/57M

------------------------------------------------------------------------

Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project examples-simple: There are test failures.

Please refer to /usr/lib/accumulo/src/examples/simple/target/surefire-reports for the individual test results.

-> [Help 1]

To see the full stack trace of the errors, re-run Maven with the -e switch.

Re-run Maven using the -X switch to enable full debug logging.

For more information about the errors and possible solutions, please read the following articles:

[Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

-> [Help 1]

==============================================================================

Following is: The results of the failed report in  "/usr/lib/accumulo/src/examples/simple/target/surefire-reports"

-------------------------------------------------------------------------------

Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest

-------------------------------------------------------------------------------

Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 2.297 sec <<< FAILURE!

test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest)  Time elapsed: 1.542 sec  <<< ERROR!

java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected

        at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108)

        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47)

        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.test(ChunkInputFormatTest.java:95)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at junit.framework.TestCase.runTest(TestCase.java:168)

        at junit.framework.TestCase.runBare(TestCase.java:134)

        at junit.framework.TestResult$1.protect(TestResult.java:110)

        at junit.framework.TestResult.runProtected(TestResult.java:128)

        at junit.framework.TestResult.run(TestResult.java:113)

        at junit.framework.TestCase.run(TestCase.java:124)

        at junit.framework.TestSuite.runTest(TestSuite.java:232)

        at junit.framework.TestSuite.run(TestSuite.java:227)

        at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:81)

        at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)

        at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)

        at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)

        at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)

        at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)

        at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)

        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)

testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest)  Time elapsed: 0.084 sec  <<< ERROR!

java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected

        at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108)

        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47)

        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.testErrorOnNextWithoutClose(ChunkInputFormatTest.java:146)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at junit.framework.TestCase.runTest(TestCase.java:168)

        at junit.framework.TestCase.runBare(TestCase.java:134)

        at junit.framework.TestResult$1.protect(TestResult.java:110)

        at junit.framework.TestResult.runProtected(TestResult.java:128)

        at junit.framework.TestResult.run(TestResult.java:113)

        at junit.framework.TestCase.run(TestCase.java:124)

        at junit.framework.TestSuite.runTest(TestSuite.java:232)

[#2]

Hi Chris!

This particular problem is caused by attempting to build Accumulo in Hadoop 1 mode against Hadoop 2 (specifically CDH4).

In the initial Cloudera integrated release of the Accumulo 1.4.x line, you still had to specify the Hadoop 2 profile via a Java system property.

Command line maven would look like this:

$> mvn -Dhadoop.profile=2.0 package

 I presume there is some way to specify this in the build options for netbeans, but I am not familiar with that particular IDE.

Alternatively, you could install our latest release, Accumulo 1.4.4-cdh4.5.0 (available from archive), which defaults to building against the Hadoop 2 profile.

It might also help to know why you're rebuilding the examples. From your other outstanding question, my guess is that you're using it as a starting point to learn about general development?

[#3]

Exactly!

I am new to netbeans as well and am not a Maven guy.

I'll see if I can use mvn -Dhadoop.profile=2.0 package.

I will be starting on my maven book in 20 minutes (sort of a machine
learning guy)

I was using the examples to be modified during training.

I will rebuild using accumulo Accumulo
1.4.4-cdh4.5.0
if
not.

Can I still use the current QuickStart VM?

appreciate your assistance Joey,

Chris

Ps. First response from Cloudera I have gotten with 4 posts

[#4]

FYI, I have moved this thread to the Accumulo board...

[#5]

@crigano I'm dropping your previous message into this thread, as well as @busbey 's since they both seem to have gotten derailed into an offline email thread.  and FWIW, there is no Joey on this thread, not sure if there is some threads getting crossed here or what.

From busbey:

Hi Chris!

If you're not already familiar with Netbeans, I'd recommend sticking with the development tools you're comfortable with.

You should check your notification settings; I know I responded to at least one of your other and I believe someone else responded to another.

-Sean

from crigano:

put the  in the IDE: mvn -Dhadoop.profile=2.0 package

Now I get completion in the IDE will not include classes from these dependencies or their transitive dependencies (unless they are among the open projects).

Please download the dependencies, or install them manually, if not available remotely.

The artifacts are:

 org.apache.hadoop:hadoop-core:jar:2.0.0-cdh4.3.0

What do you recommend Joey,

thanks,

Chris

[#6]

Hi Chris!

That definitely sounds like a problem with getting Netbeans to play nicely with Maven's dependency providing.

To avoid the drag of these kinds of tooling issues, I generally recommend people stick with whatever workflow they're used to for Java development.

Is there another IDE you are more familiar with?

-Sean

[#7]

My Bad,

I set up notifications to go to chris.p.rigano@gmail.com.

I am just trying to get a version of the CDH QuickStart with accumulo to
run for classes I am teaching and to do work outside the IC doors.

I tried both eclipse I have been using for a number of years and got the
right setting in netbeans.

Still not working as indicated in literature for examples.

This is not an ide issue but an environment problem.

I would be glad to send you my VM built IAW cloudera guidance.

It may make things easier.

Give me access to a fast FTP.

I used CDH at Meade for a while. I am a cloudera fan.

Best regards,

Chris

[#8]

Let's step back and confirm that your VM can properly see the necessary Maven repositories.

I'm using a QuickStart VM with CDH 4.4.0 and I have the Accumulo 1.4.3-cdh4.3.0 release installed from tarballs in /usr/lib/accumulo.

If I open up a terminal and navigate to the install directory, I can successfully rebuild everything including the examples.

[cloudera@localhost ~]$ sudo su - accumulo
[accumulo@localhost ~]$ cd /usr/lib/accumulo
[accumulo@localhost accumulo]$ mvn -Dhadoop.profile=2.0 package
<...snip maven downloading dependencies from the internet...>
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.accumulo.examples.simple.dirlist.CountTest
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Max depth              : 3
Time to find max depth : 7 ms
Time to compute counts : 7 ms
Entries scanned        : 30 
Counts inserted        : 4 
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.302 sec
Running org.apache.accumulo.examples.simple.filedata.KeyUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
Running org.apache.accumulo.examples.simple.filedata.ChunkInputStreamTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec
Running org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.373 sec
Running org.apache.accumulo.examples.simple.filedata.ChunkCombinerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.037 sec

Results :

Tests run: 15, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ examples-simple ---
[INFO] Building jar: /usr/lib/accumulo/lib/examples-simple-1.4.3-cdh4.3.0.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] accumulo .......................................... SUCCESS [2.171s]
[INFO] cloudtrace ........................................ SUCCESS [3.827s]
[INFO] accumulo-start .................................... SUCCESS [20.561s]
[INFO] accumulo-core ..................................... SUCCESS [59.326s]
[INFO] accumulo-server ................................... SUCCESS [1:50.049s]
[INFO] accumulo-examples ................................. SUCCESS [0.016s]
[INFO] examples-simple ................................... SUCCESS [7.369s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3:24.868s
[INFO] Finished at: Wed Feb 12 19:53:11 PST 2014
[INFO] Final Memory: 66M/168M
[INFO] ------------------------------------------------------------------------
[accumulo@localhost accumulo]$

Can you try doing the same via the commandline in your VM? If we see a failure there, it should be easier to chase down the cause.

[#9]

Can do!

R there any flags you what me to use during the build?

thanks!

Chris

[#10]

you should use the same flags I used in my example.

[#11]

Hi Sean, followed your instructions;

sudo su - accumulo 

cd /usr/lib/accumulo

mvn -Dhadoop.profile=2.0 package

Here are results:

-------------------------------------------------------
T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [43.496s]
[INFO] cloudtrace ........................................ FAILURE [35.857s]
[INFO] accumulo-start .................................... SKIPPED
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:21.951s
[INFO] Finished at: Fri Feb 14 11:20:15 PST 2014
[INFO] Final Memory: 12M/57M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :cloudtrace
[accumulo@localhost accumulo]$

Here is long version I captured:

[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:cloudtrace:jar:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-core:jar:1.4.3-cdh4.3.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.accumulo:cloudtrace:jar -> duplicate declaration of version (?) @ line 153, column 17
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-server:jar:1.4.3-cdh4.3.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.mortbay.jetty:jetty:jar -> duplicate declaration of version (?) @ line 103, column 17
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-start:jar:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-examples:pom:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo:pom:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 152, column 15
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] accumulo
[INFO] cloudtrace
[INFO] accumulo-start
[INFO] accumulo-core
[INFO] accumulo-server
[INFO] accumulo-examples
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building accumulo 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ accumulo ---
[INFO]
[INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ accumulo ---
[INFO]
[INFO] --- exec-maven-plugin:1.2:exec (user-manual) @ accumulo ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building cloudtrace 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ cloudtrace ---
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ cloudtrace ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/main/resources
[INFO]
[INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ cloudtrace ---
[INFO] log4j-1.2.16.jar already exists in destination.
[INFO] libthrift-0.6.1.jar already exists in destination.
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ cloudtrace ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloudtrace ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ cloudtrace ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ cloudtrace ---
[INFO] Surefire report directory: /usr/lib/accumulo/src/trace/target/surefire-reports

-------------------------------------------------------
T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [2.920s]
[INFO] cloudtrace ........................................ FAILURE [1.694s]
[INFO] accumulo-start .................................... SKIPPED
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.399s
[INFO] Finished at: Fri Feb 14 11:28:01 PST 2014
[INFO] Final Memory: 9M/57M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :cloudtrace

[#12]

Hi Chris!

Looks like you may have missed some steps from the installation instructions.

Can you recreate these commands and paste the results in code blocks:

[cloudera@localhost ~]$ ls -lah /usr/lib/accumulo
total 184K
drwxr-xr-x  12 accumulo accumulo 4.0K Feb 12 19:51 .
dr-xr-xr-x. 54 root     root     4.0K Feb  7 06:54 ..
drwxr-xr-x   2 accumulo accumulo 4.0K Feb  7 06:55 bin
-rw-r--r--   1 accumulo accumulo  26K Dec 18 11:32 CHANGES
drwxr-xr-x   3 accumulo accumulo 4.0K Feb  7 06:55 cloudera
drwxr-xr-x   3 accumulo accumulo 4.0K Feb 12 19:50 conf
drwxr-xr-x   2 accumulo accumulo 4.0K Feb  7 06:55 contrib
drwxr-xr-x   4 accumulo accumulo 4.0K Feb  7 06:55 docs
drwxr-xr-x   4 accumulo accumulo 4.0K Feb 12 19:50 lib
-rw-r--r--   1 accumulo accumulo  56K Dec 18 11:32 LICENSE
drwx------   2 accumulo accumulo 4.0K Feb  7 07:04 logs
-rw-r--r--   1 accumulo accumulo 2.1K Dec 18 11:32 NOTICE
-rw-r--r--   1 accumulo accumulo  31K Dec 18 11:32 pom.xml
-rw-r--r--   1 accumulo accumulo  13K Dec 18 11:32 README
drwxr-xr-x  10 accumulo accumulo 4.0K Feb  7 06:55 src
drwxrwxr-x   2 accumulo accumulo 4.0K Feb 12 19:51 target
drwxr-xr-x   5 accumulo accumulo 4.0K Feb  7 06:55 test
lrwxrwxrwx   1 root     root       11 Feb  7 08:42 walogs -> /dfs/walogs
[cloudera@localhost ~]$ ls -lah /usr/lib/accumulo/src/trace/
total 24K
drwxr-xr-x  4 accumulo accumulo 4.0K Feb 12 19:38 .
drwxr-xr-x 10 accumulo accumulo 4.0K Feb  7 06:55 ..
-rw-r--r--  1 accumulo accumulo 1.8K Dec 18 11:32 pom.xml
drwxr-xr-x  4 accumulo accumulo 4.0K Feb  7 06:55 src
drwxrwxr-x  8 accumulo accumulo 4.0K Feb 12 19:38 target
-rwxr-xr-x  1 accumulo accumulo 1.8K Dec 18 11:32 thrift.sh
[cloudera@localhost ~]$ ls -lah /var/lib/accumulo
total 40K
drwxr-xr-x   5 accumulo accumulo 4.0K Feb 12 19:34 .
drwxr-xr-x. 45 root     root     4.0K Feb  7 06:49 ..
drwxrwxr-x   2 accumulo accumulo 4.0K Feb  7 09:05 .accumulo
-rw-------   1 accumulo accumulo  824 Feb  7 08:54 .bash_history
-rw-r--r--   1 accumulo accumulo   18 Feb  7 06:50 .bash_logout
-rw-r--r--   1 accumulo accumulo  176 Feb  7 06:50 .bash_profile
-rw-r--r--   1 accumulo accumulo  288 Feb  7 08:31 .bashrc
drwxrwxr-x   3 accumulo accumulo 4.0K Feb 12 19:34 .m2
drwx------   2 accumulo accumulo 4.0K Feb  7 06:51 .ssh
-rw-------   1 accumulo accumulo 1.5K Feb 12 19:34 .viminfo
[cloudera@localhost ~]$

[#13]

This seems like an access problem ...

Poked around but wuld like the right way to gen a SSH key and set maven so I don't screw up.

[#14]

Hi Chris!

Yep, it's almost certainly a local filesystem permissions issue.

Please run the commands in my previous post. They will show the permissions at likely problem points.

-Sean

[#15]

Hi Sean,

I did it 3 times already,

But it never hurts to try again ...

I will have my wife back check me just in case ...

[#16]

Here is what we have; note I did the chmod 777 thing and made cloudera a member of accumulo group for eclipse, netbeans and cmd line development so its wide open I believe.

[accumulo@localhost ~]$ ls -lah /usr/lib/accumulo
total 192K
drwxrwxrwx 11 accumulo accumulo 4.0K Feb 14 11:31 .
dr-xr-xr-x. 55 root root 4.0K Feb 10 15:28 ..
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 bin
-rwxrwxrwx 1 accumulo accumulo 26K Dec 23 09:34 CHANGES
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 contrib
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 14:43 docs
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 14 11:16 lib
-rwxrwxrwx 1 accumulo accumulo 56K Dec 23 09:34 LICENSE
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 15:17 logs
-rwxrwxrwx 1 accumulo accumulo 2.1K Dec 23 09:34 NOTICE
-rwxrwxrwx 1 accumulo accumulo 32K Dec 23 09:34 pom.xml
-rwxrwxrwx 1 accumulo accumulo 13K Dec 23 09:34 README
drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 src
drwxrwxr-x 2 cloudera cloudera 4.0K Feb 11 06:11 target
drwxrwxrwx 5 accumulo accumulo 4.0K Dec 23 09:34 test
-rw-rw-r-- 1 accumulo accumulo 8.1K Feb 14 11:28 tmp
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 12 20:59 walogs
[accumulo@localhost ~]$

missing cloudera and config in /usr/lib/accumulo:

cloudera is at:

./.m2/repository/com/cloudera
[accumulo@localhost ~]$ find -name conf
[accumulo@localhost ~]$ ls -la ./.m2/repository/com/cloudera
total 12
drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 .
drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 ..
drwxrwxr-x 4 accumulo accumulo 4096 Feb 14 11:19 cdh
[accumulo@localhost ~]$

I BELIEVE conf is:

ls -la ./etc/accumulo/conf
lrwxrwxrwx 1 root root 31 Feb 10 15:05 ./etc/accumulo/conf -> /etc/alternatives/accumulo-conf

ls -lah /usr/lib/accumulo/src/trace/
total 24K
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 19:29 .
drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 ..
-rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 pom.xml
drwxrwxrwx 4 accumulo accumulo 4.0K Dec 23 09:34 src
drwxrwxr-x 8 cloudera cloudera 4.0K Feb 10 19:30 target
-rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 thrift.sh
[accumulo@localhost ~]$ total 24K

Checks out

drwxr-xr-x 5 accumulo accumulo 4.0K Feb 14 11:31 .
drwxr-xr-x. 43 root root 4.0K Feb 10 14:23 ..
drwxrwxr-x 2 accumulo accumulo 4.0K Feb 10 16:01 .accumulo
-rw------- 1 accumulo accumulo 2.3K Feb 14 11:35 .bash_history
-rw-r--r-- 1 accumulo accumulo 18 Feb 10 14:24 .bash_logout
-rw-r--r-- 1 accumulo accumulo 176 Feb 10 14:24 .bash_profile
-rw-r--r-- 1 accumulo accumulo 246 Feb 10 15:50 .bashrc
drwxrwxr-x 3 accumulo accumulo 4.0K Feb 14 11:17 .m2
drwx------ 2 accumulo accumulo 4.0K Feb 10 14:26 .ssh
-rw------- 1 accumulo accumulo 5.2K Feb 14 11:31 .viminfo

checks out

This is where the installation puts it. I am game to change. If I did miss something please tell me at 60 I got no ego 🙂

 only appreciation for you assistance!

[#17]

The issue here looks like you previously did a build with the cloudera user. That build added all of the target/ directories for maven with persmissions exclusive to the cloudera user (for writing). So now when the Accumulo user attempts to build, it can't write.

To fix this for now:

1. Stop Accumulo. The rest of these instructions will delete the set of jars Accumulo needs to run.
2.  As the cloudera user run these commands to clear out the directories

   [cloudera@localhost ~]$ cd /usr/lib/accumulo
   [cloudera@localhost accumulo]$ mvn -Dhadoop.profile=2.0 clean
   [INFO] Scanning for projects...
   <....skip Maven downloading the internet....>
   [INFO] ------------------------------------------------------------------------
   [INFO] Reactor Summary:
   [INFO] 
   [INFO] accumulo .......................................... SUCCESS [0.745s]
   [INFO] cloudtrace ........................................ SUCCESS [0.010s]
   [INFO] accumulo-start .................................... SUCCESS [0.005s]
   [INFO] accumulo-core ..................................... SUCCESS [0.040s]
   [INFO] accumulo-server ................................... SUCCESS [0.035s]
   [INFO] accumulo-examples ................................. SUCCESS [0.027s]
   [INFO] examples-simple ................................... SUCCESS [0.014s]
   [INFO] ------------------------------------------------------------------------
   [INFO] BUILD SUCCESS
   [INFO] ------------------------------------------------------------------------
   [INFO] Total time: 2.345s
   [INFO] Finished at: Mon Feb 17 14:51:22 PST 2014
   [INFO] Final Memory: 6M/57M
   [INFO] ------------------------------------------------------------------------
   [cloudera@localhost accumulo]$ 

3. If that fails, you might have a mix of permissions between the cloudera and accumulo user. Run the clean command from above as root.
4. Repeat the command line building from before as the accumulo user
5. Start Accumulo again

To fix this sustainably, you need to separate out building things from deploying them. This is especially true if you want to use a graphic IDE as the cloudera user. To do that, I'd recommend

1. Place the code you want to work on somewhere for the cloudera user to interact with. I generally do this in a subdirectory of the home directory.

   [cloudera@localhost ~]$ mkdir -p projects/accumulo
   [cloudera@localhost ~]$ tar -C projects/accumulo --strip=1 -xzf accumulo-1.4.3-cdh4.3.0-dist.tar.gz 
   [cloudera@localhost ~]$ cd projects/accumulo/
   [cloudera@localhost accumulo]$ ls -a
   .  ..  bin  CHANGES  cloudera  conf  contrib  docs  lib  LICENSE  logs  NOTICE  pom.xml  README  src  test  walogs
   [cloudera@localhost accumulo]$ 

2. Out of habit, I would track whatever changes happen locally

   [cloudera@localhost accumulo]$ git config --global user.name "Sean Busbey"
   [cloudera@localhost accumulo]$ git config --global user.email "busbey@cloudera.com"
   [cloudera@localhost accumulo]$ git init
   Initialized empty Git repository in /home/cloudera/projects/accumulo/.git/
   [cloudera@localhost accumulo]$ git commit --allow-empty -m "Initial commit"
   [master (root-commit) 6943bc0] Initial commit
   [cloudera@localhost accumulo]$ git add *
   [cloudera@localhost accumulo]$ git commit -m "Cloudera release 1.4.3-cdh4.3.0"
   [master b4a9911] Cloudera release 1.4.3-cdh4.3.0
    1551 files changed, 338162 insertions(+), 0 deletions(-)
   <.... skip 1551 file paths ....>
   [cloudera@localhost accumulo]$ git status
   # On branch master
   nothing to commit (working directory clean)
   [cloudera@localhost accumulo]$ git log
   commit b4a99119da3de3f9445b793ebd338dcbb310ace3
   Author: Sean Busbey <busbey@cloudera.com>
   Date:   Mon Feb 17 15:05:50 2014 -0800
   
       Cloudera release 1.4.3-cdh4.3.0
   
   commit 6943bc00904b42c5ee6aec472e963f0188433267
   Author: Sean Busbey <busbey@cloudera.com>
   Date:   Mon Feb 17 15:05:30 2014 -0800
   
       Initial commit
   [cloudera@localhost accumulo]$ 

3. Build however you're going to build (IDE or commandline). As an example, I would build via commandline maven.

   [cloudera@localhost accumulo]$ mvn -Dhadoop.profile=2.0 package
   [INFO] Scanning for projects...
   [WARNING] 
   <.... Skip warnings about plugin versions ....>
   [INFO] ------------------------------------------------------------------------
   [INFO] Reactor Build Order:
   [INFO] 
   [INFO] accumulo
   [INFO] cloudtrace
   [INFO] accumulo-start
   [INFO] accumulo-core
   [INFO] accumulo-server
   [INFO] accumulo-examples
   [INFO] examples-simple
   [INFO]                                                                         
   [INFO] ------------------------------------------------------------------------
   [INFO] Building accumulo 1.4.3-cdh4.3.0
   [INFO] ------------------------------------------------------------------------
   <.... skip maven downloading the internet ....>
   [INFO] ------------------------------------------------------------------------
   [INFO] Reactor Summary:
   [INFO] 
   [INFO] accumulo .......................................... SUCCESS [3:11.272s]
   [INFO] cloudtrace ........................................ SUCCESS [1:58.342s]
   [INFO] accumulo-start .................................... SUCCESS [4:35.473s]
   [INFO] accumulo-core ..................................... SUCCESS [59.175s]
   [INFO] accumulo-server ................................... SUCCESS [1:53.334s]
   [INFO] accumulo-examples ................................. SUCCESS [0.009s]
   [INFO] examples-simple ................................... SUCCESS [7.238s]
   [INFO] ------------------------------------------------------------------------
   [INFO] BUILD SUCCESS
   [INFO] ------------------------------------------------------------------------
   [INFO] Total time: 12:46.212s
   [INFO] Finished at: Mon Feb 17 15:21:16 PST 2014
   [INFO] Final Memory: 80M/192M
   [INFO] ------------------------------------------------------------------------
   [cloudera@localhost accumulo]$

4. When you need to deploy the jars into your accumulo instance: replace the Accumulo deployment jars with those from the working directory and restart Accumulo (all with the accumulo user).

   [cloudera@localhost accumulo]$ sudo -u accumulo rm -f /usr/lib/accumulo/lib/*.jar
   [cloudera@localhost accumulo]$ sudo -u accumulo cp lib/*.jar /usr/lib/accumulo/lib/
   [cloudera@localhost accumulo]$ sudo su - accumulo
   [accumulo@localhost ~]$ $ACCUMULO_HOME/bin/stop-all.sh
   ^CInvalid password or unable to connect to the master
   Press Ctrl-C to cancel now, or force shutdown in 15 seconds
   Utilities and unresponsive servers will be shut down in 5 seconds
   stopping monitor on localhost.localdomain
   stopping tracer on localhost.localdomain
   stopping monitor on localhost.localdomain
   stopping unresponsive tablet servers (if any) ...
   stopping unresponsive tablet servers hard (if any) ...
   Cleaning tablet server and logger entries from zookeeper
   Cleaning all server entries in zookeeper
   [accumulo@localhost ~]$ $ACCUMULO_HOME/bin/start-all.sh
   Starting tablet servers and loggers .... done
   Starting tablet server on localhost.localdomain
   Starting logger on localhost.localdomain
   2014-02-17 15:34:41,763 [server.Accumulo] INFO : Attempting to talk to zookeeper
   2014-02-17 15:34:42,136 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
   2014-02-17 15:34:47,210 [server.Accumulo] INFO : Connected to HDFS
   Starting master on localhost.localdomain
   Starting garbage collector on localhost.localdomain
   Starting monitor on localhost.localdomain
   Starting tracer on localhost.localdomain
   [accumulo@localhost ~]$ exit
   logout
   [cloudera@localhost accumulo]$

Note that this process is only needed because you're altering the jars that make up Accumulo itself. Under normal operations, you should not be altering this source nor copying jars into Accumulo's installation. Any jars you need, either for client side applications or for a custom iterator, should be deployed in their own location and referenced as appropriate from your client or server classpaths.

[#18 · Accepted solution]

Cleaned up as Root.

As accumulo executed:

Test results failed:mvn -Dhadoop.profile=2.0 package

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.accumulo.start.Test
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE!

Results :

Tests in error:
testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory)

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [3.794s]
[INFO] cloudtrace ........................................ SUCCESS [11.847s]
[INFO] accumulo-start .................................... FAILURE [1:54.079s]
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:11.538s
[INFO] Finished at: Tue Feb 18 23:24:34 PST 2014
[INFO] Final Memory: 34M/83M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures.
[ERROR]
[ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :accumulo-start
[accumulo@localhost accumulo]$ whoami
accumulo
[accumulo@localhost accumulo]$

[#19]

Your accumulo installation does not have the example configuration directories. ($ACCUMULO_HOME/conf/examples).

Looking at our docs I see we tell people to move the conf directory to set up initial configs, probably on the assumption that people won't be rebuilding. I'll file an internal ticket to get that corrected.

In the mean time, I'd recommend restoring the $ACCUMULO_HOME/conf directory from the dist tarball.