Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest

avatar
Explorer
Greetings to all esteem colleague,
 
Following indicate a build failure for accumulo-examples indicating  the failure of Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.
 
I would very much appreciate advice on actions to take in detail that would resolve this issue.
 
The environment is accumulo-1.4.3, CDH4.3 QuickStart using netbeans to import the maven project  accumulo-examples after installing accumulo from the accumulo-1.4.3cdh4.3.tar.gz.
 
The VM is available upon request.
 
Cloudera has not responded in there news groups.
 
In advance thanks for your assistance.
 
The results of executing the build with dependencies option are listed below:
 
cd /usr/lib/accumulo/src/examples/simple; JAVA_HOME=/usr/java/jdk1.6.0_32 /home/cloudera/netbeans-7.4/java/maven/bin/mvn install
Scanning for projects...
 
Some problems were encountered while building the effective model for org.apache.accumulo:examples-simple:jar:1.4.3-cdh4.3.0
'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
 
It is highly recommended to fix these problems because they threaten the stability of your build.
 
For this reason, future Maven versions might no longer support building such malformed projects.
 
                                                                        
------------------------------------------------------------------------
Building examples-simple 1.4.3-cdh4.3.0
------------------------------------------------------------------------
 
--- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ examples-simple ---
 
--- maven-resources-plugin:2.5:resources (default-resources) @ examples-simple ---
[debug] execute contextualize
Using 'UTF-8' encoding to copy filtered resources.
skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/main/resources
 
--- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ examples-simple ---
log4j-1.2.16.jar already exists in destination.
 
--- maven-compiler-plugin:2.3.2:compile (default-compile) @ examples-simple ---
Compiling 40 source files to /usr/lib/accumulo/src/examples/simple/target/classes
 
--- maven-resources-plugin:2.5:testResources (default-testResources) @ examples-simple ---
[debug] execute contextualize
Using 'UTF-8' encoding to copy filtered resources.
skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/test/resources
 
--- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ examples-simple ---
Compiling 5 source files to /usr/lib/accumulo/src/examples/simple/target/test-classes
 
--- maven-surefire-plugin:2.9:test (default-test) @ examples-simple ---
Surefire report directory: /usr/lib/accumulo/src/examples/simple/target/surefire-reports
 
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest
Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.89 sec <<< FAILURE!
Running org.apache.accumulo.examples.simple.filedata.ChunkCombinerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec
Running org.apache.accumulo.examples.simple.filedata.ChunkInputStreamTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec
Running org.apache.accumulo.examples.simple.filedata.KeyUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.apache.accumulo.examples.simple.dirlist.CountTest
Max depth              : 3
Time to find max depth : 2 ms
Time to compute counts : 7 ms
Entries scanned        : 30 
Counts inserted        : 4 
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec
 
Results :
 
Tests in error: 
  test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
  testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
  testInfoWithoutChunks(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
 
Tests run: 15, Failures: 0, Errors: 3, Skipped: 0
 
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 17.620s
Finished at: Tue Feb 11 14:34:18 PST 2014
Final Memory: 20M/57M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project examples-simple: There are test failures.
 
Please refer to /usr/lib/accumulo/src/examples/simple/target/surefire-reports for the individual test results.
-> [Help 1]
 
To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.
 
For more information about the errors and possible solutions, please read the following articles:
-> [Help 1]
==============================================================================
 
Following is: The results of the failed report in  "/usr/lib/accumulo/src/examples/simple/target/surefire-reports"
 
-------------------------------------------------------------------------------
Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest
-------------------------------------------------------------------------------
Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 2.297 sec <<< FAILURE!
test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest)  Time elapsed: 1.542 sec  <<< ERROR!
java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
        at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.test(ChunkInputFormatTest.java:95)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at junit.framework.TestCase.runTest(TestCase.java:168)
        at junit.framework.TestCase.runBare(TestCase.java:134)
        at junit.framework.TestResult$1.protect(TestResult.java:110)
        at junit.framework.TestResult.runProtected(TestResult.java:128)
        at junit.framework.TestResult.run(TestResult.java:113)
        at junit.framework.TestCase.run(TestCase.java:124)
        at junit.framework.TestSuite.runTest(TestSuite.java:232)
        at junit.framework.TestSuite.run(TestSuite.java:227)
        at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:81)
        at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)
        at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
        at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
        at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
        at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest)  Time elapsed: 0.084 sec  <<< ERROR!
java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
        at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.testErrorOnNextWithoutClose(ChunkInputFormatTest.java:146)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at junit.framework.TestCase.runTest(TestCase.java:168)
        at junit.framework.TestCase.runBare(TestCase.java:134)
        at junit.framework.TestResult$1.protect(TestResult.java:110)
        at junit.framework.TestResult.runProtected(TestResult.java:128)
        at junit.framework.TestResult.run(TestResult.java:113)
        at junit.framework.TestCase.run(TestCase.java:124)
        at junit.framework.TestSuite.runTest(TestSuite.java:232)
1 ACCEPTED SOLUTION

avatar
Explorer

Cleaned up as Root.

 

As accumulo executed:

 

Test results failed:mvn -Dhadoop.profile=2.0 package

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.accumulo.start.Test
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE!

Results :

Tests in error:
testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory)

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [3.794s]
[INFO] cloudtrace ........................................ SUCCESS [11.847s]
[INFO] accumulo-start .................................... FAILURE [1:54.079s]
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:11.538s
[INFO] Finished at: Tue Feb 18 23:24:34 PST 2014
[INFO] Final Memory: 34M/83M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures.
[ERROR]
[ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :accumulo-start
[accumulo@localhost accumulo]$ whoami
accumulo
[accumulo@localhost accumulo]$

View solution in original post

18 REPLIES 18

avatar
Explorer

Hi Sean, followed your instructions;

 

sudo su - accumulo 

 

cd /usr/lib/accumulo

 

mvn -Dhadoop.profile=2.0 package

 

Here are results:

 

-------------------------------------------------------
T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [43.496s]
[INFO] cloudtrace ........................................ FAILURE [35.857s]
[INFO] accumulo-start .................................... SKIPPED
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:21.951s
[INFO] Finished at: Fri Feb 14 11:20:15 PST 2014
[INFO] Final Memory: 12M/57M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :cloudtrace
[accumulo@localhost accumulo]$

 

Here is long version I captured:

[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:cloudtrace:jar:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-core:jar:1.4.3-cdh4.3.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.accumulo:cloudtrace:jar -> duplicate declaration of version (?) @ line 153, column 17
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-server:jar:1.4.3-cdh4.3.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.mortbay.jetty:jetty:jar -> duplicate declaration of version (?) @ line 103, column 17
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-start:jar:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-examples:pom:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo:pom:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 152, column 15
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] accumulo
[INFO] cloudtrace
[INFO] accumulo-start
[INFO] accumulo-core
[INFO] accumulo-server
[INFO] accumulo-examples
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building accumulo 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ accumulo ---
[INFO]
[INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ accumulo ---
[INFO]
[INFO] --- exec-maven-plugin:1.2:exec (user-manual) @ accumulo ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building cloudtrace 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ cloudtrace ---
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ cloudtrace ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/main/resources
[INFO]
[INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ cloudtrace ---
[INFO] log4j-1.2.16.jar already exists in destination.
[INFO] libthrift-0.6.1.jar already exists in destination.
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ cloudtrace ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloudtrace ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ cloudtrace ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ cloudtrace ---
[INFO] Surefire report directory: /usr/lib/accumulo/src/trace/target/surefire-reports

-------------------------------------------------------
T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [2.920s]
[INFO] cloudtrace ........................................ FAILURE [1.694s]
[INFO] accumulo-start .................................... SKIPPED
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.399s
[INFO] Finished at: Fri Feb 14 11:28:01 PST 2014
[INFO] Final Memory: 9M/57M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :cloudtrace

 

 

avatar
Expert Contributor

Hi Chris!

 

Looks like you may have missed some steps from the installation instructions.

 

Can you recreate these commands and paste the results in code blocks:

 

[cloudera@localhost ~]$ ls -lah /usr/lib/accumulo
total 184K
drwxr-xr-x  12 accumulo accumulo 4.0K Feb 12 19:51 .
dr-xr-xr-x. 54 root     root     4.0K Feb  7 06:54 ..
drwxr-xr-x   2 accumulo accumulo 4.0K Feb  7 06:55 bin
-rw-r--r--   1 accumulo accumulo  26K Dec 18 11:32 CHANGES
drwxr-xr-x   3 accumulo accumulo 4.0K Feb  7 06:55 cloudera
drwxr-xr-x   3 accumulo accumulo 4.0K Feb 12 19:50 conf
drwxr-xr-x   2 accumulo accumulo 4.0K Feb  7 06:55 contrib
drwxr-xr-x   4 accumulo accumulo 4.0K Feb  7 06:55 docs
drwxr-xr-x   4 accumulo accumulo 4.0K Feb 12 19:50 lib
-rw-r--r--   1 accumulo accumulo  56K Dec 18 11:32 LICENSE
drwx------   2 accumulo accumulo 4.0K Feb  7 07:04 logs
-rw-r--r--   1 accumulo accumulo 2.1K Dec 18 11:32 NOTICE
-rw-r--r--   1 accumulo accumulo  31K Dec 18 11:32 pom.xml
-rw-r--r--   1 accumulo accumulo  13K Dec 18 11:32 README
drwxr-xr-x  10 accumulo accumulo 4.0K Feb  7 06:55 src
drwxrwxr-x   2 accumulo accumulo 4.0K Feb 12 19:51 target
drwxr-xr-x   5 accumulo accumulo 4.0K Feb  7 06:55 test
lrwxrwxrwx   1 root     root       11 Feb  7 08:42 walogs -> /dfs/walogs
[cloudera@localhost ~]$ ls -lah /usr/lib/accumulo/src/trace/
total 24K
drwxr-xr-x  4 accumulo accumulo 4.0K Feb 12 19:38 .
drwxr-xr-x 10 accumulo accumulo 4.0K Feb  7 06:55 ..
-rw-r--r--  1 accumulo accumulo 1.8K Dec 18 11:32 pom.xml
drwxr-xr-x  4 accumulo accumulo 4.0K Feb  7 06:55 src
drwxrwxr-x  8 accumulo accumulo 4.0K Feb 12 19:38 target
-rwxr-xr-x  1 accumulo accumulo 1.8K Dec 18 11:32 thrift.sh
[cloudera@localhost ~]$ ls -lah /var/lib/accumulo
total 40K
drwxr-xr-x   5 accumulo accumulo 4.0K Feb 12 19:34 .
drwxr-xr-x. 45 root     root     4.0K Feb  7 06:49 ..
drwxrwxr-x   2 accumulo accumulo 4.0K Feb  7 09:05 .accumulo
-rw-------   1 accumulo accumulo  824 Feb  7 08:54 .bash_history
-rw-r--r--   1 accumulo accumulo   18 Feb  7 06:50 .bash_logout
-rw-r--r--   1 accumulo accumulo  176 Feb  7 06:50 .bash_profile
-rw-r--r--   1 accumulo accumulo  288 Feb  7 08:31 .bashrc
drwxrwxr-x   3 accumulo accumulo 4.0K Feb 12 19:34 .m2
drwx------   2 accumulo accumulo 4.0K Feb  7 06:51 .ssh
-rw-------   1 accumulo accumulo 1.5K Feb 12 19:34 .viminfo
[cloudera@localhost ~]$

 

avatar
Explorer

This seems like an access problem ...

 

Poked around but wuld like the right way to gen a SSH key and set maven so I don't screw up.

avatar
Expert Contributor

Hi Chris!

 

Yep, it's almost certainly a local filesystem permissions issue.

 

Please run the commands in my previous post. They will show the permissions at likely problem points.

 

-Sean

avatar
Explorer

Hi Sean,

 

I did it 3 times already,

 

But it never hurts to try again ...

 

I will have my wife back check me just in case ...

avatar
Explorer

Here is what we have; note I did the chmod 777 thing and made cloudera a member of accumulo group for eclipse, netbeans and cmd line development so its wide open I believe.

 

[accumulo@localhost ~]$ ls -lah /usr/lib/accumulo
total 192K
drwxrwxrwx 11 accumulo accumulo 4.0K Feb 14 11:31 .
dr-xr-xr-x. 55 root root 4.0K Feb 10 15:28 ..
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 bin
-rwxrwxrwx 1 accumulo accumulo 26K Dec 23 09:34 CHANGES
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 contrib
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 14:43 docs
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 14 11:16 lib
-rwxrwxrwx 1 accumulo accumulo 56K Dec 23 09:34 LICENSE
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 15:17 logs
-rwxrwxrwx 1 accumulo accumulo 2.1K Dec 23 09:34 NOTICE
-rwxrwxrwx 1 accumulo accumulo 32K Dec 23 09:34 pom.xml
-rwxrwxrwx 1 accumulo accumulo 13K Dec 23 09:34 README
drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 src
drwxrwxr-x 2 cloudera cloudera 4.0K Feb 11 06:11 target
drwxrwxrwx 5 accumulo accumulo 4.0K Dec 23 09:34 test
-rw-rw-r-- 1 accumulo accumulo 8.1K Feb 14 11:28 tmp
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 12 20:59 walogs
[accumulo@localhost ~]$

 

missing cloudera and config in /usr/lib/accumulo:

 

cloudera is at:

./.m2/repository/com/cloudera
[accumulo@localhost ~]$ find -name conf
[accumulo@localhost ~]$ ls -la ./.m2/repository/com/cloudera
total 12
drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 .
drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 ..
drwxrwxr-x 4 accumulo accumulo 4096 Feb 14 11:19 cdh
[accumulo@localhost ~]$

 

I BELIEVE conf is:

ls -la ./etc/accumulo/conf
lrwxrwxrwx 1 root root 31 Feb 10 15:05 ./etc/accumulo/conf -> /etc/alternatives/accumulo-conf

 

ls -lah /usr/lib/accumulo/src/trace/
total 24K
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 19:29 .
drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 ..
-rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 pom.xml
drwxrwxrwx 4 accumulo accumulo 4.0K Dec 23 09:34 src
drwxrwxr-x 8 cloudera cloudera 4.0K Feb 10 19:30 target
-rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 thrift.sh
[accumulo@localhost ~]$ total 24K

 

Checks out

 

drwxr-xr-x 5 accumulo accumulo 4.0K Feb 14 11:31 .
drwxr-xr-x. 43 root root 4.0K Feb 10 14:23 ..
drwxrwxr-x 2 accumulo accumulo 4.0K Feb 10 16:01 .accumulo
-rw------- 1 accumulo accumulo 2.3K Feb 14 11:35 .bash_history
-rw-r--r-- 1 accumulo accumulo 18 Feb 10 14:24 .bash_logout
-rw-r--r-- 1 accumulo accumulo 176 Feb 10 14:24 .bash_profile
-rw-r--r-- 1 accumulo accumulo 246 Feb 10 15:50 .bashrc
drwxrwxr-x 3 accumulo accumulo 4.0K Feb 14 11:17 .m2
drwx------ 2 accumulo accumulo 4.0K Feb 10 14:26 .ssh
-rw------- 1 accumulo accumulo 5.2K Feb 14 11:31 .viminfo

 

checks out

 

This is where the installation puts it. I am game to change. If I did miss something please tell me at 60 I got no ego 🙂

 only appreciation for you assistance!

avatar
Expert Contributor

The issue here looks like you previously did a build with the cloudera user. That build added all of the target/ directories for maven with persmissions exclusive to the cloudera user (for writing). So now when the Accumulo user attempts to build, it can't write.

 

To fix this for now:

 

  1. Stop Accumulo. The rest of these instructions will delete the set of jars Accumulo needs to run.
  2.  As the cloudera user run these commands to clear out the directories
    [cloudera@localhost ~]$ cd /usr/lib/accumulo
    [cloudera@localhost accumulo]$ mvn -Dhadoop.profile=2.0 clean
    [INFO] Scanning for projects...
    <....skip Maven downloading the internet....>
    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Summary:
    [INFO] 
    [INFO] accumulo .......................................... SUCCESS [0.745s]
    [INFO] cloudtrace ........................................ SUCCESS [0.010s]
    [INFO] accumulo-start .................................... SUCCESS [0.005s]
    [INFO] accumulo-core ..................................... SUCCESS [0.040s]
    [INFO] accumulo-server ................................... SUCCESS [0.035s]
    [INFO] accumulo-examples ................................. SUCCESS [0.027s]
    [INFO] examples-simple ................................... SUCCESS [0.014s]
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD SUCCESS
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 2.345s
    [INFO] Finished at: Mon Feb 17 14:51:22 PST 2014
    [INFO] Final Memory: 6M/57M
    [INFO] ------------------------------------------------------------------------
    [cloudera@localhost accumulo]$ 

     

  3. If that fails, you might have a mix of permissions between the cloudera and accumulo user. Run the clean command from above as root.
  4. Repeat the command line building from before as the accumulo user
  5. Start Accumulo again

 

To fix this sustainably, you need to separate out building things from deploying them. This is especially true if you want to use a graphic IDE as the cloudera user. To do that, I'd recommend

 

  1. Place the code you want to work on somewhere for the cloudera user to interact with. I generally do this in a subdirectory of the home directory.
    [cloudera@localhost ~]$ mkdir -p projects/accumulo
    [cloudera@localhost ~]$ tar -C projects/accumulo --strip=1 -xzf accumulo-1.4.3-cdh4.3.0-dist.tar.gz 
    [cloudera@localhost ~]$ cd projects/accumulo/
    [cloudera@localhost accumulo]$ ls -a
    .  ..  bin  CHANGES  cloudera  conf  contrib  docs  lib  LICENSE  logs  NOTICE  pom.xml  README  src  test  walogs
    [cloudera@localhost accumulo]$ 
  2. Out of habit, I would track whatever changes happen locally
    [cloudera@localhost accumulo]$ git config --global user.name "Sean Busbey"
    [cloudera@localhost accumulo]$ git config --global user.email "busbey@cloudera.com"
    [cloudera@localhost accumulo]$ git init
    Initialized empty Git repository in /home/cloudera/projects/accumulo/.git/
    [cloudera@localhost accumulo]$ git commit --allow-empty -m "Initial commit"
    [master (root-commit) 6943bc0] Initial commit
    [cloudera@localhost accumulo]$ git add *
    [cloudera@localhost accumulo]$ git commit -m "Cloudera release 1.4.3-cdh4.3.0"
    [master b4a9911] Cloudera release 1.4.3-cdh4.3.0
     1551 files changed, 338162 insertions(+), 0 deletions(-)
    <.... skip 1551 file paths ....>
    [cloudera@localhost accumulo]$ git status
    # On branch master
    nothing to commit (working directory clean)
    [cloudera@localhost accumulo]$ git log
    commit b4a99119da3de3f9445b793ebd338dcbb310ace3
    Author: Sean Busbey <busbey@cloudera.com>
    Date:   Mon Feb 17 15:05:50 2014 -0800
    
        Cloudera release 1.4.3-cdh4.3.0
    
    commit 6943bc00904b42c5ee6aec472e963f0188433267
    Author: Sean Busbey <busbey@cloudera.com>
    Date:   Mon Feb 17 15:05:30 2014 -0800
    
        Initial commit
    [cloudera@localhost accumulo]$ 
  3. Build however you're going to build (IDE or commandline). As an example, I would build via commandline maven.
    [cloudera@localhost accumulo]$ mvn -Dhadoop.profile=2.0 package
    [INFO] Scanning for projects...
    [WARNING] 
    <.... Skip warnings about plugin versions ....>
    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Build Order:
    [INFO] 
    [INFO] accumulo
    [INFO] cloudtrace
    [INFO] accumulo-start
    [INFO] accumulo-core
    [INFO] accumulo-server
    [INFO] accumulo-examples
    [INFO] examples-simple
    [INFO]                                                                         
    [INFO] ------------------------------------------------------------------------
    [INFO] Building accumulo 1.4.3-cdh4.3.0
    [INFO] ------------------------------------------------------------------------
    <.... skip maven downloading the internet ....>
    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Summary:
    [INFO] 
    [INFO] accumulo .......................................... SUCCESS [3:11.272s]
    [INFO] cloudtrace ........................................ SUCCESS [1:58.342s]
    [INFO] accumulo-start .................................... SUCCESS [4:35.473s]
    [INFO] accumulo-core ..................................... SUCCESS [59.175s]
    [INFO] accumulo-server ................................... SUCCESS [1:53.334s]
    [INFO] accumulo-examples ................................. SUCCESS [0.009s]
    [INFO] examples-simple ................................... SUCCESS [7.238s]
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD SUCCESS
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 12:46.212s
    [INFO] Finished at: Mon Feb 17 15:21:16 PST 2014
    [INFO] Final Memory: 80M/192M
    [INFO] ------------------------------------------------------------------------
    [cloudera@localhost accumulo]$
  4. When you need to deploy the jars into your accumulo instance: replace the Accumulo deployment jars with those from the working directory and restart Accumulo (all with the accumulo user).
    [cloudera@localhost accumulo]$ sudo -u accumulo rm -f /usr/lib/accumulo/lib/*.jar
    [cloudera@localhost accumulo]$ sudo -u accumulo cp lib/*.jar /usr/lib/accumulo/lib/
    [cloudera@localhost accumulo]$ sudo su - accumulo
    [accumulo@localhost ~]$ $ACCUMULO_HOME/bin/stop-all.sh
    ^CInvalid password or unable to connect to the master
    Press Ctrl-C to cancel now, or force shutdown in 15 seconds
    Utilities and unresponsive servers will be shut down in 5 seconds
    stopping monitor on localhost.localdomain
    stopping tracer on localhost.localdomain
    stopping monitor on localhost.localdomain
    stopping unresponsive tablet servers (if any) ...
    stopping unresponsive tablet servers hard (if any) ...
    Cleaning tablet server and logger entries from zookeeper
    Cleaning all server entries in zookeeper
    [accumulo@localhost ~]$ $ACCUMULO_HOME/bin/start-all.sh
    Starting tablet servers and loggers .... done
    Starting tablet server on localhost.localdomain
    Starting logger on localhost.localdomain
    2014-02-17 15:34:41,763 [server.Accumulo] INFO : Attempting to talk to zookeeper
    2014-02-17 15:34:42,136 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
    2014-02-17 15:34:47,210 [server.Accumulo] INFO : Connected to HDFS
    Starting master on localhost.localdomain
    Starting garbage collector on localhost.localdomain
    Starting monitor on localhost.localdomain
    Starting tracer on localhost.localdomain
    [accumulo@localhost ~]$ exit
    logout
    [cloudera@localhost accumulo]$

     

Note that this process is only needed because you're altering the jars that make up Accumulo itself. Under normal operations, you should not be altering this source nor copying jars into Accumulo's installation. Any jars you need, either for client side applications or for a custom iterator, should be deployed in their own location and referenced as appropriate from your client or server classpaths.

avatar
Explorer

Cleaned up as Root.

 

As accumulo executed:

 

Test results failed:mvn -Dhadoop.profile=2.0 package

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.accumulo.start.Test
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE!

Results :

Tests in error:
testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory)

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [3.794s]
[INFO] cloudtrace ........................................ SUCCESS [11.847s]
[INFO] accumulo-start .................................... FAILURE [1:54.079s]
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:11.538s
[INFO] Finished at: Tue Feb 18 23:24:34 PST 2014
[INFO] Final Memory: 34M/83M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures.
[ERROR]
[ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :accumulo-start
[accumulo@localhost accumulo]$ whoami
accumulo
[accumulo@localhost accumulo]$

avatar
Expert Contributor

Your accumulo installation does not have the example configuration directories. ($ACCUMULO_HOME/conf/examples).

 

Looking at our docs I see we tell people to move the conf directory to set up initial configs, probably on the assumption that people won't be rebuilding. I'll file an internal ticket to get that corrected.

 

In the mean time, I'd recommend restoring the $ACCUMULO_HOME/conf directory from the dist tarball.