Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Solved Go to solution

Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest

avatar
author-rank crigano
Explorer

Created on ‎02-11-2014 03:40 PM - edited ‎09-16-2022 01:53 AM

Greetings to all esteem colleague,
 
Following indicate a build failure for accumulo-examples indicating  the failure of Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.
 
I would very much appreciate advice on actions to take in detail that would resolve this issue.
 
The environment is accumulo-1.4.3, CDH4.3 QuickStart using netbeans to import the maven project  accumulo-examples after installing accumulo from the accumulo-1.4.3cdh4.3.tar.gz.
 
The VM is available upon request.
 
Cloudera has not responded in there news groups.
 
In advance thanks for your assistance.
 
The results of executing the build with dependencies option are listed below:
 
cd /usr/lib/accumulo/src/examples/simple; JAVA_HOME=/usr/java/jdk1.6.0_32 /home/cloudera/netbeans-7.4/java/maven/bin/mvn install
Scanning for projects...
 
Some problems were encountered while building the effective model for org.apache.accumulo:examples-simple:jar:1.4.3-cdh4.3.0
'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
 
It is highly recommended to fix these problems because they threaten the stability of your build.
 
For this reason, future Maven versions might no longer support building such malformed projects.
 
                                                                        
------------------------------------------------------------------------
Building examples-simple 1.4.3-cdh4.3.0
------------------------------------------------------------------------
 
--- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ examples-simple ---
 
--- maven-resources-plugin:2.5:resources (default-resources) @ examples-simple ---
[debug] execute contextualize
Using 'UTF-8' encoding to copy filtered resources.
skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/main/resources
 
--- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ examples-simple ---
log4j-1.2.16.jar already exists in destination.
 
--- maven-compiler-plugin:2.3.2:compile (default-compile) @ examples-simple ---
Compiling 40 source files to /usr/lib/accumulo/src/examples/simple/target/classes
 
--- maven-resources-plugin:2.5:testResources (default-testResources) @ examples-simple ---
[debug] execute contextualize
Using 'UTF-8' encoding to copy filtered resources.
skip non existing resourceDirectory /usr/lib/accumulo/src/examples/simple/src/test/resources
 
--- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ examples-simple ---
Compiling 5 source files to /usr/lib/accumulo/src/examples/simple/target/test-classes
 
--- maven-surefire-plugin:2.9:test (default-test) @ examples-simple ---
Surefire report directory: /usr/lib/accumulo/src/examples/simple/target/surefire-reports
 
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest
Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 1.89 sec <<< FAILURE!
Running org.apache.accumulo.examples.simple.filedata.ChunkCombinerTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec
Running org.apache.accumulo.examples.simple.filedata.ChunkInputStreamTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec
Running org.apache.accumulo.examples.simple.filedata.KeyUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
Running org.apache.accumulo.examples.simple.dirlist.CountTest
Max depth              : 3
Time to find max depth : 2 ms
Time to compute counts : 7 ms
Entries scanned        : 30 
Counts inserted        : 4 
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec
 
Results :
 
Tests in error: 
  test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
  testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
  testInfoWithoutChunks(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest): Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
 
Tests run: 15, Failures: 0, Errors: 3, Skipped: 0
 
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 17.620s
Finished at: Tue Feb 11 14:34:18 PST 2014
Final Memory: 20M/57M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project examples-simple: There are test failures.
 
Please refer to /usr/lib/accumulo/src/examples/simple/target/surefire-reports for the individual test results.
-> [Help 1]
 
To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.
 
For more information about the errors and possible solutions, please read the following articles:
-> [Help 1]
==============================================================================
 
Following is: The results of the failed report in  "/usr/lib/accumulo/src/examples/simple/target/surefire-reports"
 
-------------------------------------------------------------------------------
Test set: org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest
-------------------------------------------------------------------------------
Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 2.297 sec <<< FAILURE!
test(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest)  Time elapsed: 1.542 sec  <<< ERROR!
java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
        at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.test(ChunkInputFormatTest.java:95)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at junit.framework.TestCase.runTest(TestCase.java:168)
        at junit.framework.TestCase.runBare(TestCase.java:134)
        at junit.framework.TestResult$1.protect(TestResult.java:110)
        at junit.framework.TestResult.runProtected(TestResult.java:128)
        at junit.framework.TestResult.run(TestResult.java:113)
        at junit.framework.TestCase.run(TestCase.java:124)
        at junit.framework.TestSuite.runTest(TestSuite.java:232)
        at junit.framework.TestSuite.run(TestSuite.java:227)
        at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:81)
        at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
        at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)
        at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)
        at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)
        at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:172)
        at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:104)
        at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:70)
testErrorOnNextWithoutClose(org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest)  Time elapsed: 0.084 sec  <<< ERROR!
java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
        at org.apache.accumulo.core.client.mapreduce.InputFormatBase$RecordReaderBase.initialize(InputFormatBase.java:1108)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormat$1.initialize(ChunkInputFormat.java:47)
        at org.apache.accumulo.examples.simple.filedata.ChunkInputFormatTest.testErrorOnNextWithoutClose(ChunkInputFormatTest.java:146)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at junit.framework.TestCase.runTest(TestCase.java:168)
        at junit.framework.TestCase.runBare(TestCase.java:134)
        at junit.framework.TestResult$1.protect(TestResult.java:110)
        at junit.framework.TestResult.runProtected(TestResult.java:128)
        at junit.framework.TestResult.run(TestResult.java:113)
        at junit.framework.TestCase.run(TestCase.java:124)
        at junit.framework.TestSuite.runTest(TestSuite.java:232)
8,036 Views
0 Kudos
1 ACCEPTED SOLUTION

avatar
author-rank crigano
Explorer

Created ‎02-19-2014 10:28 AM

Cleaned up as Root.

 

As accumulo executed:

 

Test results failed:mvn -Dhadoop.profile=2.0 package

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.accumulo.start.Test
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE!

Results :

Tests in error:
testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory)

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [3.794s]
[INFO] cloudtrace ........................................ SUCCESS [11.847s]
[INFO] accumulo-start .................................... FAILURE [1:54.079s]
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:11.538s
[INFO] Finished at: Tue Feb 18 23:24:34 PST 2014
[INFO] Final Memory: 34M/83M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures.
[ERROR]
[ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :accumulo-start
[accumulo@localhost accumulo]$ whoami
accumulo
[accumulo@localhost accumulo]$

View solution in original post

8,799 Views
0 Kudos
18 REPLIES 18

avatar
author-rank crigano
Explorer

Created ‎02-14-2014 10:37 AM

Hi Sean, followed your instructions;

 

sudo su - accumulo 

 

cd /usr/lib/accumulo

 

mvn -Dhadoop.profile=2.0 package

 

Here are results:

 

-------------------------------------------------------
T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [43.496s]
[INFO] cloudtrace ........................................ FAILURE [35.857s]
[INFO] accumulo-start .................................... SKIPPED
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:21.951s
[INFO] Finished at: Fri Feb 14 11:20:15 PST 2014
[INFO] Final Memory: 12M/57M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :cloudtrace
[accumulo@localhost accumulo]$

 

Here is long version I captured:

[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:cloudtrace:jar:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-core:jar:1.4.3-cdh4.3.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.accumulo:cloudtrace:jar -> duplicate declaration of version (?) @ line 153, column 17
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-server:jar:1.4.3-cdh4.3.0
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.mortbay.jetty:jetty:jar -> duplicate declaration of version (?) @ line 103, column 17
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-start:jar:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo-examples:pom:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ org.apache.accumulo:accumulo:1.4.3-cdh4.3.0, /usr/lib/accumulo/pom.xml, line 152, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.accumulo:accumulo:pom:1.4.3-cdh4.3.0
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-clean-plugin is missing. @ line 81, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-resources-plugin is missing. @ line 152, column 15
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING] The expression ${artifactId} is deprecated. Please use ${project.artifactId} instead.
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] accumulo
[INFO] cloudtrace
[INFO] accumulo-start
[INFO] accumulo-core
[INFO] accumulo-server
[INFO] accumulo-examples
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building accumulo 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ accumulo ---
[INFO]
[INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ accumulo ---
[INFO]
[INFO] --- exec-maven-plugin:1.2:exec (user-manual) @ accumulo ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building cloudtrace 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-enforcer-plugin:1.0:enforce (enforce-mvn) @ cloudtrace ---
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ cloudtrace ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/main/resources
[INFO]
[INFO] --- maven-dependency-plugin:2.1:copy-dependencies (copy-dependencies) @ cloudtrace ---
[INFO] log4j-1.2.16.jar already exists in destination.
[INFO] libthrift-0.6.1.jar already exists in destination.
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ cloudtrace ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ cloudtrace ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /usr/lib/accumulo/src/trace/src/test/resources
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ cloudtrace ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-surefire-plugin:2.9:test (default-test) @ cloudtrace ---
[INFO] Surefire report directory: /usr/lib/accumulo/src/trace/target/surefire-reports

-------------------------------------------------------
T E S T S
-------------------------------------------------------

Results :

Tests run: 0, Failures: 0, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [2.920s]
[INFO] cloudtrace ........................................ FAILURE [1.694s]
[INFO] accumulo-start .................................... SKIPPED
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.399s
[INFO] Finished at: Fri Feb 14 11:28:01 PST 2014
[INFO] Final Memory: 9M/57M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project cloudtrace: Error creating properties files for forking; nested exception is java.io.IOException: Permission denied -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :cloudtrace

 

 

6,651 Views
0 Kudos

avatar
author-rank busbey author-rank
Expert Contributor

Created ‎02-14-2014 11:42 AM

Hi Chris!

 

Looks like you may have missed some steps from the installation instructions.

 

Can you recreate these commands and paste the results in code blocks:

 

[cloudera@localhost ~]$ ls -lah /usr/lib/accumulo
total 184K
drwxr-xr-x  12 accumulo accumulo 4.0K Feb 12 19:51 .
dr-xr-xr-x. 54 root     root     4.0K Feb  7 06:54 ..
drwxr-xr-x   2 accumulo accumulo 4.0K Feb  7 06:55 bin
-rw-r--r--   1 accumulo accumulo  26K Dec 18 11:32 CHANGES
drwxr-xr-x   3 accumulo accumulo 4.0K Feb  7 06:55 cloudera
drwxr-xr-x   3 accumulo accumulo 4.0K Feb 12 19:50 conf
drwxr-xr-x   2 accumulo accumulo 4.0K Feb  7 06:55 contrib
drwxr-xr-x   4 accumulo accumulo 4.0K Feb  7 06:55 docs
drwxr-xr-x   4 accumulo accumulo 4.0K Feb 12 19:50 lib
-rw-r--r--   1 accumulo accumulo  56K Dec 18 11:32 LICENSE
drwx------   2 accumulo accumulo 4.0K Feb  7 07:04 logs
-rw-r--r--   1 accumulo accumulo 2.1K Dec 18 11:32 NOTICE
-rw-r--r--   1 accumulo accumulo  31K Dec 18 11:32 pom.xml
-rw-r--r--   1 accumulo accumulo  13K Dec 18 11:32 README
drwxr-xr-x  10 accumulo accumulo 4.0K Feb  7 06:55 src
drwxrwxr-x   2 accumulo accumulo 4.0K Feb 12 19:51 target
drwxr-xr-x   5 accumulo accumulo 4.0K Feb  7 06:55 test
lrwxrwxrwx   1 root     root       11 Feb  7 08:42 walogs -> /dfs/walogs
[cloudera@localhost ~]$ ls -lah /usr/lib/accumulo/src/trace/
total 24K
drwxr-xr-x  4 accumulo accumulo 4.0K Feb 12 19:38 .
drwxr-xr-x 10 accumulo accumulo 4.0K Feb  7 06:55 ..
-rw-r--r--  1 accumulo accumulo 1.8K Dec 18 11:32 pom.xml
drwxr-xr-x  4 accumulo accumulo 4.0K Feb  7 06:55 src
drwxrwxr-x  8 accumulo accumulo 4.0K Feb 12 19:38 target
-rwxr-xr-x  1 accumulo accumulo 1.8K Dec 18 11:32 thrift.sh
[cloudera@localhost ~]$ ls -lah /var/lib/accumulo
total 40K
drwxr-xr-x   5 accumulo accumulo 4.0K Feb 12 19:34 .
drwxr-xr-x. 45 root     root     4.0K Feb  7 06:49 ..
drwxrwxr-x   2 accumulo accumulo 4.0K Feb  7 09:05 .accumulo
-rw-------   1 accumulo accumulo  824 Feb  7 08:54 .bash_history
-rw-r--r--   1 accumulo accumulo   18 Feb  7 06:50 .bash_logout
-rw-r--r--   1 accumulo accumulo  176 Feb  7 06:50 .bash_profile
-rw-r--r--   1 accumulo accumulo  288 Feb  7 08:31 .bashrc
drwxrwxr-x   3 accumulo accumulo 4.0K Feb 12 19:34 .m2
drwx------   2 accumulo accumulo 4.0K Feb  7 06:51 .ssh
-rw-------   1 accumulo accumulo 1.5K Feb 12 19:34 .viminfo
[cloudera@localhost ~]$

 

6,647 Views
0 Kudos

avatar
author-rank crigano
Explorer

Created ‎02-14-2014 12:25 PM

This seems like an access problem ...

 

Poked around but wuld like the right way to gen a SSH key and set maven so I don't screw up.

6,646 Views
0 Kudos

avatar
author-rank busbey author-rank
Expert Contributor

Created ‎02-14-2014 01:06 PM

Hi Chris!

 

Yep, it's almost certainly a local filesystem permissions issue.

 

Please run the commands in my previous post. They will show the permissions at likely problem points.

 

-Sean

6,643 Views
0 Kudos

avatar
author-rank crigano
Explorer

Created ‎02-14-2014 01:35 PM

Hi Sean,

 

I did it 3 times already,

 

But it never hurts to try again ...

 

I will have my wife back check me just in case ...

6,639 Views
0 Kudos

avatar
author-rank crigano
Explorer

Created ‎02-14-2014 02:18 PM

Here is what we have; note I did the chmod 777 thing and made cloudera a member of accumulo group for eclipse, netbeans and cmd line development so its wide open I believe.

 

[accumulo@localhost ~]$ ls -lah /usr/lib/accumulo
total 192K
drwxrwxrwx 11 accumulo accumulo 4.0K Feb 14 11:31 .
dr-xr-xr-x. 55 root root 4.0K Feb 10 15:28 ..
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 bin
-rwxrwxrwx 1 accumulo accumulo 26K Dec 23 09:34 CHANGES
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 14:43 contrib
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 14:43 docs
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 14 11:16 lib
-rwxrwxrwx 1 accumulo accumulo 56K Dec 23 09:34 LICENSE
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 10 15:17 logs
-rwxrwxrwx 1 accumulo accumulo 2.1K Dec 23 09:34 NOTICE
-rwxrwxrwx 1 accumulo accumulo 32K Dec 23 09:34 pom.xml
-rwxrwxrwx 1 accumulo accumulo 13K Dec 23 09:34 README
drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 src
drwxrwxr-x 2 cloudera cloudera 4.0K Feb 11 06:11 target
drwxrwxrwx 5 accumulo accumulo 4.0K Dec 23 09:34 test
-rw-rw-r-- 1 accumulo accumulo 8.1K Feb 14 11:28 tmp
drwxrwxrwx 2 accumulo accumulo 4.0K Feb 12 20:59 walogs
[accumulo@localhost ~]$

 

missing cloudera and config in /usr/lib/accumulo:

 

cloudera is at:

./.m2/repository/com/cloudera
[accumulo@localhost ~]$ find -name conf
[accumulo@localhost ~]$ ls -la ./.m2/repository/com/cloudera
total 12
drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 .
drwxrwxr-x 3 accumulo accumulo 4096 Feb 14 11:18 ..
drwxrwxr-x 4 accumulo accumulo 4096 Feb 14 11:19 cdh
[accumulo@localhost ~]$

 

I BELIEVE conf is:

ls -la ./etc/accumulo/conf
lrwxrwxrwx 1 root root 31 Feb 10 15:05 ./etc/accumulo/conf -> /etc/alternatives/accumulo-conf

 

ls -lah /usr/lib/accumulo/src/trace/
total 24K
drwxrwxrwx 4 accumulo accumulo 4.0K Feb 10 19:29 .
drwxrwxrwx 10 accumulo accumulo 4.0K Dec 23 09:36 ..
-rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 pom.xml
drwxrwxrwx 4 accumulo accumulo 4.0K Dec 23 09:34 src
drwxrwxr-x 8 cloudera cloudera 4.0K Feb 10 19:30 target
-rwxrwxrwx 1 accumulo accumulo 1.8K Dec 23 09:34 thrift.sh
[accumulo@localhost ~]$ total 24K

 

Checks out

 

drwxr-xr-x 5 accumulo accumulo 4.0K Feb 14 11:31 .
drwxr-xr-x. 43 root root 4.0K Feb 10 14:23 ..
drwxrwxr-x 2 accumulo accumulo 4.0K Feb 10 16:01 .accumulo
-rw------- 1 accumulo accumulo 2.3K Feb 14 11:35 .bash_history
-rw-r--r-- 1 accumulo accumulo 18 Feb 10 14:24 .bash_logout
-rw-r--r-- 1 accumulo accumulo 176 Feb 10 14:24 .bash_profile
-rw-r--r-- 1 accumulo accumulo 246 Feb 10 15:50 .bashrc
drwxrwxr-x 3 accumulo accumulo 4.0K Feb 14 11:17 .m2
drwx------ 2 accumulo accumulo 4.0K Feb 10 14:26 .ssh
-rw------- 1 accumulo accumulo 5.2K Feb 14 11:31 .viminfo

 

checks out

 

This is where the installation puts it. I am game to change. If I did miss something please tell me at 60 I got no ego 🙂

 only appreciation for you assistance!

6,636 Views
0 Kudos

avatar
author-rank busbey author-rank
Expert Contributor

Created on ‎02-17-2014 03:41 PM - edited ‎02-17-2014 03:42 PM

The issue here looks like you previously did a build with the cloudera user. That build added all of the target/ directories for maven with persmissions exclusive to the cloudera user (for writing). So now when the Accumulo user attempts to build, it can't write.

 

To fix this for now:

 

  1. Stop Accumulo. The rest of these instructions will delete the set of jars Accumulo needs to run.
  2.  As the cloudera user run these commands to clear out the directories
    [cloudera@localhost ~]$ cd /usr/lib/accumulo
[cloudera@localhost accumulo]$ mvn -Dhadoop.profile=2.0 clean
[INFO] Scanning for projects...
<....skip Maven downloading the internet....>
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] accumulo .......................................... SUCCESS [0.745s]
[INFO] cloudtrace ........................................ SUCCESS [0.010s]
[INFO] accumulo-start .................................... SUCCESS [0.005s]
[INFO] accumulo-core ..................................... SUCCESS [0.040s]
[INFO] accumulo-server ................................... SUCCESS [0.035s]
[INFO] accumulo-examples ................................. SUCCESS [0.027s]
[INFO] examples-simple ................................... SUCCESS [0.014s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2.345s
[INFO] Finished at: Mon Feb 17 14:51:22 PST 2014
[INFO] Final Memory: 6M/57M
[INFO] ------------------------------------------------------------------------
[cloudera@localhost accumulo]$

     

  3. If that fails, you might have a mix of permissions between the cloudera and accumulo user. Run the clean command from above as root.
  4. Repeat the command line building from before as the accumulo user
  5. Start Accumulo again

 

To fix this sustainably, you need to separate out building things from deploying them. This is especially true if you want to use a graphic IDE as the cloudera user. To do that, I'd recommend

 

  1. Place the code you want to work on somewhere for the cloudera user to interact with. I generally do this in a subdirectory of the home directory.
    [cloudera@localhost ~]$ mkdir -p projects/accumulo
[cloudera@localhost ~]$ tar -C projects/accumulo --strip=1 -xzf accumulo-1.4.3-cdh4.3.0-dist.tar.gz 
[cloudera@localhost ~]$ cd projects/accumulo/
[cloudera@localhost accumulo]$ ls -a
.  ..  bin  CHANGES  cloudera  conf  contrib  docs  lib  LICENSE  logs  NOTICE  pom.xml  README  src  test  walogs
[cloudera@localhost accumulo]$
  2. Out of habit, I would track whatever changes happen locally
    [cloudera@localhost accumulo]$ git config --global user.name "Sean Busbey"
[cloudera@localhost accumulo]$ git config --global user.email "busbey@cloudera.com"
[cloudera@localhost accumulo]$ git init
Initialized empty Git repository in /home/cloudera/projects/accumulo/.git/
[cloudera@localhost accumulo]$ git commit --allow-empty -m "Initial commit"
[master (root-commit) 6943bc0] Initial commit
[cloudera@localhost accumulo]$ git add *
[cloudera@localhost accumulo]$ git commit -m "Cloudera release 1.4.3-cdh4.3.0"
[master b4a9911] Cloudera release 1.4.3-cdh4.3.0
 1551 files changed, 338162 insertions(+), 0 deletions(-)
<.... skip 1551 file paths ....>
[cloudera@localhost accumulo]$ git status
# On branch master
nothing to commit (working directory clean)
[cloudera@localhost accumulo]$ git log
commit b4a99119da3de3f9445b793ebd338dcbb310ace3
Author: Sean Busbey <busbey@cloudera.com>
Date:   Mon Feb 17 15:05:50 2014 -0800

    Cloudera release 1.4.3-cdh4.3.0

commit 6943bc00904b42c5ee6aec472e963f0188433267
Author: Sean Busbey <busbey@cloudera.com>
Date:   Mon Feb 17 15:05:30 2014 -0800

    Initial commit
[cloudera@localhost accumulo]$
  3. Build however you're going to build (IDE or commandline). As an example, I would build via commandline maven.
    [cloudera@localhost accumulo]$ mvn -Dhadoop.profile=2.0 package
[INFO] Scanning for projects...
[WARNING] 
<.... Skip warnings about plugin versions ....>
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO] 
[INFO] accumulo
[INFO] cloudtrace
[INFO] accumulo-start
[INFO] accumulo-core
[INFO] accumulo-server
[INFO] accumulo-examples
[INFO] examples-simple
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building accumulo 1.4.3-cdh4.3.0
[INFO] ------------------------------------------------------------------------
<.... skip maven downloading the internet ....>
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] accumulo .......................................... SUCCESS [3:11.272s]
[INFO] cloudtrace ........................................ SUCCESS [1:58.342s]
[INFO] accumulo-start .................................... SUCCESS [4:35.473s]
[INFO] accumulo-core ..................................... SUCCESS [59.175s]
[INFO] accumulo-server ................................... SUCCESS [1:53.334s]
[INFO] accumulo-examples ................................. SUCCESS [0.009s]
[INFO] examples-simple ................................... SUCCESS [7.238s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 12:46.212s
[INFO] Finished at: Mon Feb 17 15:21:16 PST 2014
[INFO] Final Memory: 80M/192M
[INFO] ------------------------------------------------------------------------
[cloudera@localhost accumulo]$
  4. When you need to deploy the jars into your accumulo instance: replace the Accumulo deployment jars with those from the working directory and restart Accumulo (all with the accumulo user).
    [cloudera@localhost accumulo]$ sudo -u accumulo rm -f /usr/lib/accumulo/lib/*.jar
[cloudera@localhost accumulo]$ sudo -u accumulo cp lib/*.jar /usr/lib/accumulo/lib/
[cloudera@localhost accumulo]$ sudo su - accumulo
[accumulo@localhost ~]$ $ACCUMULO_HOME/bin/stop-all.sh
^CInvalid password or unable to connect to the master
Press Ctrl-C to cancel now, or force shutdown in 15 seconds
Utilities and unresponsive servers will be shut down in 5 seconds
stopping monitor on localhost.localdomain
stopping tracer on localhost.localdomain
stopping monitor on localhost.localdomain
stopping unresponsive tablet servers (if any) ...
stopping unresponsive tablet servers hard (if any) ...
Cleaning tablet server and logger entries from zookeeper
Cleaning all server entries in zookeeper
[accumulo@localhost ~]$ $ACCUMULO_HOME/bin/start-all.sh
Starting tablet servers and loggers .... done
Starting tablet server on localhost.localdomain
Starting logger on localhost.localdomain
2014-02-17 15:34:41,763 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-02-17 15:34:42,136 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-02-17 15:34:47,210 [server.Accumulo] INFO : Connected to HDFS
Starting master on localhost.localdomain
Starting garbage collector on localhost.localdomain
Starting monitor on localhost.localdomain
Starting tracer on localhost.localdomain
[accumulo@localhost ~]$ exit
logout
[cloudera@localhost accumulo]$

     

Note that this process is only needed because you're altering the jars that make up Accumulo itself. Under normal operations, you should not be altering this source nor copying jars into Accumulo's installation. Any jars you need, either for client side applications or for a custom iterator, should be deployed in their own location and referenced as appropriate from your client or server classpaths.

6,615 Views
0 Kudos

avatar
author-rank crigano
Explorer

Created ‎02-19-2014 10:28 AM

Cleaned up as Root.

 

As accumulo executed:

 

Test results failed:mvn -Dhadoop.profile=2.0 package

-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.accumulo.start.Test
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 11.703 sec <<< FAILURE!

Results :

Tests in error:
testChangingDirectory(org.apache.accumulo.start.Test): /usr/lib/accumulo/src/start/../../conf/examples/512MB/standalone/accumulo-site.xml (No such file or directory)

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] accumulo .......................................... SUCCESS [3.794s]
[INFO] cloudtrace ........................................ SUCCESS [11.847s]
[INFO] accumulo-start .................................... FAILURE [1:54.079s]
[INFO] accumulo-core ..................................... SKIPPED
[INFO] accumulo-server ................................... SKIPPED
[INFO] accumulo-examples ................................. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:11.538s
[INFO] Finished at: Tue Feb 18 23:24:34 PST 2014
[INFO] Final Memory: 34M/83M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.9:test (default-test) on project accumulo-start: There are test failures.
[ERROR]
[ERROR] Please refer to /usr/lib/accumulo/src/start/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :accumulo-start
[accumulo@localhost accumulo]$ whoami
accumulo
[accumulo@localhost accumulo]$

8,800 Views
0 Kudos

avatar
author-rank busbey author-rank
Expert Contributor

Created ‎02-19-2014 11:56 AM

Your accumulo installation does not have the example configuration directories. ($ACCUMULO_HOME/conf/examples).

 

Looking at our docs I see we tell people to move the conf directory to set up initial configs, probably on the assumption that people won't be rebuilding. I'll file an internal ticket to get that corrected.

 

In the mean time, I'd recommend restoring the $ACCUMULO_HOME/conf directory from the dist tarball.

6,605 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera Data Engineering 1.23: Access Spark from Your Favor...
What's New @ Cloudera
HBase REST server scaling support is Generally Available
What's New @ Cloudera
New CLI option in the update-database command
What's New @ Cloudera
New Action menu item in the Cloudera Operational Database UI
What's New @ Cloudera
Get the list of supported instance types in the Cloudera Ope...
View More Announcements