Member since
10-23-2015
20
Posts
8
Kudos Received
6
Solutions
08-31-2018
01:48 PM
1 Kudo
@Sandeep Nemuri helped me work through this. Here are updated steps: Clone Hadoop. From the trunk branch run the following command to install protoc 2.5: brew install protobuf250 Run the following command to create symlinks for protoc 2.5: brew link --overwrite --force protobuf250 You can use the following command to verify that protoc 2.5 has been installed: protoc --version Use the following command to build ozone: mvn clean package -Phdds -Pdist -Dtar -DskipShade -DskipTests -Dmaven.javadoc.skip=true Go to the directory that contains the Docker compose files: cd <path_to_local_github>/hadoop/hadoop-dist/target/ozone-0.2.1-SNAPSHOT/compose/ozone Start ozone: docker-compose up -d Log in to the DataNode container: docker exec-it ozone_datanode_1 bash Run the ozone load generator: bin/ozone freon -validateWrites -numOfVolumes 5 -numOfBuckets 10 -numOfKeys 10 Now you should be able to see the OzoneManager UI at http://localhost:9874/
... View more
08-30-2018
12:51 PM
@Ajay, I checked out the HDFS-7240 branch and ran the build command (on Mac OS X). That seemed to work and downloaded a bunch of files, but then failed saying "hdsl" does not exist: [INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 12.615 s
[INFO] Finished at: 2018-08-30T07:09:47-04:00
[INFO] Final Memory: 127M/1258M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "hdsl" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.2.0-SNAPSHOT:protoc (compile-protoc) on project hadoop-common: org.apache.maven.plugin.MojoExecutionException: 'protoc --version' did not return a version -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
<br>
... View more
09-29-2016
01:58 AM
The Security Guide was extensively updated to reflect new Ranger and Knox features for HDP 2.5. This new content includes:
Ranger-Atlas integration using tag-based services and policies. Tags and policy evaluation. Atlas Ranger Authorization plugin. Ranger-Hive row-filtering and column-masking. Migration script to convert from Audit-to-DB to Audit-to-Solr. Ranger Reports page improvements. Knox SSO. Ranger Usersync enhancements. Ranger High Availability (added to Apache Hadoop High Availability guide). Updates to reflect the new Ambari Infra Solr instance. The Data Governance guide was completely rewritten for HDP 2.5 to reflect new Apache Atlas capabilities, along with a new Atlas UI. This new content includes:
Atlas-Ranger integration and Tag synch. Installation and Configuration. Configuring Atlas Security. Configuring Atlas High Availability. Searching and viewing Atlas Assets. Working with Atlas tags. Enabling and Managing the Atlas Business Taxonomy (Technical Preview). Updated REST API resources.
... View more
Labels: