Member since
08-31-2015
81
Posts
115
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2902 | 03-22-2017 03:51 PM | |
1783 | 05-04-2016 09:34 AM | |
1394 | 03-24-2016 03:07 PM | |
1546 | 03-24-2016 02:54 PM | |
1475 | 03-24-2016 02:47 PM |
09-24-2015
11:28 PM
1 Kudo
It it possible for new files/dirs to inherit group ownership from the user instead of the parent directory? For reference this is how default group permissions are handled: "When a file or directory is created, its owner is the user identity of the client process, and its group is the group of the parent directory (the BSD rule).” http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.h
... View more
Labels:
- Labels:
-
Apache Hadoop
09-24-2015
11:07 PM
1 Kudo
Do we actually support Docker Container Executor in HDP 2.3 release?
... View more
Labels:
09-24-2015
05:07 PM
@MCarter@hortonworks.com @ssen@hortonworks.com lot of good content in this thread..Lets harvest it into a KB article
... View more
09-24-2015
04:47 PM
2 Kudos
The following provide directions to swap out the default Derby DB in Ambari for Ooize to Mysql.
followed *some* steps from this for preparing to create the MySQL db creation - http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1-latest/bk_installing_manually_book/content/rpm-chap8-3.html Setup databse (dropped the existing DB first)
$ mysqldump -u oozie -p -h <host> oozie > oozie.dump.sql $ mysql -u oozie -p -h <host> -e "drop database oozie" $ sudo mysql mysql> create database oozie;
Query OK, 1 row affected (0.03 sec) mysql> grant all privileges on oozie.* to 'oozie'@'localhost' identified by 'oozie'
Query OK, 0 rows affected (0.03 sec) mysql> grant all privileges on oozie.* to 'oozie'@'%' identified by 'oozie';
Query OK, 0 rows affected (0.03 sec) mysql> exit backup oozie-site.xml modify the following in oozie-site.xml change db info to mysql (note: use the proper password for the grants: pass=oozie). This is used for creating the database. We need to manually change it because Ambari disables this options once it's been set. <property>
<name>oozie.service.JPAService.jdbc.driver</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>oozie.service.JPAService.jdbc.url</name>
<value>jdbc:mysql://<hostname>:3306/oozie</value>
</property>
<property>
<name>oozie.service.JPAService.jdbc.username</name>
<value>oozie</value>
</property>
<property>
<name>oozie.service.JPAService.jdbc.password</name>
<value>oozie</value>
</property>
copy mysql-connector-java.jar to oozie/libext (/var/lib/oozie/) install the Oozie DB sudo -u oozie /usr/lib/oozie/bin/ooziedb.sh create -run Check out the Ambari Oozie settings via the CLI API /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p <password> get 127.0.0.1 <clustername> oozie-site | python -m json.tool
cat <(echo {) <(/var/lib/ambari-server/resources/scripts/configs.sh -u admin -p <password> get 127.0.0.1 <clustername> oozie-site|tail -n +4) <(echo })|python -m json.tool
Update the Oozie properties in Ambari create a tmp dir, e.g. /tmp/oozie and cd to it Get the global config /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p <password> get 127.0.0.1 <clustername> global global.json Update the following: "oozie_database" : "Existing MySQL Database" "oozie_database_type" : "MySQL" Update the global config /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p <password> set 127.0.0.1 <clustername> global global.json Get the oozie-site config /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p <password> get 127.0.0.1 <clustername> oozie-site oozie-site.json Update the following: "oozie.db.schema.name" : "oozie" "oozie.service.JPAService.jdbc.driver" : "com.mysql.jdbc.Driver" "oozie.service.JPAService.jdbc.url" : "jdbc:mysql://<hostname>:3306/oozie" Update the oozie-site config
/var/lib/ambari-server/resources/scripts/configs.sh -u admin -p <password> set 127.0.0.1 <clustername> oozie-site oozie-site.json
... View more
Labels:
09-24-2015
02:41 PM
1 Kudo
Thank You! Ok that works. is there a plan to have this configurable via Ambari?
... View more
09-24-2015
02:38 PM
2 Kudos
How do I change the directory where Knox logs are located ? default is /var/log/knox? Customers wants on /var/log/hdp/knox
... View more
Labels:
- Labels:
-
Apache Knox
09-23-2015
09:37 PM
2 Kudos
I have used and built some testing utilities to be able to create unit tests and integration tests of topologies that use kafka, solr and other components. These provide the capabilities to deploy a topology from your desktop machine to your dev cluster, etc.. Check out the following github links for examples: Unit Test Example Integration Test Example The test utilities it uses can be found here: Also check out the Hortonworks Gallery, it has a cool project that is being featured called Mini Clusters by @skumpf@hortonworks.com that has some great testing utilities to run clusters in local mode.
... View more
09-23-2015
08:23 PM
5 Kudos
You need to create the proxy settings for 'root', since Ambari runs as root. This allows it to impersonate the user in hdfs. hadoop.proxyuser.root.groups=* hadoop.proxyuser.root.hosts=* You'll also need to create the 'admin' user home directory in hdfs for Admin, if you haven't already done that. Since you're signed into Ambari as Admin, your jobs will be submitted/passed through as that user.
... View more
09-23-2015
08:07 PM
You should be able to change ams user by using the configs.sh script. cd /var/lib/ambari-server/resources/scripts/ ./configs.sh set localhost bp ams-env ambari_metrics_user new_ams_user
... View more
- « Previous
- Next »