Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2693 | 11-01-2016 05:43 PM | |
| 9145 | 11-01-2016 05:36 PM | |
| 5032 | 07-01-2016 03:20 PM | |
| 8444 | 05-25-2016 11:36 AM | |
| 4613 | 05-24-2016 05:27 PM |
02-11-2016
10:27 PM
1 Kudo
@PJ Moutrie Please see this http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_data_governance/content/ch_hdp_data_governance_overview.html We have Hive and Atlas setup in place. More components integration coming down the road.
... View more
02-11-2016
10:25 PM
@Ram D Please see the official doc on decommission process http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_Ambari_Users_Guide/content/_how_to_decommission_a_component.html If you are using Ambari to manage the cluster then Don't decomsission manually.
... View more
02-11-2016
10:04 PM
@dan goldberg This is very basic but it can help to understand the kafka basic model http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_installing_manually_book/content/validate_kafka.html Basic training http://www.slideshare.net/miguno/apache-kafka-08-basic-training-verisign
... View more
02-11-2016
10:00 PM
@Ian Maloney https://issues.apache.org/jira/browse/SPARK-6411 https://mail-archives.apache.org/mod_mbox/spark-user/201406.mbox/%3CCAMJOb8kcGk0PqiOGJu6UoKCeysWCuSW3xwd5wRs8ikpMgD2DAg@mail.gmail.com%3E That is because people usually don't package python files into their jars.
For pyspark, however, this will work as long as the jar can be opened and
its contents can be read. In my experience, if I am able to import the
pyspark module by explicitly specifying the PYTHONPATH this way, then I can
run pyspark on YARN without fail.
... View more
02-11-2016
05:21 PM
1 Kudo
Error: 2016-02-11 08:57:07,482 ERROR [Thread-9]: client.RangerAdminRESTClient (RangerAdminRESTClient.java:getServicePoliciesIfUpdated(81)) - Error getting policies. request=http://phdns01.cloud.hortonworks.com:6080/service/plugins/policies/download/HDPTEST_hive?lastKnownVersion=11&pluginId=hiveServer2@phdns02.cloud.hortonworks.com-HDPTEST_hive, response={"httpStatusCode":400,"statusCode":1,"msgDesc":"Serivce:HDPTEST_hive not found","messageList":[{"name":"DATA_NOT_FOUND","rbKey":"xa.error.data_not_found","message":"Data not found"}]}, serviceName=HDPTEST_hive Issue: Ranger was deleted and delete process ended up causing issues at the database level as shown above. Delete was done using the following command curl --user admin:admin -i -H "X-Requested-By: ambari" -X DELETE http://`hostname -f`:8080/api/v1/clusters/CLUSTERNAME/services/RANGER Now, No Hive repo showed up in Ranger console after adding Ranger and enabling Hive plugin. Fix: As you can seen in the error "HDPTEST_hive" Data Not Found. Disclaimer: Unofficial solution
... View more
Labels:
02-11-2016
04:50 PM
@rbalam Look at Benjamin comments.
... View more
02-11-2016
03:34 PM
@khushi kalra Atlas and Hive hook works. Take a look on this tutorial please...you can see that all the tags are defined in xml http://hortonworks.com/hadoop-tutorial/defining-processing-data-end-end-data-pipeline-apache-falcon/
... View more
02-11-2016
03:18 PM
@rajdip chaudhuri Also, very important Run following in mysql as root user grant all privileges on *.* to 'hive'@'host' identified by 'hivepassword' with grant option;
... View more
02-11-2016
03:11 PM
@rajdip chaudhuri In Hive server cd /var/log/hive/ and read logs to troubleshoot further
... View more
02-11-2016
03:10 PM
1 Kudo
@Kunal Gaikwad Please watch this https://www.youtube.com/watch?v=xeT3A1nha6g&ab_channel=DeepAdmin
... View more