Member since
08-23-2016
261
Posts
201
Kudos Received
106
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1774 | 01-26-2018 07:28 PM | |
1408 | 11-29-2017 04:02 PM | |
35371 | 11-29-2017 03:56 PM | |
3541 | 11-28-2017 01:01 AM | |
968 | 11-22-2017 04:08 PM |
06-27-2017
04:47 PM
1 Kudo
Hi @John Cleveland Both the popular HDP and HDF Sandboxes are delivered as Dockerized containers. You are correct that there is a Docker container, as well as a Host machine that are different but ship within the same VM appliance. The following link from the docs might help provide additional clarity as well: https://hortonworks.com/tutorial/hortonworks-sandbox-guide/section/2/
... View more
06-27-2017
04:41 PM
2 Kudos
Hi @Ashis Panigrahi NiFi does have a REST API that can be used in this case. Here are links to both the NiFi docs for the API, and to github repo that shows an example script that might help get you started: https://nifi.apache.org/docs/nifi-docs/rest-api/ https://github.com/aperepel/nifi-api-deploy
... View more
06-27-2017
04:29 PM
Hi @Vamsi N the "Files" view in Ambari Views is a file explorer for HDFS. You should see it in the dropdown for the views. If you don't see it under the Ambari account you are using, you can use the instructions that Jay has above to add an instance of the Files view.
... View more
06-26-2017
04:00 PM
1 Kudo
hi @Andrey Shulgin Step 1 of the docs here talks about what configurations to add/change for the user running the NFS Gateway. Hopefully you are using an HDP version of 2.5 or greater as there was a bug in previous versions around this, but it is resolved now and the docs are updated. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_hdfs-nfs-gateway-user-guide/content/user-guide-hdfs-nfs-instructions.html
... View more
06-26-2017
03:22 PM
1 Kudo
Hi @Sateesh Mandumula For reading from the RDBMS, you can use processors like QueryDatabaseTable or ExecuteSQL. Hive now supports Merge which should cover your update else insert requirement, you can try using a PutHiveQL and seeing if you can issue the merge command using that. Here are some relevant links to the documentation that should help: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.3.0/org.apache.nifi.processors.standard.QueryDatabaseTable/index.html https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.3.0/org.apache.nifi.processors.standard.ExecuteSQL/index.html https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML#LanguageManualDML-Merge https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-hive-nar/1.3.0/org.apache.nifi.processors.hive.PutHiveQL/index.html
... View more
06-23-2017
08:57 PM
1 Kudo
hi @Mahendra Malpute Since you are doing this in Azure, some additional steps may be required to enable access to Ambari. The following links may help: https://community.hortonworks.com/questions/79042/step-12-not-showing-welcome-page-as-mentioned.html https://community.hortonworks.com/articles/78757/enabling-access-to-ambari-and-other-service-endpoi.html Also, if you are able to ssh to your Ambari server and login as root or a sudo user, you can always reset the password via this command 'ambari-admin-password-reset' If you are using the Hortonworks Sandbox, you might be able to use the webssh utlity: http://<hostname/ipaddress>:4200
... View more
06-23-2017
04:37 PM
1 Kudo
Hi @sai saiedfar I've seen this in the Ambari Hive View 2.0, where if you once select a property, it becomes grey and cannot be selected again. I suspect its a UI bug, and will report it internally. To work around it, get out of the Hive View 2.0 and come back in and the property will be selectable again. When I tried just now, I just went back to the Ambari dashboard, waited it for the dashboard to load, then went back into the Hive View 2.0 and the property was again selectable for me to set. In the first screenshot, the values I've tried to select, did not update, and re-select are grey. In the second screenshot, ascreen-shot-2017-06-23-at-103601-am.pngfter going out and back into the Hive View 2.0, they are selectable again and able for me to set the execution engine to 'tez'. screen-shot-2017-06-23-at- 102625-am.png
... View more
06-22-2017
08:20 PM
3 Kudos
Hi @Raj B This link might hep you: https://community.hortonworks.com/questions/8871/nifi-routetext-processor-too-many-open-files.html
... View more
06-22-2017
08:05 PM
Hi @Rick Liao you can SCP them directly from the Sandbox, which is the most reliable way to ensure compatibility. The following examples download more jars from the Sandbox to your local machine, then, in the SquirrelSQL Drivers config, just pick only the ones you need. scp -P 2222 root@sandbox.hortonworks.com:/usr/hdp/2.6.0.3-8/hadoop/lib/slf* /your/local/dir/ scp -P 2222 root@sandbox.hortonworks.com:/usr/hdp/2.6.0.3-8/hadoop/hadoop-common-2.7.3.2.6.0.3-8.jar /your/local/dir/ scp -P 2222 root@sandbox.hortonworks.com:/usr/hdp/2.6.0.3-8/hive/lib/* /your/local/dir/
... View more
06-22-2017
07:43 PM
Hi @Rick Liao Attached here is my Alias screenshot showing its configuration. I just used hive/hive for the test credentials, which worked as I can see the pre-loaded databases in the Sandbox. One thing I am noticing is that you are using HDP 2.4.x jars but from the screenshots above trying to connect to to an HDP 2.6.x cluster. I would strongly recommend you download fresh jars from the 2.6 cluster and only add the ones required (see my attachment).
... View more