Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
shashank_naresh
shashank_naresh
New Contributor

Python 2.7 in sandbox

by New Contributor shashank_naresh in Support Questions
‎08-21-2019 11:05 AM
‎08-21-2019 11:05 AM
Hi Hortonworks Team,   We are getting error "DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020" during pip install. I can see that HDP3.0/HDF3.2 are having python 2.7. My question is post January 1st, 2020. will HDP3.0/HDF3.2 stop working or we will not be able to install any python library through pip or there will be new release of HDP/HDF sandboxes with python version > 2.7. ... View more

Re: Unable to create hive table from df in Zeppeli...

by New Contributor shashank_naresh in Support Questions
‎08-19-2019 06:08 PM
‎08-19-2019 06:08 PM
Hi @cstefan ,   Could you please check and let us know the value in "HIVE_WAREHOUSE_CONNECTOR"   And hive parameters setting in Spark2. ... View more

Re: Hive databases are not visible in Spark sessio...

by New Contributor shashank_naresh in Support Questions
‎08-13-2019 05:27 PM
‎08-13-2019 05:27 PM
Hi @dbompart, Thanks for your reply; I've tried below: 1) Changed the Zeppelin setting per below 2) Restarted notebook 3) Tried below code in notebook and getting below import error. Requesting to assist here. Thanks and Regards. ... View more

Re: Hive databases are not visible in Spark sessio...

by New Contributor shashank_naresh in Support Questions
‎08-13-2019 04:00 AM
‎08-13-2019 04:00 AM
Hi @dbompart, Thanks for the answer, I am using HDP3.1, I've tried to change the settings per link "https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.1.0/integrating-hive/content/hive_configure_a_spark_hive_connection.html" 1) Spark setting below 2) Trying to get hive databases in spark - no success; 3) Can see hive databases in hive Could you please assist me on this, what else needs to be done. ... View more

Re: Hive databases are not visible in Spark sessio...

by New Contributor shashank_naresh in Support Questions
‎08-13-2019 12:18 AM
‎08-13-2019 12:18 AM
I am using HDP 3.1.0 ... View more

Re: Issue : "sandbox-hdp.hortonworks.com:8020 fail...

by New Contributor shashank_naresh in Support Questions
‎07-20-2019 05:56 PM
‎07-20-2019 05:56 PM
Please note I am using HDP 3.0 version ... View more

Issue : "sandbox-hdp.hortonworks.com:8020 failed o...

by New Contributor shashank_naresh in Support Questions
‎07-20-2019 05:56 PM
‎07-20-2019 05:56 PM
Hi, In my CDA, on HDP while system is starting it is throwing below error: "sandbox-hdp.hortonworks.com:8020 failed on connection exception: java.net.connectexception: connection refused;" for namenode. Below is the more detailed log. Could you please let me know what should be done since it is not starting namenode and hence not letting to start entire system. stderr: stdout: 2019-07-20 01:20:47,602 - Waiting for this NameNode to leave Safemode due to the following conditions: HA: False, isActive: True, upgradeType: None 2019-07-20 01:20:47,604 - Waiting up to 19 minutes for the NameNode to leave Safemode... 2019-07-20 01:20:47,604 - Execute['/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF''] {'logoutput': True, 'tries': 115, 'user': 'hdfs', 'try_sleep': 10} safemode: Call From sandbox-hdp.hortonworks.com/172.18.0.3 to sandbox-hdp.hortonworks.com:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused 2019-07-20 01:20:51,904 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. safemode: Call From sandbox-hdp.hortonworks.com/172.18.0.3 to sandbox-hdp.hortonworks.com:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused 2019-07-20 01:21:06,242 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. 2019-07-20 01:21:19,389 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. 2019-07-20 01:21:31,853 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. 2019-07-20 01:21:45,871 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. 2019-07-20 01:21:57,932 - Retrying after 10 seconds. Reason: Execution of '/usr/hdp/current/hadoop-hdfs-namenode/bin/hdfs dfsadmin -fs hdfs://sandbox-hdp.hortonworks.com:8020 -safemode get | grep 'Safe mode is OFF'' returned 1. ... View more
Labels:

Re: How to create hive interpreter in Zeppelin 0.7...

by New Contributor shashank_naresh in Support Questions
‎07-20-2019 10:35 AM
‎07-20-2019 10:35 AM
Please use %jdbc(hive) instead of %hql, it worked for me. ... View more

Re: HDP 3.0 "ip addr show" shows only eth0 and lo

by New Contributor shashank_naresh in Support Questions
‎06-13-2019 10:39 AM
‎06-13-2019 10:39 AM
I was able to do it by choosing only network adapter setting. ... View more

Re: How to integrate HDP and HDF on same virtual b...

by New Contributor shashank_naresh in Support Questions
‎06-13-2019 10:37 AM
‎06-13-2019 10:37 AM
Thanks @.Geoffrey Shelton Okot it is working ... View more

Re: Python Script in NiFi

by New Contributor shashank_naresh in Community Articles
‎06-13-2019 10:34 AM
‎06-13-2019 10:34 AM
Thank you @Vasilis Vagias ... View more

HDP 3.0 "ip addr show" shows only eth0 and lo

by New Contributor shashank_naresh in Support Questions
‎05-25-2019 06:12 AM
‎05-25-2019 06:12 AM
Hi, Need help here: When I am doing "ip addr show" in HDP 3.0 shell in box; it is showing only eth0 and lo. Though in NETWORK options I have two network adapters 1) NAT 2) NETNETWORK In my VirtualBox NET NETWORK setting I have given NETNETWORK 11.0.2.0/24. My concern is when I am doing ip addr show my NETNETWORK ip 11.0.2.# should be displayed, which is not displaying currently. Do I need to have some setting changes in HDP 3.0. Or HDP 3.0 doesn't sense network adapter other than NAT? ... View more

How to integrate HDP and HDF on same virtual box

by New Contributor shashank_naresh in Support Questions
‎05-13-2019 11:05 PM
‎05-13-2019 11:05 PM
Hi, I wanted to know whether it is possible to use HDP and HDF simultaneously on same virtual machine. Actually wanted to use HDF Nifi/Kafka (producer) services to fetch data from source and wanted to trigger Kafka(consumer) at HDP. Facing issue when both HDF/HDP are running not able to use localhost:1080 ... View more

Re: Spark 2.3 : pyspark.sql.utils.AnalysisExceptio...

by New Contributor shashank_naresh in Support Questions
‎05-06-2019 09:22 PM
‎05-06-2019 09:22 PM
Hi, I am trying to run spark application which will need access to Hive databases. But Hive databases like FOODMART are not visible in spark session. I did spark.sql("show databases").show(); it is not showing Foodmart database, though spark session is having enableHiveSupport. Below i've tried: 1) cp /etc/hive/conf/hive-site.xml /etc/spark2/conf 2) Changed spark.sql.warehouse.dir in spark UI from /apps/spark/warehouse to /warehouse/tablespace/managed/hive Even though it is not working. Please let me know what configuration changes would be required to have this. Please note - Above is working in HDP2.6.5. ... View more

Re: Hive on Spark

by New Contributor shashank_naresh in Support Questions
‎05-05-2019 05:05 AM
‎05-05-2019 05:05 AM
Thank you for valuable information. ... View more

Hive databases are not visible in Spark session.

by New Contributor shashank_naresh in Support Questions
‎05-05-2019 04:43 AM
‎05-05-2019 04:43 AM
Hi, I am trying to run spark application which will need access to Hive databases. But Hive databases like FOODMART are not visible in spark session. I did spark.sql("show databases").show(); it is not showing Foodmart database, though spark session is having enableHiveSupport. Below i've tried: 1) cp /etc/hive/conf/hive-site.xml /etc/spark2/conf 2) Changed spark.sql.warehouse.dir in spark UI from /apps/spark/warehouse to /warehouse/tablespace/managed/hive Even though it is not working. Please let me know what configuration changes would be required to have this. Please note - Above is working in HDP2.6.5. ... View more
Contact Me
Online
Offline
Last Visited
‎08-22-2019 01:43 PM
Public Statistics
Date Registered ‎08-16-2019 09:55 AM
Last Visited ‎08-22-2019 01:43 PM
Total Messages Posted 16