Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
frisch
frisch
Cloudera Employee

Re: Undeletable HDFS Files

by frisch Cloudera Employee in Support Questions
‎10-28-2019 10:40 AM
‎10-28-2019 10:40 AM
Since Hadoop 2.8, it is possible to make a directory protected and so all its files cannot be deleted, using : fs.protected.directories property.   From documentation: "A comma-separated list of directories which cannot be deleted even by the superuser unless they are empty. This setting can be used to guard important system directories against accidental deletion due to administrator error."   It does not exactly answer the question but it is a possibility. ... View more

Re: ImportError: No module named pyspark_llap

by frisch Cloudera Employee in Support Questions
‎10-14-2019 02:30 AM
‎10-14-2019 02:30 AM
Hello @sduraisankar93,   If you are facing this issue, as you said it's because you do not have imported the module.   I believe you should check this documentation on how to import HWC and use it : https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.4/integrating-hive/content/hive_configure_a_spark_hive_connection.html   If you are using Zeppelin, please check this : https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.4/integrating-hive/content/hive_zeppelin_configuration_hivewarehouseconnector.html   Note that, in Zeppelin pysark configuration could not work, so a work around is to set (via Ambari) in Zeppelin-env.sh section, this configuration : export SPARK_SUBMIT_OTPIONS="--jars usr/hdp/current/hive_warehouse_connector/hive-warehouse-connector-assembly-<version>.jar --py-files usr/hdp/current/hive_warehouse_connector/hive-warehouse-connector-assembly-<version>.zip"   Then to start a pyspark shell on your machines, launch this command : pyspark --jars /usr/hdp/current/hive_warehouse_connector/hive-warehouse-connector-assembly-jar --py-files /usr/hdp/current/hive_warehouse_connector/pyspark_hwc-.zip ... View more
Contact Me
Online
Offline
Last Visited
‎11-15-2019 11:04 AM
Public Statistics
Date Registered ‎05-13-2019 09:29 AM
Last Visited ‎11-15-2019 11:04 AM
Total Messages Posted 2