About sandyy006

sandyy006 · ‎09-24-2018

@Mahadevan Swamy Did the above mentioned property helped in addressing your query? If yes, Could you please login and mark this answer as "Accept" to close this thread.

sandyy006 · ‎09-22-2018

@Mahadevan Swamy You can use --exclude-tables <tables> Option [Comma separated list of tables to exclude from import process] with the sqoop import-all-tables command. Hope this helps.

sandyy006 · ‎09-22-2018

@Sami Ahmad The sqoop output is generating a orc snappy file and the hive table you have created is a orc table without any compression. Do create a table with compression type snappy. CREATE TABLE mytable (...) STORED AS orc tblproperties ("orc.compress"="SNAPPY");

sandyy006 · ‎09-19-2018

@Christopher Falter What is the master you are running the job with? Make sure hive-site.xml is present in /etc/spark/conf/ and if it is a yarn-cluster mode please pass the hive-site.xml using --files parameter in spark-submit command.

sandyy006 · ‎09-19-2018

@Takefumi Oide The file/directory you mentioned are correct, apart from that i don't think there is any other location/file which has this information. Ref: https://hortonworks.com/blog/hdfs-metadata-directories-explained/

sandyy006 · ‎09-19-2018

@Hamza Rashid This should be broker hostname and port(default 6667, "listeners" property will have the configured port in your environment) instead of zookeeper port.

sandyy006 · ‎09-19-2018

@Rakesh S Disabling SPNEGO while keeping kerberos enabled is not a supported configuration in storm, you will have to disable kerberos and SPNEGO entirely on the cluster. Here is the storm jira https://issues.apache.org/jira/browse/STORM-2377 asking for read-only option for users without spnego. Hope this helps.

sandyy006 · ‎09-14-2018

@Ronnie 10 , Do consider accepting the answer if it helped you 🙂

sandyy006 · ‎09-14-2018

@Daniel Zafar Did this help in addressing your query? if yes, please confider accepting the answer and mark this thread as closed.

sandyy006 · ‎09-12-2018

Great one @Jonathan Sneep

Online	Offline
Last Visited	‎01-23-2020 02:33 AM

Member Since	‎02-01-2019 10:51 AM
Last Visited	‎01-23-2020 02:33 AM
Posts	650
Kudos received	142

Cloudera Community

Re: Distributed I/O Benchmark of HDFS

Re: How to reset Ambari admin password in Ambari 2...

Re: Discovering existing Hive tables in Atlas

Re: Does Distcp use Tez now in HDP 3.0 instead of ...

Re: hive server2 interactive logs

Re: Sqoop import remaining tables into HDFS

Re: Sqoop import remaining tables into HDFS

Re: malformed ORC file format

Re: Unable to find Hive database from Pyspark scri...

Re: What stores clusterID, namespaceID, and blockp...

Re: Consume Kafka processor not working

Re: How to disable HTTP spnego authentication for...

Re: will Hortonworks create hdfs folder under /dat...

Re: Cannot Disable Tez with Hive on HDP3.0

Re: Monitoring Spark 2 performance via Grafana in ...