About HadoopHelp

HadoopHelp · ‎11-17-2019

Hi @rohitmalhotra . I want to create hive table on top hdinsight hdfs path . so is it possible to create hive table on HDinsight HDFS path or directly we have to use blob container address . i think i am not able to find out hdfs path from HDInsight! Thanks HadoopHelp

HadoopHelp · ‎10-22-2019

Dear All. I having issue with creating hive table with hdfs data in Azure HDInsight cluster. i am able to create hive table from BLOB Storage but not with HDFS Data. as below example code for taking data from blob storage:- hive> CREATE EXTERNAL TABLE IF NOT EXISTS tsvtab ( > name string, > region_code int, > sal int, > add string > ) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' > STORED AS TEXTFILE; load data inpath 'wasb://hadoophdinsightigi-2019-10-21t07-33-15-078z@hadooighdistorage.blob.core.windows.net/user/sshuser/data.tsv' into table tsvtab; below taking data from hdfs but not working:- hive> CREATE EXTERNAL TABLE IF NOT EXISTS tsvtab ( > name string, > region_code int, > sal int, > add string > ) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' > STORED AS TEXTFILE; load data inpath 'wasb://hadoophdinsightigi-2019-10-21t07-33-15-078z@hadohdistorage.blob.core.windows.net//user/HadoopPOCDir/data.tsv' into table tsvtab; so please help me....

HadoopHelp · ‎07-26-2019

Hi @dennisli , I hope You are doing well. Please confirm one time in below fields value what i commented:- <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> //this is metadata db </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> //this is metadata db username </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>mypassword</value> //this is metadatapassword </property> Thanks HadoopHelp

HadoopHelp · ‎07-26-2019

Hi @bgooley , I want only delete zero size directory i.e empty directory but condition is here ? *current directory contains some directory data, but some of the directory contains zero size directory in same directory. I hope You understood now? here @michalis has given idea that is matching with my requirements. Thanks HadoopHelp

HadoopHelp · ‎07-26-2019

Thanks @michalis , Your Idea is correct but we need to add jars files as you added in previous ? hadoop jar /opt/cloudera/parcels/CDH-*/jars/search-mr-*-job.jar org.apache.solr.hadoop.HdfsFindTool Is there any option to find empty directory using HDFS command Directly? I appreciated with your idea. Thanks HadoopHelp

HadoopHelp · ‎07-24-2019

Dear All . Below is my data format in pig output file but $1 column contains name :- name dob gender address (LACTE^MIRAM,19659802,F,4395 NOREY AVE^^ATTIC CITY^N9J^09901) (JSON^MAW,19820309,M,COUNTRY CLUB DR^^NORELD^NJ^99225) but want like below:- firstname lastname dob gender address (LACTE,MIRAM,19659802,F,4395 NOREY AVE^^ATTIC CITY^N9J^09901) (JSON,MAW,19820309,M,COUNTRY CLUB DR^^NORELD^NJ^99225) Thanks HadoopHelp

HadoopHelp · ‎07-23-2019

Hi. @avengers this issue basically comes ,when you try to access columns from a parent table to child table and whatever you are trying to access columns that is not matching with your parents table at time of insertion. so suggest you please check your parent table columns and child while trying to Create table or inserting data,loadinging data. Thanks HadoopHelp

HadoopHelp · ‎07-23-2019

Thanks @bgooley . but my situation is like below:- i have dir like:- /user/root/Data/hl71 /user/root/Data/hl72 /user/root/Data/hl73 /user/root/Data/hl74 /user/root/Data/hl75 /user/root/Data/hl76 /user/root/Data/hl77 /user/root/Data/hl78 /user/root/Data/hl79 .............................. .............................. but inside /user/root/Data/* multiple dir conatins zero size and as well data dir also.so as per your responce :- (hdfs dfs -rmdir /tmp/emptydir) this will remove all dir from /user/root/Data/* Note:-only want want delete zero size dir ,not want to delete data conatains dir. so help with some other idea. Thanks HadoopHelp

HadoopHelp · ‎07-22-2019

how to delete zero size directory from hdfs path. thanks HadoopHelp

HadoopHelp · ‎05-24-2019

Dear All. I have a table in hive but it taking more time due to huge data available in that table... so plz guide me which tools will help me to get data under a second/mili..second tools like:- Drill or Presto? plz help....... Thanks HadoopHelp

Online	Offline
Last Visited	‎02-20-2021 08:44 AM

Member Since	‎03-04-2019 06:35 AM
Last Visited	‎02-20-2021 08:44 AM
Posts	67
Kudos received	2

Cloudera Community

Re: Error in reading database through hive using p...

Re: What is the latest downloadable quickstart vm ...

Re: how to create hive table in HDInsight with HDF...

Re: how to create hive table in HDInsight with HDF...

how to create hive table in HDInsight with HDFS da...

Re: Hive Errors happend when execute hive --servic...

Re: how to delete zero size directory from hdfs pa...

Re: how to delete zero size directory from hdfs pa...

how to split tuple into to different columns in pi...

Re: HiveException "Number of input columns was dif...

Re: how to delete zero size directory from hdfs pa...

how to delete zero size directory from hdfs path

Re: Drill - Hive connectivity : Can't get Master K...