Member since
03-04-2019
67
Posts
2
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3706 | 03-18-2020 01:42 AM | |
1855 | 03-11-2020 01:09 AM | |
2369 | 12-16-2019 04:17 AM |
11-17-2019
11:55 PM
Hi @rohitmalhotra . I want to create hive table on top hdinsight hdfs path . so is it possible to create hive table on HDinsight HDFS path or directly we have to use blob container address . i think i am not able to find out hdfs path from HDInsight! Thanks HadoopHelp
... View more
10-22-2019
04:17 AM
Dear All.
I having issue with creating hive table with hdfs data in Azure HDInsight cluster.
i am able to create hive table from BLOB Storage but not with HDFS Data.
as below example code for taking data from blob storage:-
hive> CREATE EXTERNAL TABLE IF NOT EXISTS tsvtab ( > name string, > region_code int, > sal int, > add string > ) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' > STORED AS TEXTFILE;
load data inpath 'wasb://hadoophdinsightigi-2019-10-21t07-33-15-078z@hadooighdistorage.blob.core.windows.net/user/sshuser/data.tsv' into table tsvtab;
below taking data from hdfs but not working:-
hive> CREATE EXTERNAL TABLE IF NOT EXISTS tsvtab ( > name string, > region_code int, > sal int, > add string > ) > ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' > STORED AS TEXTFILE;
load data inpath 'wasb://hadoophdinsightigi-2019-10-21t07-33-15-078z@hadohdistorage.blob.core.windows.net//user/HadoopPOCDir/data.tsv' into table tsvtab;
so please help me....
... View more
Labels:
- Labels:
-
Apache Hive
07-26-2019
09:00 AM
Hi @dennisli , I hope You are doing well. Please confirm one time in below fields value what i commented:- <property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value> //this is metadata db
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive</value> //this is metadata db username
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>mypassword</value> //this is metadatapassword
</property> Thanks HadoopHelp
... View more
07-26-2019
08:07 AM
Hi @bgooley , I want only delete zero size directory i.e empty directory but condition is here ? *current directory contains some directory data, but some of the directory contains zero size directory in same directory. I hope You understood now? here @michalis has given idea that is matching with my requirements. Thanks HadoopHelp
... View more
07-26-2019
08:01 AM
Thanks @michalis , Your Idea is correct but we need to add jars files as you added in previous ? hadoop jar /opt/cloudera/parcels/CDH-*/jars/search-mr-*-job.jar org.apache.solr.hadoop.HdfsFindTool Is there any option to find empty directory using HDFS command Directly? I appreciated with your idea. Thanks HadoopHelp
... View more
07-24-2019
03:59 AM
Dear All . Below is my data format in pig output file but $1 column contains name :- name dob gender address (LACTE^MIRAM,19659802,F,4395 NOREY AVE^^ATTIC CITY^N9J^09901) (JSON^MAW,19820309,M,COUNTRY CLUB DR^^NORELD^NJ^99225) but want like below:- firstname lastname dob gender address (LACTE,MIRAM,19659802,F,4395 NOREY AVE^^ATTIC CITY^N9J^09901) (JSON,MAW,19820309,M,COUNTRY CLUB DR^^NORELD^NJ^99225) Thanks HadoopHelp
... View more
07-23-2019
04:36 AM
Hi. @avengers this issue basically comes ,when you try to access columns from a parent table to child table and whatever you are trying to access columns that is not matching with your parents table at time of insertion. so suggest you please check your parent table columns and child while trying to Create table or inserting data,loadinging data. Thanks HadoopHelp
... View more
07-23-2019
03:37 AM
Thanks @bgooley . but my situation is like below:- i have dir like:- /user/root/Data/hl71 /user/root/Data/hl72 /user/root/Data/hl73 /user/root/Data/hl74 /user/root/Data/hl75 /user/root/Data/hl76 /user/root/Data/hl77 /user/root/Data/hl78 /user/root/Data/hl79 .............................. .............................. but inside /user/root/Data/* multiple dir conatins zero size and as well data dir also.so as per your responce :- (hdfs dfs -rmdir /tmp/emptydir) this will remove all dir from /user/root/Data/* Note:-only want want delete zero size dir ,not want to delete data conatains dir. so help with some other idea. Thanks HadoopHelp
... View more
07-22-2019
07:05 AM
how to delete zero size directory from hdfs path. thanks HadoopHelp
... View more
05-24-2019
03:10 AM
Dear All. I have a table in hive but it taking more time due to huge data available in that table... so plz guide me which tools will help me to get data under a second/mili..second tools like:- Drill or Presto? plz help....... Thanks HadoopHelp
... View more
- « Previous
- Next »