Member since
03-04-2019
67
Posts
2
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5143 | 03-18-2020 01:42 AM | |
2616 | 03-11-2020 01:09 AM | |
3150 | 12-16-2019 04:17 AM |
02-12-2020
05:18 AM
Hi . any solution you found for same . i having the same issue the accessing the hive through python. Thanks HadoopHelp
... View more
02-03-2020
07:17 AM
Hi @mike_bronson7 . I think you need to continue here:- https://community.cloudera.com/t5/Support-Questions/how-to-know-if-any-service-in-ambari-cluster-need-to-restart/td-p/228707 Thanks HadoopHelp
... View more
01-06-2020
11:42 PM
Hi @EricL . Thank you very much... but the same use case is here:- this is my output data structure from a JSON we required:- {
"name": [
{
"use": "official", //here "tab1.use" is column and value
"family": "family",//here "tab1.family" is column and value
"given": [ //this column we need to create and add value from "tab1.fn&ln"
"first1", //here "first1" is coming from tab1.fname
"last1" //here "last1"is coming from tab1.lname
]
},
{
"use": "usual", //here "tab2.use" is column and value
"given": [ //here we need to create column with fn&ln
"first1 last1" //here "first1 last1" is coming from tab1.fname &tab1.lname
]
}
]
}
here we want to create a column(name) from above columns :-
above data is JSON structure but i want in Hive with table columns.
then further we can convert the same into JSON in my use cases.
Note :- structure is matter here.
Thanks
HadoopHelp
... View more
01-06-2020
07:53 AM
Dear All. i having some issue with combining two columns fields into single fields as STruct type. below code i tried but still getting the same issue? create table dummy_TBL2 (id int,fname string ,lname string) ;
insert into dummy_TBL2 (id,fname,lname) values(1,'bhau','anna') ; //dummy side
now below show the struct table:-
create table data_TBL2 (id int, name struct<fname:string,lname:string>)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
STORED AS TEXTFILE;//in this table i took name as struct type
___inserting the data from dummy into struct type-----
insert into table data_TBL2
select id,
name(fname,lname)
from dummy_TBL2 limit 1; Thanks HadoopHelp
... View more
Labels:
12-18-2019
02:22 AM
hI @cjervis . Please use below Download link:- https://www.cloudera.com/downloads/hortonworks-sandbox/hdp.html I jest verified Thanks HadoopHelp
... View more
12-17-2019
07:54 AM
Hi All. Here is all steps for doing same!!! Link :- https://www.oreilly.com/library/view/hadoop-with-python/9781492048435/ch01.html Thanks HadoopHelp
... View more
12-17-2019
07:48 AM
Hi All . here is more Details about above :- https://community.cloudera.com/t5/Support-Questions/HDInsight-Vs-HDP-Service-on-Azure-Vs-HDP-on-Azure-IaaS/m-p/166424 Thanks HadoopHelp
... View more
12-16-2019
05:06 AM
Hi . Please try with below step :- df = spark.read.format("csv").option("header", "true").load("csvfile.csv") just remove "hdfs:///" from path and also try to create separate dir within user dir or other. then load that data and give that path with your code! Thanks HadoopHelp
... View more
12-16-2019
04:17 AM
Hi @rohitmalhotra . Thanks!! i found this solution already!!! problem was :- not able to get exact HDFS Path as last post i mentioned . i checked core.site.xml file with Azure HDInsight cluster DFS File path:- Thanks HadoopHelp
... View more
12-09-2019
01:50 AM
Hi @redwuie . you can do this activity with Azure HDInsight Cluster as below LInk:- http://dbmentors.blogspot.com/2018/02/integrating-hadoop-cluster-with.html(this is not on premise) But as per my concern i tried a lot to do the same with on premise hadoop cluster but that not worked . there is only single solution for that if you want to move data from Hadoop on premise cluster to Azure data lake or Blob then you have to use Azure Data Box. Thanks HadoopHelp
... View more