abhitd14
Explorer

PIG Nested Json Query

by Explorer in Support Questions
‎07-27-2017 07:19 AM
‎07-27-2017 07:19 AM
sample-complex.txtHi All, I am running PIG query as mentioned below grunt> a = LOAD '/user/maria_dev/Sample_Complex.txt' USING JsonLoader ('recipe:chararray,ingredients:{(name:chararray)},inventor:(name:chararray,age:int)'); grunt> b = FOREACH a GENERATE recipe; grunt> DUMP b; Output is (Tacos) (TomatoSoup) But I want to get the output as Recipe (Tacos) (TomatoSoup) Please Suggest Samle dataset is also attached ... View more
Labels:

Re: Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 06:39 AM
‎07-27-2017 06:39 AM
@Jay SenSharma screen-shot-2017-07-27-at-120755-pm.pngAgain Getting the same error ... View more

Re: Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 06:06 AM
‎07-27-2017 06:06 AM
@Jay SenSharma I have sent you the complete log . The issue might be due to the Maria_dev user don't have access on the same ? Can you please try on your system. Regards Abhishek ... View more

Re: Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 05:43 AM
‎07-27-2017 05:43 AM
@Jay SenSharma Please find the complete log.ambari-servertxt.zip ... View more

Re: Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 05:31 AM
‎07-27-2017 05:31 AM
@Jay SenSharma For where to check the same . Path ? ... View more

Re: Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 05:23 AM
‎07-27-2017 05:23 AM
@Jay SenSharma Hi , By Clicking in Details . got the msg as attached.screen-shot-2017-07-27-at-105216-am.png ... View more

Re: Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 05:13 AM
‎07-27-2017 05:13 AM
Hi , Error and file attached.screen-shot-2017-07-27-at-102823-am.png ... View more

Unable to Load Json File via Ambari

by Explorer in Support Questions
‎07-27-2017 05:03 AM
‎07-27-2017 05:03 AM
Hi , I am unable to upload json file in HDFS using Ambari ( File View ). Getting error as Attached Sample file is also attached for your reference. ... View more
Labels:

Re: Unable to download live tweets into hdfs

by Explorer in Support Questions
‎07-24-2017 03:04 PM
‎07-24-2017 03:04 PM
@@Geoffrey Shelton Okot Hi , I am unable to do download the live tweets . My process stops at the following steps. PFB the logs [root@sandbox apache-flume-1.4.0-bin]# ./bin/flume-ng agent -n TwitterAgent -c conf -f /usr/lib/apache-flume-1.4.0-bin/conf/flume.conf Info: Including Hadoop libraries found via (/usr/bin/hadoop) for HDFS access Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/tez/lib/slf4j-api-1.7.5.jar from classpath Info: Including HBASE libraries found via (/usr/bin/hbase) for HBASE access Info: Excluding /usr/hdp/2.4.0.0-169/hbase/lib/slf4j-api-1.7.7.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/tez/lib/slf4j-api-1.7.5.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-api-1.6.1.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-log4j12-1.6.1.jar from classpath + exec /usr/lib/jvm/java/bin/java -Xmx20m -cp '/usr/lib/apache-flume-1.4.0-bin/conf:/usr/lib/apache-flume-1.4.0-bin/lib/*:/usr/hdp/2.4.0.0-169/hadoop/conf:/usr/hdp/2.4.0.0-169/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.0.0- . . . Regards Abhishek ... View more

Re: Unable to download live tweets into hdfs

by Explorer in Support Questions
‎07-24-2017 03:35 AM
‎07-24-2017 03:35 AM
@Geoffrey Shelton Okot Hi , You mentioned to use Twitter.Type as org.apache.flume.source.twitter.TwitterSource But as I told I you I am using hortonworks sandbox hdp 2.4 . Will it work for it as well ? Also what does FQDN stands for ? Please explain Regards Abhishek ... View more

Unable to download live tweets into hdfs

by Explorer in Support Questions
‎07-23-2017 06:41 AM
‎07-23-2017 06:41 AM
Hi All, I want to download live tweets from twitter.com into hdfs. i have followed all the steps mentioned in the link https://www.eduonix.com/blog/bigdata-and-hadoop/flume-installation-and-streaming-twitter-data-using-flume/ In flume.conf i need few clarification like as mentioned in flume.conf file TwitterAgent.sources.Twitter.type = com.cloudera.flume.source.TwitterSource TwitterAgent.sinks.HDFS.hdfs.path=hdfs://localhost:9000/user/flume/tweets I am using hdp 2.4 sandbox . So what will be values for TwitterAgent.sources.Twitter.type = TwitterAgent.sinks.HDFS.hdfs.path= Please help me on this. Regards Abhishek ... View more
Labels:

Re: Hi All , Please help me to find the location ...

by Explorer in Support Questions
‎07-11-2016 02:24 PM
1 Kudo
‎07-11-2016 02:24 PM
1 Kudo
Thanks @Laurent Edel I have updated the value as follows <property> <name>hive.metastore.warehouse.dir</name> <value>/user/hive/warehouse</value> </property> But still Database object is created in the default path as shown /apps/hive/warehouse Regards Abhishek ... View more
Contact Me
Online
Offline
Last Visited
‎11-15-2017 03:05 AM
Public Statistics
Date Registered ‎06-11-2016 11:27 AM
Last Visited ‎11-15-2017 03:05 AM
Total Messages Posted 23
Total Kudos Received 1