Member since
06-11-2016
23
Posts
1
Kudos Received
0
Solutions
07-27-2017
07:19 AM
sample-complex.txtHi All, I am running PIG query as mentioned below grunt> a = LOAD '/user/maria_dev/Sample_Complex.txt' USING JsonLoader ('recipe:chararray,ingredients:{(name:chararray)},inventor:(name:chararray,age:int)'); grunt> b = FOREACH a GENERATE recipe; grunt> DUMP b; Output is (Tacos) (TomatoSoup) But I want to get the output as Recipe (Tacos) (TomatoSoup) Please Suggest Samle dataset is also attached
... View more
- Tags:
- Data Processing
- Pig
Labels:
- Labels:
-
Apache Pig
07-27-2017
06:39 AM
@Jay SenSharma screen-shot-2017-07-27-at-120755-pm.pngAgain Getting the same error
... View more
07-27-2017
06:06 AM
@Jay SenSharma I have sent you the complete log . The issue might be due to the Maria_dev user don't have access on the same ? Can you please try on your system. Regards Abhishek
... View more
07-27-2017
05:23 AM
@Jay SenSharma Hi , By Clicking in Details . got the msg as attached.screen-shot-2017-07-27-at-105216-am.png
... View more
07-27-2017
05:13 AM
Hi , Error and file attached.screen-shot-2017-07-27-at-102823-am.png
... View more
07-27-2017
05:03 AM
Hi , I am unable to upload json file in HDFS using Ambari ( File View ). Getting error as Attached Sample file is also attached for your reference.
... View more
Labels:
- Labels:
-
Apache Ambari
07-24-2017
03:04 PM
@@Geoffrey Shelton Okot Hi , I am unable to do download the live tweets . My process stops at the following steps. PFB the logs [root@sandbox apache-flume-1.4.0-bin]# ./bin/flume-ng agent -n TwitterAgent -c conf -f /usr/lib/apache-flume-1.4.0-bin/conf/flume.conf Info: Including Hadoop libraries found via (/usr/bin/hadoop) for HDFS access Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/tez/lib/slf4j-api-1.7.5.jar from classpath Info: Including HBASE libraries found via (/usr/bin/hbase) for HBASE access Info: Excluding /usr/hdp/2.4.0.0-169/hbase/lib/slf4j-api-1.7.7.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/tez/lib/slf4j-api-1.7.5.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-api-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-api-1.6.1.jar from classpath Info: Excluding /usr/hdp/2.4.0.0-169/zookeeper/lib/slf4j-log4j12-1.6.1.jar from classpath + exec /usr/lib/jvm/java/bin/java -Xmx20m -cp '/usr/lib/apache-flume-1.4.0-bin/conf:/usr/lib/apache-flume-1.4.0-bin/lib/*:/usr/hdp/2.4.0.0-169/hadoop/conf:/usr/hdp/2.4.0.0-169/hadoop/lib/activation-1.1.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/api-util-1.0.0-M20.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/asm-3.2.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/avro-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/aws-java-sdk-1.7.4.jar:/usr/hdp/2.4.0.0-169/hadoop/lib/azure-storage-2.2.0.jar:/usr/hdp/2.4.0.0- . . . Regards Abhishek
... View more
07-24-2017
03:35 AM
@Geoffrey Shelton Okot Hi , You mentioned to use Twitter.Type as org.apache.flume.source.twitter.TwitterSource But as I told I you I am using hortonworks sandbox hdp 2.4 . Will it work for it as well ? Also what does FQDN stands for ? Please explain Regards Abhishek
... View more
07-23-2017
06:41 AM
Hi All, I want to download live tweets from twitter.com into hdfs. i have followed all the steps mentioned in the link https://www.eduonix.com/blog/bigdata-and-hadoop/flume-installation-and-streaming-twitter-data-using-flume/ In flume.conf i need few clarification like as mentioned in flume.conf file TwitterAgent.sources.Twitter.type = com.cloudera.flume.source.TwitterSource TwitterAgent.sinks.HDFS.hdfs.path=hdfs://localhost:9000/user/flume/tweets I am using hdp 2.4 sandbox . So what will be values for TwitterAgent.sources.Twitter.type = TwitterAgent.sinks.HDFS.hdfs.path= Please help me on this. Regards Abhishek
... View more
Labels:
- Labels:
-
Apache Flume
07-11-2016
02:24 PM
1 Kudo
Thanks @Laurent Edel I have updated the value as follows <property>
<name>hive.metastore.warehouse.dir</name>
<value>/user/hive/warehouse</value>
</property> But still Database object is created in the default path as shown /apps/hive/warehouse Regards Abhishek
... View more