About grajagopal

grajagopal · ‎10-16-2016

Just DUMP the relation filteHeader to verify the same.

grajagopal · ‎10-16-2016

Thats correct. Your full file is what you load initially. Try the following: filterHeader = STREAM fullFile THROUGH `tail -n +10| head -n -1`; and DUMP filterHeader; to verify the same.

grajagopal · ‎10-16-2016

@Simran Kaur - If the headers and trailers are static, you can eliminate them using PIG STREAM. For example, Once you load the file to a relation, you can stream through the file to remove the first 10 lines as follows: filterHeader = STREAM fullFile THROUGH `tail -n +10`; Hope this helps!!

grajagopal · ‎10-15-2016

@Rogerio Biondi What is the permission set on the UDF jar file ?

grajagopal · ‎10-14-2016

Please check the following property on HDFS Config to see if the Ranger Hook is enabled. dfs.namenode.inode.attributes.provider.class=org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

grajagopal · ‎07-17-2016

@vijayakumar Ramdoss yes. Need an Ambari I'd with admin / super user access.

grajagopal · ‎06-01-2016

@Tajinderpal Singh Also, look at mapreduce.job.reduce.slowstart.completedmaps properties in map-reduce and set this to 0.9. This property will ensure reducers not coming in early and waiting for mappers to complete there by avoiding hung jobs.

grajagopal · ‎05-11-2016

Please provide the hiveserver2.log. Also check the RM to see the job has launched and it is in an accepted state. If yes, check what is it waiting on.

grajagopal · ‎05-11-2016

@Vaibhav YadavI think you can try collapsing the inner query as follows: select driverid, count(event) from geolocation where event!='normal' group by driverid;

grajagopal · ‎05-09-2016

@Roberto Sancho You can go with ambari-agent and have the properties file in /etc/ambari-agent/conf/ambari-agent.ini to point to the ambari server and start the agent. That would make things faster. Please make sure you disable iptables and selinux.

Online	Offline
Last Visited	‎08-15-2019 06:35 AM

Member Since	‎09-10-2015 05:52 PM
Last Visited	‎08-15-2019 06:35 AM
Posts	54
Kudos received	24

Cloudera Community

Re: Apache Sqoop : How Sqoop can be used with Java...

Re: How to remove header and footer from a CSV fil...

Re: Converting Lab3 PIG script to HIVE

Re: Falcon Passing parameters to existing Oozie Wo...

Re: How to remove header and footer from a CSV fil...

Re: How to remove header and footer from a CSV fil...

Re: How to remove header and footer from a CSV fil...

Re: Hive UDF not running with other user than HDFS

Re: How to troubleshoot creation of default servic...

Re: Is there a way to execute Ambari service check...

Re: how to set number of map and reduce tasks

Re: INSERT COMMAND HANGING

Re: Converting Lab3 PIG script to HIVE

Re: Adding Hosts to a Cluster