Member since
09-10-2015
54
Posts
24
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2303 | 10-20-2016 07:44 PM | |
7185 | 10-16-2016 03:14 PM | |
2601 | 05-11-2016 02:16 PM | |
1930 | 09-29-2015 08:27 PM |
10-16-2016
03:30 PM
Just DUMP the relation filteHeader to verify the same.
... View more
10-16-2016
03:22 PM
Thats correct. Your full file is what you load initially. Try the following: filterHeader = STREAM fullFile THROUGH `tail -n +10| head -n -1`; and DUMP filterHeader; to verify the same.
... View more
10-16-2016
03:14 PM
2 Kudos
@Simran Kaur - If the headers and trailers are static, you can eliminate them using PIG STREAM. For example, Once you load the file to a relation, you can stream through the file to remove the first 10 lines as follows: filterHeader = STREAM fullFile THROUGH `tail -n +10`; Hope this helps!!
... View more
10-15-2016
04:36 PM
@Rogerio Biondi What is the permission set on the UDF jar file ?
... View more
10-14-2016
08:54 PM
Please check the following property on HDFS Config to see if the Ranger Hook is enabled. dfs.namenode.inode.attributes.provider.class=org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer
... View more
07-17-2016
06:46 PM
@vijayakumar Ramdoss yes. Need an Ambari I'd with admin / super user access.
... View more
06-01-2016
02:15 PM
@Tajinderpal Singh Also, look at mapreduce.job.reduce.slowstart.completedmaps properties in map-reduce and set this to 0.9. This property will ensure reducers not coming in early and waiting for mappers to complete there by avoiding hung jobs.
... View more
05-11-2016
11:58 PM
Please provide the hiveserver2.log. Also check the RM to see the job has launched and it is in an accepted state. If yes, check what is it waiting on.
... View more
05-11-2016
02:16 PM
1 Kudo
@Vaibhav YadavI think you can try collapsing the inner query as follows: select driverid, count(event) from geolocation where event!='normal' group by driverid;
... View more
05-09-2016
05:36 PM
@Roberto Sancho You can go with ambari-agent and have the properties file in /etc/ambari-agent/conf/ambari-agent.ini to point to the ambari server and start the agent. That would make things faster. Please make sure you disable iptables and selinux.
... View more