@Roberto Sancho as you see in my script I am not registering hive jars, just make sure you use -useHCatalog. I had same issue in this thread https://community.hortonworks.com/content/idea/2391/pig-and-hive-actions-should-include-hive-hcatalog.html also in your original script, you're mixing hive and pig 0.11 with hive 1.2.1. That's why I said use latest jars. If you still need to register, go to /usr/hdp/current/pig-client for pig jars and /usr/hdp/current/hive for hive jars. Remove 0.11 jars completely. But in my script I don't even register any pig or hive jars, just fix your classpath. ... View more

Yes just look at my script @Roberto Sancho ... View more

@priya dharshini if Benjamin's answer help, please accept it. ... View more

@Jim Fratzke that's good, progress, please post logs. According to src, its waiting for acks so it is still may look like networking issue. http://grepcode.com/file/repo1.maven.org/maven2/org.apache.hadoop/hadoop-hdfs/0.23.1/org/apache/hadoop/hdfs/DFSOutputStream.java ... View more

@Divya Gehlot please follow the steps in this document http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_spark-guide/content/ch_tuning-spark.html#spark-job-status ... View more

@Brenden Cobb which region are you in? You can tail the Ambari server log for configbstatus. @Mark Herring ... View more

@Pedro Gandola I would say if it works for you, then go ahead, its more trial and error and tuning usually takes a few tries to get optimal performance. I think you have a great foundation and have a good handle on the situation. Keep those questions coming! ... View more

@Jim Fratzke check firewall, in vm settings make sure allow all is enabled for network adapter, your vm fqdn is in /etc/hosts, your hdfs scheme in your URL in your code is properly identified and not recognizing local filesystem. Also hdfs Port on Sandbox is 8020 not 50010. ... View more