@Nick Giammanco As per WARN message you shared HttpParser is failing to parse the response from a HTTP request I think. Could you check If same code runs fine on local mode --master local? If same code runs fine in local mode perhaps there is a firewall/network issue when you run the code in yarn-cluster mode (driver and executors will run on cluster worker nodes), which causes the HTTP requests to fail. Another point to check is whether you need to use an http-proxy. HTH ... View more

@tthomas If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

@raouia Please check the following: https://stackoverflow.com/questions/44217654/how-to-recover-zookeeper-from-java-io-eofexception-after-a-server-crash The above lists few solutions you can take to resolve this problem. HTH ... View more

@Pirlouis Pirlouis I can see 401 is coming from hiveserver2. Hive is not authorizing the access to /cliservice?doAs=myuser DEBUG hadoop.gateway (DefaultDispatch.java:executeOutboundRequest(121)) - Dispatch request: POST http://my_http_hive_hostname:10011/cliservice?doAs=myuser DEBUG hadoop.gateway (DefaultDispatch.java:executeOutboundRequest(134)) - Dispatch response status: 401 Few things to check: 1. Check ambari > hdfs > configs> core-site.xml contains > hadoop.proxyuser.knox.groups=* and hadoop.proxyuser.knox.hosts=* 2. Check ambari > hive > configs > Custom webhcat-site > webhcat.proxyuser.knox.groups=* and webhcat.proxyuser.knox.hosts=* 3. Enable debug on hiveserver2, hopefully this will print the reason behind the 401 error being returned by hs2 4. Finally, in my experience this has helped. On knox host run the following command to see the html response coming back from hs2: tcpdump -A port 10011 HTH ... View more

@Anurag Mishra Please take a moment to login and click the "accept" link on the answer if you think the above helped address your question. ... View more

@Vinay K yes, you will need to add appropiate policies on Ranger to authorize users to resources. ... View more

@Pirlouis Pirlouis what is the full error stack you see while running beeline? Also tail -f the /var/log/hive/hiveserver2.log (hiveserver2 host) and the /var/log/knox/gateway.log (knox host) while running the beeline !connect, hopefully we will get more details as to why is failing. ... View more

@Dakota M I recently came across an article where they are parsing html pages for images. Perhaps this helps you as well. Article here ... View more

@tthomas Have you consider EvaluateJsonPath with Destination flowfile attribute? https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.6.0/org.apache.nifi.processors.standard.EvaluateJsonPath/index.html Here is an example screenshot of how it looks for twitter json feed: HTH ... View more