generally working now. except that every time it runs, it returns one and exactly one result .json file. i find it hard to believe that there is exactly one tweet meeting my criteria ever 30 seconds. ... View more

I've just finished reading up on twitter's API and perhaps rate-limiting is the issue. I'm using a template pulled from HWX and it looks like it had the scheduling set to zero seconds. I have increased it to 30 seconds and still it does not work. Will reset my keys and see if that fixes it. perhaps twitter cuts off access for those identifiers. What is a "reasonable" schedule time that won't run into the rate limit? Here are some log messages: 2016-07-27 05:38:49,352 INFO [hosebird-client-io-thread-0] com.twitter.hbc.httpclient.ClientBase GetTwitter[id=b2e83358-2e38-42c5-88a7-9f8a3f8307ba] Establishing a connection 2016-07-27 05:38:50,837 WARN [hosebird-client-io-thread-0] com.twitter.hbc.httpclient.ClientBase GetTwitter[id=b2e83358-2e38-42c5-88a7-9f8a3f8307ba] Error connecting w/ status code - 420, reason - Enhance Your Calm 2016-07-27 05:39:07,949 ERROR [Timer-Driven Process Thread-2] o.a.nifi.processors.twitter.GetTwitter GetTwitter[id=b2e83358-2e38-42c5-88a7-9f8a3f8307ba] Received error HTTP_ERROR: HTTP/1.1 420 Enhance Your Calm. Will attempt to reconnect ... View more

thanks! had this same problem and getting ntpd running properly fixed it. ... View more

I got now(72,0) to work. don't know the ramifications.... ... View more

thanks! that's what I was trying to do but couldn't figure out the right syntax. ... View more

@nmaillard thanks. checked as you say and all is as expected. tried again and got the same error. same stack trace. If this helps, I can run spark from within zeppelin. Problem seems to be only with hive interpreter. ... View more

@Neeraj Sabharwal thanks. I killed all of the yarn applications and tried again. Both the hive CLI and the ambari hive query editor still hang up. the initial issue (reported separately) was with the ambari hive query: CREATE TABLE events STORED AS ORC AS SELECT driverid, city, state FROM geolocation; as per the tutorial. so perhaps the issue is with creating ORC files? and that is hung and cascading back to any hive activity? All I am doing is trying to follow the tutorial. very frustrating. here is yarn application list: ^C[hive@sandbox hive]$ yarn application -list 16/05/02 14:38:35 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 16/05/02 14:38:35 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050 Total number of applications (application-types: [] and states: [SUBMITTED, ACCEPTED, RUNNING]):1 Application-Id Application-Name Application-Type User Queue State Final-State Progress Tracking-URL application_1461958087140_0034 HIVE-c01d9d1e-b461-4770-822b-b46a7ceeecf2 TEZ hive default RUNNING UNDEFINED 0% http://sandbox.hortonworks.com:44396/ui/ [hive@sandbox hive]$ yarn application -list 16/05/02 14:41:24 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 16/05/02 14:41:24 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050 Total number of applications (application-types: [] and states: [SUBMITTED, ACCEPTED, RUNNING]):2 Application-Id Application-Name Application-Type User Queue State Final-State Progress Tracking-URL application_1461958087140_0035 HIVE-caf7b780-54c9-436b-9c90-28bd6db769dd TEZ hive default RUNNING UNDEFINED 0% http://sandbox.hortonworks.com:51481/ui/ application_1461958087140_0034 HIVE-c01d9d1e-b461-4770-822b-b46a7ceeecf2 TEZ hive default RUNNING UNDEFINED 0% http://sandbox.hortonworks.com:44396/ui/ [hive@sandbox hive]$ ... View more

hivelog.txtattached is the hive log. just tried this again and same thing happened. just a nuisance, but the upload refuses to accept files with extension of .log. sigh.... ... View more

@hduraiswamy this seems to be an IE 11 compatibility issue. It works fine with Chrome. Chrome shows all of the pig scripts that were created. IE shows some of them. it seems to show only those that were created during a prior session. I created two new ones just now. one with chrome, one with IE. Chrome shows all of the scripts (created previously, new from chrome, new from IE), IE doesn't show the ones that were just created (either with chrome or IE). ... View more

@hduraiswamy I know the problem. It is an IE 11 feature that I encountered and dealt with for one of my own apps. I can do the upload with Chrome. IE 11 passes the full local file pathname at times (depends upon user browser options) . Ambari needs to strip off the path prefix when forming the server filename. ... View more

yes it is the sandbox, out of the box, no config changes made. just downloaded it the other day, so it is the most recent version. browser IE 11 I've noticed a couple of other weird things happening, and I have a suspicion of browser compatibility issues with IE 11. will try this with chrome. trying to save into the default directory, just following the tutorial scripts. so whatever directories, permissions etc. that are set in the sandbox VM are what are being used. will check on permissions. ... View more

thanks @hduraiswamy used filezilla to do the uploads. would be nice it this ambari feature worked because it is really convenient. ... View more