Member since
05-17-2018
37
Posts
1
Kudos Received
0
Solutions
06-05-2018
08:16 PM
@David Sandoval Did you ever solve your problem here? I'm running into the same error.
... View more
06-05-2018
02:46 PM
To provide a little more info, I'm seeing this error as well: java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
... View more
06-05-2018
01:37 PM
Has anyone seen this error? I'm trying to load data that currently resides in hdfs into Hive and running into this error And here's the data in hdfs:
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
05-31-2018
08:48 PM
@Geoffrey Shelton Okot Right now, yarn.resourcemanager.scheduler.monitor.enable is set to false. Looks like there are few settings I'll have to add to yarn-site.xml: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_yarn-resource-management/content/preemption.html I'll get to it...
... View more
05-31-2018
07:40 PM
@Geoffrey Shelton Okot @Felix Albani Capacity Scheduler config Yarn Queue Manager- Are there any obviously wrong settings?
... View more
05-31-2018
04:59 PM
@Felix Albani Thanks for the input. Where do I check the yarn scheduler config?
... View more
05-31-2018
04:33 PM
My cluster seems to be having a problem with the App Timeline Server (ATS) and Resource Manager running at the same time. As a test, I stopped both services, cleared out the log files, and just started RM. Ambari shows RM has started fine, but... Here's what I found in the logs. yarn-yarn-resourcemanager-<server>.log 2018-05-31 15:57:42,336 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(779)) - application_1527213246626_3635 State change from NEW to FAILED
2018-05-31 15:57:42,336 WARN rmapp.RMAppImpl (RMAppImpl.java:<init>(423)) - The specific max attempts: 0 for application: 3636 is invalid, because it is out of the range [1, 2]. Use the global max attempts instead.
2018-05-31 15:57:42,336 INFO rmapp.RMAppImpl (RMAppImpl.java:recover(792)) - Recovering app: application_1527213246626_3636 with 0 attempts and final state = FAILED rm-audit.log 2018-05-31 15:57:49,435 WARN resourcemanager.RMAuditLogger: USER=dr.who OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=org.apache.hadoop.security.AccessControlException: Queue root.default already has 1 applications, cannot accept submission of application: application_1527213246626_3508 APPID=application_1527213246626_3508 What's going on here?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Cloudera Manager
05-30-2018
09:24 PM
@Matt Clarke Per your suggestion, I turned on debugging in the nifi-app.log file and captured about 10 seconds of a run. Files are still not being ingested and I'm starting to ret really frustrated Log file attachednifi-applog.zip
... View more
05-29-2018
11:22 PM
@Matt Clarke Quick update: I tried changing the owner:group to nifi:nifi based on the ps -ef | grep nifi Still not seeing any queued FlowFiles nor am I seeing anything in hdfs
... View more
05-29-2018
10:40 PM
@Matt Clarke Your observations are correct, the processors seem to be configured fine, but the GetFile doesn't retrieve the CSV. I ran the ps, but not sure where to find the user that owns nifi (see screenshot) I've attached the latest log file. I don't see any WARN or ERROR logs...nifi-applog.zip
... View more