Member since
11-11-2016
26
Posts
3
Kudos Received
0
Solutions
12-20-2016
07:28 AM
thanks you , after I deleted log files , my usage space reduced from 98% to 74 % . then I could insert , but could you tell me how can I delete other unused files in ambari or how can I find the path then I can delete the manually?
... View more
12-16-2016
10:11 AM
I went to /hadoop/yarn/log and deleted all and restarted yarn , ut i got same error , do you have another solution ?hiveserver2.txtyarn-yarn-nodemanager-ibm-biginsight.txtyarn-yarn-timelineserver-ibm-biginsight-2.txt
... View more
12-16-2016
09:18 AM
I went to /hadoop/yarn/log and deleted all and restarted yarn , ut i got same error , do you have another solution ?
... View more
12-15-2016
08:26 AM
When I want to run queries such count or insert , I always get INFO : number of splits:1
INFO : Submitting tokens for job: job_1481788223653_0004
INFO : The url to track the job: http://ibm-biginsight.com:8088/proxy/application_1481788223653_0004/ INFO
: Starting Job = job_1481788223653_0004, Tracking URL =
http://ibm-biginsight.com:8088/proxy/application_1481788223653_0004/ INFO : Kill Command = /usr/iop/4.1.0.0/hadoop/bin/hadoop job -kill job. when I check the hive log , it shows that "ERROR mr.ExecDriver (ExecDriver.java:execute(400)) - yarn"
I do not know what to do . I have been stuck around one month , I am unable to do any thing . but I can do queries like show databases or show tables.I have attache the logs .please help to resolve my problem in ambari and my hadoop version is 2.1 hiveserver2log-for-count-query.txthiveserver2-insert-query.txtyarn-log-for-count-query.txtyarn-log-for-insert.txt
... View more
Labels:
- Labels:
-
Apache Hive
-
Cloudera DataFlow (CDF)
12-02-2016
08:46 PM
OK, thanks alot for help , i will try it
... View more
11-24-2016
09:15 AM
1 Kudo
I am using catalana log . my input has is like below lines. for date and others i have no problem but I need to read neext line which is start after INFO . i tried alot but i do not how to bring next line .I have used \\n and \\r but they did not work. my regex is like this . A= LOAD 'catalina.log' USING TextLoader AS (line:chararray); B = FOREACH A GENERATE FLATTEN(REGEX_EXTRACT_ALL(line,
'^([a-zA-z]{3}\\s[0-9]{1,2},\\s[0-9]{4}\\s[0-9]{1,2}:[0-9]{2}:[0-9]{2}\\s[A-Z]{2})\\n+(.*)INFO:(.*))); DUMP B; input :
Nov 3, 2016 11:00:06 AM org.apache.catalina.startup.HostConfig deployDescriptor INFO: Deploying configuration descriptor host-manager.xmlF output: Nov 3, 2016 11:00:06 AM org.apache.catalina.startup.HostConfig deployDescriptor
... View more
Labels:
- Labels:
-
Apache Pig