Member since
01-09-2016
70
Posts
30
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
8145 | 01-27-2016 04:47 PM |
01-27-2016
04:47 PM
The issue has been resolved. The entity was corrupt and we restored the falcon Store and WebApp.
... View more
01-27-2016
01:21 AM
Please see the log in my previous response. The output of ps -ef | grep falcon falcon 13996 1 3 01:00 ? 00:00:31 /usr/jdk64/jdk1.7.0_67/bin/java -Xmx1024m -noverify -Dfalcon.embeddedmq=True -Dfalcon.emeddedmq.port=61616 -Dfalcon.log.dir=/var/log/falcon -Dfalcon.embeddedmq.data=/hadoop/falcon/embeddedmq/data -Dfalcon.home=/usr/hdp/current/falcon-server -Dconfig.location=/usr/hdp/current/falcon-server/conf -Dfalcon.app.type=falcon -Dfalcon.catalog.service.enabled= -cp /usr/hdp/current/falcon-server/conf:/usr/hdp/2.3.2.0-2950/hadoop/conf:/usr/hdp/2.3.2.0-2950/hadoop/lib/*:/usr/hdp/2.3.2.0-2950/hadoop/.//*:/usr/hdp/2.3.2.0-2950/hadoop-hdfs/./:/usr/hdp/2.3.2.0-2950/hadoop-hdfs/lib/*:/usr/hdp/2.3.2.0-2950/hadoop-hdfs/.//*:/usr/hdp/2.3.2.0-2950/hadoop-yarn/lib/*:/usr/hdp/2.3.2.0-2950/hadoop-yarn/.//*:/usr/hdp/2.3.2.0-2950/hadoop-mapreduce/lib/*:/usr/hdp/2.3.2.0-2950/hadoop-mapreduce/.//*:::/usr/share/java/mysql-connector-java-5.1.17.jar:/usr/share/java/mysql-connector-java.jar:/usr/hdp/current/falcon-server/server/webapp/falcon/WEB-INF/classes:/usr/hdp/current/falcon-server/server/webapp/falcon/WEB-INF/lib/*:/usr/hdp/current/falcon-server/libext/* org.apache.falcon.Main -app /usr/hdp/current/falcon-server/server/webapp/falcon -port 15000 On Ambari, there is not error on Falcon Server. But when I tried to run Falcon UI, I am getting: HTTP ERROR: 503 Problem accessing /index.html. Reason: SERVICE_UNAVAILABLE Please Note: I need to Update pig-action.xml to have hive in the share lib config and repackage
falcon-oozie-adaptor-0.6.1.2.3.2.0-2950.jar and replace jar at
"/usr/hdp/current/falcon-server/webapp/falcon/WEB-INF/lib” and restart
Falcon.
... View more
01-27-2016
01:04 AM
Falcon: 0.6.1.2.3, HDP: 2.3.2.0-2950, Ambari: 2.1.2.1 Which log I need to provide? Extract from application log: 2016-01-27 01:00:50,873 ERROR - [main:] ~ Failed to initialize service org.apache.falcon.entity.store.ConfigurationStore (ServiceInitializer:49)
org.apache.falcon.FalconException: Unable to restore configurations for entity type PROCESS
at org.apache.falcon.entity.store.ConfigurationStore.loadEntity(ConfigurationStore.java:189)
at org.apache.falcon.entity.store.ConfigurationStore.init(ConfigurationStore.java:152)
at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:47)
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:56)
at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:550)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:519)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:57)
at org.apache.falcon.Main.main(Main.java:83)
2016-01-27 01:00:50,875 ERROR - [main:] ~ Failed startup of context org.mortbay.jetty.webapp.WebAppContext@4759d881{/,/usr/hdp/current/falcon-server/server/webapp/falcon} (log:87)
java.lang.RuntimeException: org.apache.falcon.FalconException: org.apache.falcon.FalconException: Unable to restore configurations for entity type PROCESS
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:59)
at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:550)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:519)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:57)
at org.apache.falcon.Main.main(Main.java:83)
Caused by: org.apache.falcon.FalconException: org.apache.falcon.FalconException: Unable to restore configurations for entity type PROCESS
at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:50)
at org.apache.falcon.listener.ContextStartupListener.contextInitialized(ContextStartupListener.java:56)
... 11 more
Caused by: org.apache.falcon.FalconException: Unable to restore configurations for entity type PROCESS
at org.apache.falcon.entity.store.ConfigurationStore.loadEntity(ConfigurationStore.java:189)
at org.apache.falcon.entity.store.ConfigurationStore.init(ConfigurationStore.java:152)
at org.apache.falcon.service.ServiceInitializer.initialize(ServiceInitializer.java:47)
... 12 more
2016-01-27 01:00:50,879 INFO - [main:] ~ Started SocketConnector@0.0.0.0:15000 (log:67)
... View more
01-27-2016
12:25 AM
I restarted Falcon Server and getting this error: HTTP ERROR: 503
Problem accessing /index.html. Reason:
SERVICE_UNAVAILABLE
... View more
Labels:
- Labels:
-
Apache Falcon
01-22-2016
05:01 PM
It works fine when we made changes in workflow.xml for oozie 4.2. But when we are running Falcon process and then system will create the oozie workflow. At PIG action, it got failed with ShimsLoader error. Actually falcon is not picking changes made in oozie-site.xml: oozie.action.sharelib.for.pig=pig,hcatalog,hive I also tried restarting Falcon, OOzie, Hive bit still the not picking up the above property.
... View more
01-22-2016
01:17 AM
Please let me know which one I need to set: oozie.action.sharelib.for.pig=pig,hcatalog oozie.action.sharelib.for.pig=hive,pig,hcatalog
oozie.action.sharelib.for.hive=hive,hcatalog,sqoop Also where I need to set: In Job Config or Hive-site.xml as custom property.
... View more
01-21-2016
11:27 PM
Hi I am trying to run a PIG action in oozie workflow and getting this error: Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error. org/apache/hadoop/hive/shims/ShimLoader
java.lang.NoClassDefFoundError: org/apache/hadoop/hive/shims/ShimLoader
at org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:368)
at org.apache.hive.hcatalog.pig.PigHCatUtil.getHCatServerUri(PigHCatUtil.java:134)
at org.apache.hive.hcatalog.pig.HCatLoader.getSchema(HCatLoader.java:217)
at org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:175)
at org.apache.pig.newplan.logical.relational.LOLoad.<init>(LOLoad.java:89)
at org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:901)
at org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3568)
at org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
at org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
at org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
at org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:191)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1735)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1443)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:387)
at org.apache.pig.PigServer.executeBatch(PigServer.java:412)
at org.apache.pig.PigServer.executeBatch(PigServer.java:398)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:234)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
at org.apache.pig.Main.run(Main.java:502)
at org.apache.pig.PigRunner.run(PigRunner.java:49)
at org.apache.oozie.action.hadoop.PigMain.runPigJob(PigMain.java:288)
at org.apache.oozie.action.hadoop.PigMain.run(PigMain.java:231)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:47)
at org.apache.oozie.action.hadoop.PigMain.main(PigMain.java:76)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.shims.ShimLoader
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 40 more
================================================================================
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.PigMain], exit code [2]
... View more
Labels:
01-20-2016
06:19 PM
1 Kudo
I am facing authenticating ldap user. The following command results in: ldap_bind: Invalid credentials (49) ldapsearch -x -H ldaps://my-ldap-server.net -b "ou=People,o=xx.com" "(uid=xx.xxx@xx.com)" -W But without -W (without password), it is working fine and search the record.
... View more
Labels:
- Labels:
-
Apache Ambari
01-11-2016
04:24 PM
1 Kudo
source type is setup by default to 'solr'. I changed it to 'db' and also, remove the filter. And it works!!!!. The Solr os a preferabl and the recommended audit source type but unfortunately it is not included in the Ambari 2.1 stack. Thanks for the support.
... View more
01-10-2016
07:36 PM
1 Kudo
HDFS ranger plugin audit is getting logged in Ranger_Audit DB. Yes,HDFS resource access/denied audit is being audited and recorded in MySQL ranger_audit DB. We have verified from the xa_access.. table. Yes,the ranger.audit.source.type is set to db in advance-ranger-admin-site. Still the audit page is not displaying any transactions.
... View more
- « Previous
-
- 1
- 2
- Next »