Cluster entity vertex must exist

margusja — Tue, 26 Jul 2016 20:31:27 GMT

I am using falcon 0.6.1

When I am trying to submit process or feed I am getting error:

In case I just restarted falcon server then I can submit process or feed:

[margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml

falcon/default/Submit successful (process) sign--web3

But after I deleted process:

[margusja@hadoopnn2 ~]$ falcon entity -delete -type process -name sign--web3

falcon/default/sign--web3(process) removed successfully (KILLED in ENGINE)

And I try to submit again then I am getting:

[margusja@hadoopnn2 ~]$ falcon entity -submit -type process -file web3.xml

ERROR: Bad Request;default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2

and in log:

2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 - aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest RemoteUser is null (Servlets:47)

2016-07-26 16:28:26,873 INFO - [63390@qtp-1536471117-0 - aa4fe6b0-3d10-4fcd-b8fe-d83ee9e6f7b7:] ~ HttpServletRequest user.name param value is margusja (Servlets:53)

2016-07-26 16:28:27,010 INFO - [2138332724@qtp-1536471117-3 - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest RemoteUser is null (Servlets:47)

2016-07-26 16:28:27,011 INFO - [2138332724@qtp-1536471117-3 - b0cea0a4-efff-48c8-a81f-5c9ffda411a7:] ~ HttpServletRequest user.name param value is margusja (Servlets:53)

2016-07-26 16:28:27,358 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:] ~ HttpServletRequest RemoteUser is falcon (Servlets:47)

2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Logging in falcon (CurrentUser:65)

2016-07-26 16:28:27,359 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Request from authenticated user: falcon, URL=/api/entities/submit/process, doAs user: null (FalconAuthenticationFilter:185)

2016-07-26 16:28:27,362 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Parsed Entity: sign--web3 (EntityParser:95)

2016-07-26 16:28:27,364 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Parsed Entity: sign--web3 (EntityParser:95)

2016-07-26 16:28:27,381 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Creating FS for the login user falcon, impersonation not required (HadoopClientFactory:191)

2016-07-26 16:28:27,406 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Persisted configuration PROCESS/sign--web3 (ConfigurationStore:371)

2016-07-26 16:28:27,407 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Adding lineage for entity: sign--web3, type: PROCESS (MetadataMappingService:209)

2016-07-26 16:28:27,409 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)

2016-07-26 16:28:27,465 ERROR - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Illegal State: Cluster entity vertex must exist for Cluster2 (EntityRelationshipGraphBuilder:173)

2016-07-26 16:28:27,476 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)

2016-07-26 16:28:27,497 ERROR - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Illegal State: Cluster entity vertex must exist for Cluster2 (EntityRelationshipGraphBuilder:173)

2016-07-26 16:28:27,518 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Adding process entity: sign--web3 (EntityRelationshipGraphBuilder:131)

2016-07-26 16:28:27,536 ERROR - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Illegal State: Cluster entity vertex must exist for Cluster2 (EntityRelationshipGraphBuilder:173)

2016-07-26 16:28:27,537 ERROR - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Unable to persist entity object (AbstractEntityManager:198)

org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2

at org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:223)

at org.apache.falcon.entity.store.ConfigurationStore.onAdd(ConfigurationStore.java:259)

at org.apache.falcon.entity.store.ConfigurationStore.publish(ConfigurationStore.java:219)

at org.apache.falcon.resource.AbstractEntityManager.submitInternal(AbstractEntityManager.java:414)

at org.apache.falcon.resource.AbstractEntityManager.submit(AbstractEntityManager.java:195)

at org.apache.falcon.resource.ConfigSyncService.submit(ConfigSyncService.java:50)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:497)

at org.apache.falcon.resource.channel.IPCChannel.invoke(IPCChannel.java:49)

at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$1.doExecute(SchedulableEntityManagerProxy.java:139)

at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:577)

at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody0(SchedulableEntityManagerProxy.java:141)

at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure1.run(SchedulableEntityManagerProxy.java:1)

at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)

at org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51)

at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:119)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:497)

at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)

at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)

at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)

at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)

at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)

...

Caused by: java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2

at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:176)

at com.tinkerpop.blueprints.util.TransactionRetryHelper.use(TransactionRetryHelper.java:115)

at com.tinkerpop.blueprints.util.TransactionRetryHelper.exponentialBackoff(TransactionRetryHelper.java:94)

at org.apache.falcon.metadata.MetadataMappingService.onAdd(MetadataMappingService.java:211)

... 64 more

Caused by: java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2

at org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addRelationToCluster(EntityRelationshipGraphBuilder.java:174)

at org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addProcessEntity(EntityRelationshipGraphBuilder.java:140)

at org.apache.falcon.metadata.EntityRelationshipGraphBuilder.addEntity(EntityRelationshipGraphBuilder.java:62)

at org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:215)

at org.apache.falcon.metadata.MetadataMappingService$1.execute(MetadataMappingService.java:212)

at com.tinkerpop.blueprints.util.TransactionRetryStrategy$AbstractRetryStrategy.execute(TransactionRetryStrategy.java:146)

... 67 more

2016-07-26 16:28:27,541 ERROR - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Action failed: Bad Request

Error: java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2 (FalconWebException:83)

2016-07-26 16:28:27,542 ERROR - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ Action failed: Bad Request

Error: default/org.apache.falcon.FalconWebException::org.apache.falcon.FalconException: java.lang.RuntimeException: java.lang.IllegalStateException: Cluster entity vertex must exist: Cluster2

(FalconWebException:83)

2016-07-26 16:28:27,542 INFO - [2138332724@qtp-1536471117-3 - 1e1fa678-4426-4398-b942-348c5742cc68:falcon:POST//entities/submit/process] ~ {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status: FAILED, Time-taken:182944401 ns} (METRIC:38)

Any hints?

-- 
Margus (margusja) Roo
<a href="http://margus.roo.ee">http://margus.roo.ee</a>
skype: margusja
+372 51 48 780

Re: Cluster entity vertex must exist

rbaskaran — Tue, 26 Jul 2016 20:44:00 GMT

Did you submit the cluster entity. Here is the step to do.

$FALCON_HOME/bin/falcon entity -submit -type cluster -file /cluster/definition.xml

Re: Cluster entity vertex must exist

margusja — Tue, 26 Jul 2016 20:45:52 GMT

Yes cluster is there. I can submit feeds and processes just after falcon restart but not later.

Re: Cluster entity vertex must exist

pbishnoi — Wed, 27 Jul 2016 19:04:35 GMT

This issue is getting tracked on the following Apache Falcon JIRA : https://issues.apache.org/jira/browse/FALCON-1955

Re: Cluster entity vertex must exist

KuldeepK — Tue, 11 Jul 2017 07:21:37 GMT

To resolve this issue - Please remove org.apache.falcon.metadata.MetadataMappingService out from *.application.services in falcon startup.properties and restart falcon server

question Re: Cluster entity vertex must exist in Archives of Support Questions (Read Only)

Cluster entity vertex must exist

Re: Cluster entity vertex must exist

Re: Cluster entity vertex must exist

Re: Cluster entity vertex must exist

Re: Cluster entity vertex must exist