Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP 2.5: Falcon Snapshot issue "does not allow snapshots"

Highlighted

HDP 2.5: Falcon Snapshot issue "does not allow snapshots"

New Contributor

Falcon Snapshot extension not working when I try to do use case as per the below link,

https://community.hortonworks.com/articles/63379/hdfs-snapshots-based-replication-using-apache-falc....

I have enabled snapshot to the directory,

hdfs dfsadmin -allowSnapshot /tmp/falcon/HDFSSnapshot/target

Even though Falcon says the "does not allow snapshots".

FS impersonating user ambari-qa (HadoopClientFactory:244) 2017-01-20 14:03:27,307 ERROR - [139399371@qtp-790021811-2818 - 0f1adda7-4e8d-46b1-bb71-cc36532a71e8:ambari-qa:POST//extension/submit/HDFS-SNAPSHOT-MIRRORING] ~ Error when submitting extension job: (ExtensionManager:309) org.apache.falcon.FalconException: sourceSnapshotDir /tmp/source does not allow snapshots. at org.apache.falcon.extensions.mirroring.hdfsSnapshot.HdfsSnapshotMirroringExtension.validate(HdfsSnapshotMirroringExtension.java:90) at org.apache.falcon.extensions.Extension.getEntities(Extension.java:73) at org.apache.falcon.resource.extensions.ExtensionManager.generateEntities(ExtensionManager.java:487) at org.apache.falcon.resource.extensions.ExtensionManager.submit(ExtensionManager.java:304) at sun.reflect.GeneratedMethodAccessor196.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339) at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416) at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537) at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) at org.apache.falcon.security.FalconAuthorizationFilter.doFilter(FalconAuthorizationFilter.java:108) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.falcon.security.FalconCSRFFilter.doFilter(FalconCSRFFilter.java:78) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.falcon.security.FalconAuthenticationFilter$2.doFilter(FalconAuthenticationFilter.java:188) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:614) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:573) at org.apache.falcon.security.FalconAuthenticationFilter.doFilter(FalconAuthenticationFilter.java:197) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.falcon.security.FalconAuditFilter.doFilter(FalconAuditFilter.java:64)

2 REPLIES 2

Re: HDP 2.5: Falcon Snapshot issue "does not allow snapshots"

Expert Contributor

@Uvaraj Seerangan I think the exception has occurred because in snapshottable directory there no snapshots available. So can you please manually create the snapshots first for snapshottable directory and then submit the extensions. Please see if this works for you.

Re: HDP 2.5: Falcon Snapshot issue "does not allow snapshots"

New Contributor

Yes I have created the snapshot using HDFS commands and then submit the extension but the issue still exists in Falcon.

Don't have an account?
Coming from Hortonworks? Activate your account here