About amittewari_5

amittewari_5 · ‎05-09-2016

Thanks @Kuldeep Kulkarni , @Sagar Shimpi LDAP users synched, however: LDAP user not able to login using Ranger UI (Invalid credentials error-"The username or password you entered is incorrect..") LDAP users' group not synched/empty in Ranger UI

amittewari_5 · ‎05-06-2016

The steps for Ranger configuration (cn=Manager,dc=hortonworks,dc=com etc.) vs LDAP structure (cn=ldapusers,ou=Groups,dc=example,dc=com etc) are not in sync at https://community.hortonworks.com/articles/16696/ranger-ldap-integration.html Since I don't have much experience on LDAP, is their any reliable step-by-step I can use to quickly get upto speed with Ranger/LDAP integration?

amittewari_5 · ‎05-03-2016

@pnagwekar So far, Falcon seems a great tool for Data governance and lineage. What I liked- Creating Falcon workflows around existing and new custom functionality ( e.g. I was successfully able to call an external Dell Boomi process from inside a Falcon process as a system integration POC) Scope for Improvement- Falcon UI responsiveness. Hope its more fluidic, intuitive and responsive in next release (July 2016?) Tighter integration with Atlas. Didn't find many documents around this functionality/(Roadmap?) Feed lineage was missing (seems its a UI issue to be fixed in next release)

amittewari_5 · ‎04-18-2016

Here's how I resolved the issue: RM log was showing some issue related to ZK :2016-04-18 05:20:57,275 INFO recovery.ZKRMStateStore (ZKRMStateStore.java:runWithRetries(1214)) - Retrying operation on ZK. Retry no. 195 2016-04-18 05:20:57,454 INFO zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(1019)) - Opening socket connection to server ZK_HOST/10.131.$ 2016-04-18 05:20:57,455 WARN zookeeper.ClientCnxn (ClientCnxn.java:run(1146)) - Session 0x0 for server null, unexpected error, closing socket connection and attemptin$ java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) Also noticed ZK kept getting stopped. ZK logs: java.io.FileNotFoundException: /hadoop/zookeeper/version-2/log. (Permission denied) So did chmod a+rwx -R /hadoop/zookeeper andd then restarted ZK and RM services. After that was able to successfully start Hive CLI. Thanks @Kuldeep Kulkarni @Laurent Edel

amittewari_5 · ‎04-18-2016

@Kuldeep Kulkarni Couldnt connect using telnet

amittewari_5 · ‎04-13-2016

Since HiveUI is not working through Ambari, on troubleshooting through "hive -hiveconf hive.root.logger=DEBUG,console", 16/04/13 06:44:37 [IPC Client (1720891078) connection to RM_FQDN /RM_IP:8020 from root]: DEBUG ipc.Client: IPC Client (1720891078) connection to RM_FQDN/RM_IP:8020 from root got value #32 16/04/13 06:44:37 [main]: DEBUG ipc.ProtobufRpcEngine: Call: getFileInfo took 1ms 16/04/13 06:44:37 [main]: DEBUG ipc.Client: The ping interval is 60000 ms. 16/04/13 06:44:37 [main]: DEBUG ipc.Client: Connecting to RM_FQDN/RM_IP:8050 16/04/13 06:44:38 [main]: INFO ipc.Client: Retrying connect to server: RM_FQDN/RM_IP:8050. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS) 16/04/13 06:44:39 [main]: INFO ipc.Client: Retrying connect to server: RM_FQDN/RM_IP:8050. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS) Also ResourceManager UI giving "ERR_CONNECTION_REFUSED" Seems even when RM is already started through Ambari, it cannot be accessed/connected through client or UI.

amittewari_5 · ‎04-13-2016

I too am facing this issue frequently both on HDP 2.3 as well as 2.4 cluster setups. As @R Wys mentioned, above suggested steps not working. @Neeraj Sabharwal any suggestions, workarounds would be highly appreciated. Ambari Version: 2.2.1.1 Thanks Amit

amittewari_5 · ‎04-01-2016

I am not able to see lineage for a feed (though the lineage for a process is visible) Screenshot of the feed with lineage invisible (feed.png) and process with lineage visible (process.png) attached. Have followed the tutorial- http://hortonworks.com/hadoop-tutorial/defining-processing-data-end-end-data-pipeline-apache-falcon/#run-the-processes

amittewari_5 · ‎03-31-2016

Problem resolved. The problem was that when I started the HDP sandbox today, somehow the namenode started in safemode (I really cant imagine why specially on a sandbox, but anyways...) After removing the namenode from safemode, was able to remove the successfully entities.

amittewari_5 · ‎03-31-2016

@jramakrishnan ./falcon entity -type process -list 2 (PROCESS) cleanseEmailProcess (PROCESS) rawEmailIngestProcess ./falcon entity -type process -name rawEmailIngestProcess -list 2 (PROCESS) cleanseEmailProcess (PROCESS) rawEmailIngestProcess

Online	Offline
Last Visited	‎11-23-2016 09:23 AM

Member Since	‎03-15-2016 07:11 AM
Last Visited	‎11-23-2016 09:23 AM
Posts	35
Kudos received	13

Cloudera Community

Re: New datanode not starting (added to an existin...

Re: Cannot connect to ResoureManager

Re: Cannot delete an entity in Falcon

Re: Ranger-LDAP integration

Ranger-LDAP integration

Re: Why Falcon lineage not visible for feeds (thou...

Re: Cannot connect to ResoureManager

Re: Cannot connect to ResoureManager

Cannot connect to ResoureManager

Re: With Hive View what causes: "H100 Unable to su...

Why Falcon lineage not visible for feeds (though v...

Re: Cannot delete an entity in Falcon

Re: Cannot delete an entity in Falcon