About amittewari_5

Shelton · ‎11-06-2016

Thanks a million for sharing keep the spirit

mjohnson · ‎10-26-2016

The article: Modify Atlas Entity properties using REST API commands contains a full description for how to update both the comment and description entity properties for Atlas managed hive_table types.

amittewari_5 · ‎05-12-2016

@Ana Gillan @Sagar Shimpi Thanks, got partial resolution. Ranger Hive plugin applies only to Hiveserver2 and not to CLI. But in below mentioned hive table file, how user mktg1 is able to query it using HIVE CLI? [hive@sandbox ~]$ hadoop fs -ls /apps/hive/warehouse/xademo.db/customer_details/acct.txt ---------- 3 hive hdfs 1532 2016-03-14 14:52 /apps/hive/warehouse/xademo.db/customer_details/acct.txt [mktg1@sandbox ~]$ hive hive> use xademo; OK Time taken: 1.737 seconds hive> select * from customer_details limit 10; OK PHONE_NUM PLAN REC_DATE STAUS BALANCE IMEI REGION 5553947406 6290 20130328 31 0 012565003040464 R06 7622112093 2316 20120625 21 28 359896046017644 R02 5092111043 6389 20120610 21 293 012974008373781 R06 9392254909 4002 20110611 21 178 357004045763373 R04 7783343634 2276 20121214 31 0 354643051707734 R02 5534292073 6389 20120223 31 83 359896040168211 R06 9227087403 4096 20081010 31 35 356927012514661 R04 9226203167 4060 20060527 21 450 010589003666377 R04 9221154050 4107 20100811 31 3 358665019197977 R04 Time taken: 6.467 seconds, Fetched: 10 row(s)

amittewari_5 · ‎05-10-2016

Yes able to see "atewari" use in Ranger UI. Thanks.

amittewari_5 · ‎04-18-2016

Here's how I resolved the issue: RM log was showing some issue related to ZK :2016-04-18 05:20:57,275 INFO recovery.ZKRMStateStore (ZKRMStateStore.java:runWithRetries(1214)) - Retrying operation on ZK. Retry no. 195 2016-04-18 05:20:57,454 INFO zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(1019)) - Opening socket connection to server ZK_HOST/10.131.$ 2016-04-18 05:20:57,455 WARN zookeeper.ClientCnxn (ClientCnxn.java:run(1146)) - Session 0x0 for server null, unexpected error, closing socket connection and attemptin$ java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1125) Also noticed ZK kept getting stopped. ZK logs: java.io.FileNotFoundException: /hadoop/zookeeper/version-2/log. (Permission denied) So did chmod a+rwx -R /hadoop/zookeeper andd then restarted ZK and RM services. After that was able to successfully start Hive CLI. Thanks @Kuldeep Kulkarni @Laurent Edel

amittewari_5 · ‎05-03-2016

@pnagwekar So far, Falcon seems a great tool for Data governance and lineage. What I liked- Creating Falcon workflows around existing and new custom functionality ( e.g. I was successfully able to call an external Dell Boomi process from inside a Falcon process as a system integration POC) Scope for Improvement- Falcon UI responsiveness. Hope its more fluidic, intuitive and responsive in next release (July 2016?) Tighter integration with Atlas. Didn't find many documents around this functionality/(Roadmap?) Feed lineage was missing (seems its a UI issue to be fixed in next release)

amittewari_5 · ‎03-31-2016

Problem resolved. The problem was that when I started the HDP sandbox today, somehow the namenode started in safemode (I really cant imagine why specially on a sandbox, but anyways...) After removing the namenode from safemode, was able to remove the successfully entities.

yzheng · ‎03-21-2016

@Amit Tewari Which version of Falcon are you using? Are the jobs submitted and scheduled successfully? Could you go to falcon web ui and share the job status image? You should be able to see rawEmailIngestProcess, cleanseEmailProcess and corresponding feeds on the web ui after typing "*" in the search box.

aervits · ‎03-15-2016

Please see this https://community.hortonworks.com/questions/16663/hdp-2340-3485-upgrade-failed-due-to-hdp-utils-2340.html#answer-23019

jankytara · ‎09-21-2017

Any solutions that work long term?

Online	Offline
Last Visited	‎11-23-2016 09:23 AM

Member Since	‎03-15-2016 07:11 AM
Last Visited	‎11-23-2016 09:23 AM
Posts	35
Kudos received	13

Cloudera Community

Re: New datanode not starting (added to an existin...

Re: Cannot connect to ResoureManager

Re: Cannot delete an entity in Falcon

Re: New datanode not starting (added to an existin...

Re: How to add OR modify comment for an existing h...

Re: Ranger HDFS policy not taking effect even afte...

Re: Ranger-LDAP integration

Re: Cannot connect to ResoureManager

Re: Why Falcon lineage not visible for feeds (thou...

Re: Cannot delete an entity in Falcon

Re: Output of the Falcon data pipeline is empty

Re: Hortonworks Data Platform (from HDP-2.3.4.0-34...

Re: With Hive View what causes: "H100 Unable to su...