About sunile_manjee

sunile_manjee · ‎06-23-2016

@milind pandit that is straight forward. Simple download the two files from the cluster and place in your nifi cluster.

sunile_manjee · ‎06-23-2016

@milind pandit if you are running nodes in the cloud make sure the ports are accessible by both clusters. You will need to allow both clusters to talk with each other.

sunile_manjee · ‎06-23-2016

@milind pandit If i understand your ? correct you simply want to write to a HDFS. The HDFS cluster is running on different nodes which is typical. Use the putHDFS processor (info here). In the hadoop configuration resources simply point to core-site.xml and hdfs-site.xml. You can download these files from your target cluster. Now NiFi knows where the cluster is.

sunile_manjee · ‎06-23-2016

I am trying to start ambari and it fails while starting postgres on the sandbox. [root@sandbox ~]# ambari-server restart Using python /usr/bin/python2 Restarting ambari-server Using python /usr/bin/python2 Stopping ambari-server Ambari Server is not running Using python /usr/bin/python2 Starting ambari-server Ambari Server running with administrator privileges. Running initdb: This may take upto a minute. About to start PostgreSQL ERROR: Exiting with exit code 3. REASON: Unable to start PostgreSQL server. Status stopped. . Exiting I tried to start postgres [root@sandbox ~]# service postgresql start Starting postgresql service: [FAILED] Then I ran a postgres status: [root@sandbox ~]# service postgresql status postmaster is stopped I am not sure how to start postmaster. I tried [root@sandbox ~]# pg_ctl start pg_ctl: cannot be run as root Please log in (using, e.g., "su") as the (unprivileged) user that will own the server process. Any other ideas?

sunile_manjee · ‎06-23-2016

@Saurabh Kumar hortonworks and teradata are partners. They have built documentation on the hdp teradata connector here.

sunile_manjee · ‎06-23-2016

@rahul jain I do not understand your question. Can you specify the use case?

sunile_manjee · ‎06-22-2016

@Vijay Parmar that is good to hear. is this question considered answered or do you need further help?

sunile_manjee · ‎06-21-2016

@milind pandit Nothing I know of out of the both at this moment will get you this. An option is to enable ranger and plug into rangers audit frame work. more info here. Basically when you enable audit on hdfs you will who did what and when. This will tell you the data sets which are being used. Not much about if the data set which are not being use. This with ranger will need to be inferred. You can also view HDFS space utilization through zeppelin here. Another option is to build a custom job which would be to take the HDFS space utilization report out (above) feed and store into a table. Cross join it with ranger audit logs and store results in phoenix. Run this jobs every hour. run report off end table In summary I am not aware of any out of the box solution.

sunile_manjee · ‎06-19-2016

@lmccay Any performance considerations?

sunile_manjee · ‎06-19-2016

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

Online	Offline
Last Visited	‎05-25-2022 10:07 AM

Member Since	‎05-30-2018 10:40 PM
Last Visited	‎05-25-2022 10:07 AM
Posts	1,322
Kudos received	713

Cloudera Community

Re: Iterate over ADLS files using spark?

Re: Install NiFi CA service post nifi cluster inst...

Re: Which storage format is optimum for training m...

Re: Ambari custom alert failing

Re: df.cache() is not working on jdbc table

Re: How can I write to remote HDFS using NiFi?( As...

Re: How can I write to remote HDFS using NiFi?( As...

Re: How can I write to remote HDFS using NiFi?( As...

unable to start postgres for ambari

Re: Can someone please help me to setup teradata s...

Re: Can we take user input in hive

Re: How can I automate a process in Hive?

Re: I would like to get custom report on Which dat...

Re: Firewall Between Knox and Master/Data nodes

Re: NiFi Phoenix processor?