About avijeetd

avijeetd · ‎04-18-2017

This issue got resolved by using maven-shade-plugin as mentioned here http://storm.apache.org/releases/0.10.0/storm-hdfs.html

aaron_harris · ‎08-07-2017

For anyone that comes to this from google, as I did, you may also need to remove/backup the /hadoop/storm/supervisor/localstate directory. It seems this keeps track of what the supervisor is currently running, so if the stormdist folder doesn't exist but there is a record in localstate, it will keep trying to access that file on startup.

kelvintong718 · ‎04-13-2017

@Michael Young Thanks ! That worked like a charm. I still have no idea why it doesn't let me upload using the HDFS UI so if you know why then I would love to know.

gary_mullen-sch · ‎03-13-2018

Thanks. Any other common patterns for this use case?

gkeys · ‎04-12-2017

During installation of HDP you can uncheck Atlas service on the step when you are setting up services for the cluster: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-user-guide/content/adding_a_service_to_your_hadoop_cluster.html If you have Atlas implemented, you can click on the Atlas service in Ambari (left panel) and then go to upper right Service Actions and delete the service.

afernandez · ‎05-04-2017

@Avijeet Dash, you may find this presentation useful, http://events.linuxfoundation.org/sites/events/files/slides/ambari_big_data_2017.pdf Custom Services can be added to the stack, as long as they support lifecycle commands like stop, start, restart, status, etc., and can also contain Custom Commands. Technology-wise, Ambari Server is all Java and supports multiple DB types (Postgres, MySQL, Oracle, Azure). The Agents use Python for running, heartbeating, and executing the scripts for managing the Hadoop Services. The Agents send heartbeat messages to the Server every 4-10 seconds (configurable). The web UI uses AngularJS and Node.js to responsiveness and auto-refresh, and relies on the RESTful web service for all data.

aervits · ‎02-27-2017

@Avijeet Dash there are a few options, here's a great article by one of our engineers https://community.hortonworks.com/articles/70658/how-to-diagnose-zeppelin.html to see it in action, here's a short article that demonstrates remote debug in action http://lresende.blogspot.com/2016/08/launching-apache-zeppelin-in-debug-mode.html

MFP · ‎05-13-2017

Hi Avijeet Dash , Apache Zeppelin 0.7.0 is packed and integrated with new version of HDP 2.6. It has new security feature for Zeppelin.

dzaratsian · ‎02-13-2017

@Avijeet Dash Here's a good HCC article describing the process to build a custom NiFi processor: https://community.hortonworks.com/articles/4318/build-custom-nifi-processor.html If you want to use existing processors/code and modify for your own purpose, then many of the standard processors can be found here: https://github.com/apache/nifi/tree/master/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard If you check out these NiFi processors, you'll be able to view the code for getXXX versus fetchXXX in order to understand the difference (or to modify for your own custom use).

kkawamura · ‎02-13-2017

Hi @Avijeet Dash I had a hard time to understand how should I write a Jolt spec before, and wrote this blog post to memorandum what I've learnt based on my experience. It's not an official documentation, but I hope it'll be helpful in someway. http://ijokarumawak.github.io/nifi/2016/11/22/nifi-jolt/ Thanks, Koji

Online	Offline
Last Visited	‎01-18-2021 12:06 AM

Member Since	‎06-09-2016 06:30 AM
Last Visited	‎01-18-2021 12:06 AM
Posts	185
Kudos received	22

Cloudera Community

Re: storm supervisor error

Re: Storm-hdfs - java.lang.RuntimeException: Error...

Re: zeppelin architecture

Re: Falcon server - cannot create cluster

Re: Hive Streamaing

Re: Storm-hdfs - java.lang.RuntimeException: Error...

Re: storm supervisor error

Re: Why can't I upload a simple text file onto HDF...

Re: Nifi for batch ingest

Re: hive atlas integration

Re: devops tools used in Ambari

Re: zeppelin debug

Re: zeppelin architecture

Re: writing custom processors in nifi

Re: JSON transformation in Nifi