Re: Sandbox HDF Nifi: How do I convert TSV files t...

Avi · ‎02-14-2019

you might be hitting this issue/bug https://community.hortonworks.com/content/supportkb/148576/error-dag-did-not-succeed-due-to-vertex-failure-fa.html

Avi · ‎05-07-2018

@LV The supported UIs for Knox WebSSO are Ambari, Ranger and Atlas. so if you are using Ranger, Atlas and want to use SSO auth for those UIs then those steps required, else not required.

Avi · ‎05-03-2018

Hi, Did you try this https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_security/content/setting_up_knox_sso_for_ambari.html

Avi · ‎05-03-2018

This might be useful https://community.hortonworks.com/questions/106505/how-to-transform-an-avro-to-a-super-schema-avro.html

Avi · ‎04-05-2018

Hi, I would suggest to use the Record reader / writer processors. You can read using a CSVRecordReader (can specify tab as the delimiter) and then use ConverRecord to convert to another schema. you have to define a schema for the records though in avro format.

Avi · ‎03-28-2018

HIVE needs to store meta data such as Table structures, OOZIE needs to store Job details etc. you can go into the db schemas of each product and see what they store. Its a persistent mechanism for storing meta data, please look at the internal architecture of each component, it will be clear.

Avi · ‎03-28-2018

Some of the services such as HIVE, OOZIE, Ranger need a back end database to store Meta-data, you can pick one DB such as mariadb/mysql for all these metadata stores and configure through ambari.

Avi · ‎03-28-2018

https://hortonworks.com/services/training/certification/hdp-certified-spark-developer/

Avi · ‎03-28-2018

Hi, this error is from the DB, so Nifi is running the SQL, I think you have to check the syntax. Try running the sql query on sqlclient to verify first.

Avi · ‎03-28-2018

Hi, Are you running nifi docker images with kubernetes, I assume the image has zookeeper, as that is required for teh cluster to work. nifi logs are in the nifi-app files, please check that as well.

Avi · ‎03-28-2018

Hi, Please check if your disk didn't got full, I had similar issue a while back. I see lot of Errors on your log ue to java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.

Avi · ‎11-28-2017

HI, with HDF3.0 and Ambari 2.5.1 , we can install HDF to an existing HDP cluster. Please have a look https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.2/index.html Thanks, Avijeet

Avi · ‎11-28-2017

Hi, with HDF3.0, Ambari 2.5.1 Both HDP and HDF can be managed under one ambari. Have a look at https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.2/index.html Thanks, Avijeet

Online	Offline
Last Visited	‎05-11-2022 12:06 AM

Date Registered	‎07-30-2019 08:49 PM
Last Visited	‎05-11-2022 12:06 AM
Total Messages Posted	13
Total Kudos Received	1

Re: Sandbox HDF Nifi: How do I convert TSV files t...

Re: why do we need to configure seperate DB for hi...

Re: HDP3 and Hive Ware house connector intermitten...

Re: YARN through KNOX - Ldap integration

Re: YARN through KNOX - Ldap integration

Re: Nifi: How to assign custom header to CSV after...

Re: Sandbox HDF Nifi: How do I convert TSV files t...

Re: why do we need to configure seperate DB for hi...

Re: why do we need to configure seperate DB for hi...

Re: Hortonworks spark certification

Re: ORA-000923:From key word not found where expec...

Re: NiFi cluster keeps crashing

Re: I can't access the NIFI

Re: Combine HDP and HDF

Re: Confusion with HDF and HDP and their capabilit...