When trying to download companion files for HDP-2.6.1 I am getting a 404 error not found when running: sudo wget http://public-repo-1.hortonworks.com/HDP/tools/2.6.1.0/hdp_manual_install_rpm_helper_files-2.6.1.0.129.tar.gz I am following the documentation located here - https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_command-line-installation/content/download-companion-files.html Cheers, Brendan ... View more

I have an datetime attribute which looks something like this "2017-08-29T00:00:15.4945" which comes from a JSON file. In my PutHDFS when I am trying to put files into a file structure I am trying to get Year/Month/Day. My Directory: /data/events/${datetime:toDate("YYYY-MM-dd'T'HH:mm:ss.SSSS", "NZDT"):format("YYYY/MM/dd")} This is nearly working but is putting 2017/01/01 but it should be 2017/08/29. Thanks, Brendan ... View more

Hi there, Currently I am trying to replace our current flume workflow using NiFi. For a bit of background I am working with JSON files where each line is an event (bids, logins, purchase, comment etc..) with other information that comes along with that. What I am trying to do is: 1. Read the JSON file line by line 2. Grab the event type from each line 3. Store events of the same type in say 1GB files in HDFS based on the event type e.g (events/$(event_type)). I don't want to store lots of tiny files preferably. I have attached some of the different ways I have tried, but haven't been able to get the desired flow. Thanks a lot! Brendan ... View more

Hello all, I am running a kerberised cluster and am having issues trying to open the Falcon Web UI. I am using Mozilla Firefox to try and open it. Any help would be much appreciated. ... View more