Member since
04-11-2016
471
Posts
325
Kudos Received
118
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2013 | 03-09-2018 05:31 PM | |
2568 | 03-07-2018 09:45 AM | |
2474 | 03-07-2018 09:31 AM | |
4246 | 03-03-2018 01:37 PM | |
2428 | 10-17-2017 02:15 PM |
04-22-2016
06:48 PM
2 Kudos
Hi Will, On a logical point of view, you are right, I think there is no absolute need to have an incoming connection. As it is coded right now, it requires an incoming connection to allow users to leverage the expression language in the properties of the processor. However I think that the incoming connection could be optional instead of required. The simplest way to get things working is to add a GenerateFlowFile processor before the FetchElasticsearch one. You can configure the generate flow file processor with a 0B size to have empty flow files, and change the scheduling as cron-time based to decide the frequency of the requests that will be sent to Elasticsearch. Hope that helps.
... View more
04-22-2016
04:28 PM
If you are talking about data that you already encrypted, you have to get back your data out of your encryption zones before uninstalling Ranger KMS. If you don't have any encrypted data, you can use HDFS without any problem with or without Ranger KMS. Your data won't be encrypted and will be readable by any application on top of HDFS. Note: if you have KMS installed, it does not mean your data is encrypted. You have to specifically create encrypted zones in HDFS to get your data encrypted. All your original data is untouched and readable.
... View more
04-22-2016
04:07 PM
No. Unless you get back your encrypted data from your encryption zones before uninstalling Ranger KMS, the encrypted data will not be readable. The reason is that for each file stored in an encryption zone, Ranger KMS stores a DEK (Data Encryption Key) which is needed to decrypt your data. In conclusion, your data will remain on HDFS but it will remain encrypted.
... View more
04-22-2016
03:47 PM
Hi, Not sure to understand your question. If you enable KMS, you will have the availability to create encryption zones (in other words directories) in HDFS where stored file will be encrypted. If then you uninstall the KMS plugin, encryption zone (and associated files) will remain unchanged and the data will not be readable.
... View more
04-21-2016
11:27 AM
3 Kudos
Hi Wellington, There are few examples out there to use the Twitter API with Storm. You should have a look to Hortonworks tutorials (like this one http://hortonworks.com/hadoop-tutorial/ingesting-processing-real-time-events-apache-storm/) to have explained and comprehensive examples using the sandbox. If you only want simple code examples, you will find a lot by searching for "github twitter storm" on the internet. A possible example is: https://github.com/pvillard31/storm-twitter But there are a lot of possibilities depending on how you want to use the Twitter API. For example, you will find some examples that leverages the Trident API in Storm. Hope that helps!
... View more
04-20-2016
09:36 AM
I'd suggest you to have a look at this post: http://funnifi.blogspot.co.uk/2016/02/executescript-processor-replacing-flow.html It'll show you how to play around with the flow file content using ExecuteScript processor. Once you have your full string, you can put it as an attribute of the FlowFile or keep it as new content (it depends of what you have in mind). Hope that helps.
... View more
04-20-2016
08:35 AM
Hi Sunile, I believe unix groups are not created during AD/LDAP sync with Ranger, however I think that if a policy cannot be checked with AD/LDAP, it will then be checked against unix groups before failing.
... View more
04-18-2016
07:23 PM
What do you mean by on-demand basis?
... View more
04-15-2016
05:18 PM
As an indication, when you are in the NiFi UI, you have an "about" link at the top-right, it should let you know which version of NiFi is running.
... View more
04-15-2016
06:16 AM
Hi Pradeep, NiFi is running on Windows. As far as I know, I don't see any reason why this tutorial wouldn't work on Windows Azure.
... View more
- « Previous
- Next »