Member since
04-11-2016
471
Posts
325
Kudos Received
118
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2129 | 03-09-2018 05:31 PM | |
2693 | 03-07-2018 09:45 AM | |
2592 | 03-07-2018 09:31 AM | |
4465 | 03-03-2018 01:37 PM | |
2511 | 10-17-2017 02:15 PM |
07-21-2016
11:49 AM
1 Kudo
Hi @Iyappan Gopalakrishnan, You can achieve what you are looking for by using the last version of NiFi v0.7.0 which includes Hive processors. Hope this helps.
... View more
07-05-2016
05:46 PM
2 Kudos
Hi @Felix Albani, If you are using Maven to handle your dependencies : http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-client The last one: <dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>2.7.2</version>
</dependency> Hope this helps.
... View more
07-05-2016
11:28 AM
2 Kudos
Hi @SparkRocks At the moment there is no such processor but there are ongoing discussions on the subject [1]. The best output format really depends of what you want to do with the data, JSON looks like a good format to me for its flexibility. If you really want CSV, there are multiple options depending of how complicated is your input data. If there are not a lot of tables/columns, you could do something like: ExecuteSQL > AvroToJson > EvaluateJsonPath (to extract the values into flow file attributes) > ReplaceText to write your CSV using expression language > PutS3 Otherwise you could have a look to ExecuteScript processor and rely on an existing library to perform the conversion. Or, as you suggested, you could write a custom processor and you could contribute your code to NiFi. [1] https://issues.apache.org/jira/browse/NIFI-1372 Hope this helps.
... View more
07-05-2016
11:05 AM
Hi @Manikandan Durairaj To update the name of the file, you can use an UpdateAttribute processor and set the attribute 'filename' with the name of your choice using expression language [1]. If you want a name based on current time, you can use date functions, otherwise you can use the function UUID to generate a unique filename for each flow file. That would be a property filename with ${UUID()} [1] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html Hope this helps.
... View more
07-04-2016
07:36 AM
3 Kudos
Hi @Manikandan Durairaj, I'd suggest you to read the following posts:
https://developers.facebook.com/docs/graph-api/using-graph-api https://developers.facebook.com/docs/graph-api/common-scenarios https://developers.facebook.com/docs/facebook-login/access-tokens I'd try something like: https://graph.facebook.com/search?q=%23YOU-HASH-VALUE&limit=10000&access_token=YOUR-ACCESS-TOKEN Hope this helps.
... View more
06-23-2016
03:39 PM
1 Kudo
Hi @milind pandit, Yes you just need to have core-site and hdfs-site configuration files available on your NiFi nodes for your PutHDFS processor. And obviously that network connections are OK between NiFi and HDP. Hope this helps.
... View more
06-22-2016
04:00 PM
Hi @Thierry Vernhet, NiFi is an Apache software, for improvement wish I'd recommend you to raise a JIRA on https://issues.apache.org/jira/browse/NIFI or to subscribe to dev mailing list (https://nifi.apache.org/mailing_lists.html) and start a discussion on this list about this subject. In any case, IMO it seems to be a valid point but it needs to go through Apache process. Hope this helps.
... View more
06-17-2016
03:18 PM
Answering my question, I was just not using the concat function correctly... the syntax is: ${fs:exists(concat(wf:actionData('hdfs-lookup')['outputPath'], '/2'))}
... View more
06-17-2016
08:25 AM
Hi, I'm trying to launch an action if and only if a file exists. I have a decision node with the following case: ${fs:exists(wf:actionData('hdfs-lookup')['outputPath']/2)} The path I am checking is something like: hdfs:///mypath/2 and wf:actionData('hdfs-lookup')['outputPath'] is returning: hdfs:///mypath So I'm trying to concatenate this string with '/2'. Is there a way to do this? I tried with simple quotes, plus operator, .concat, etc but no luck so far. Thanks!
... View more
Labels:
- Labels:
-
Apache Oozie
06-16-2016
09:52 AM
1 Kudo
Hi @Thierry Vernhet, I am not familiar with WMI events, but there are the following JIRAs: https://issues.apache.org/jira/browse/NIFI-1976 (work in progress, PR available) https://issues.apache.org/jira/browse/NIFI-1975 (will be available in NiFi 1.0.0) Does it answer your need?
... View more