Member since
05-24-2016
52
Posts
3
Kudos Received
0
Solutions
11-15-2016
02:09 PM
@Iyappan Gopalakrishnan Adding new users to a secured NiFI 0.x / HDF 1.x version of NiFi can be done directly via the NIFi UI. I am assuming you have already secured your NiFi and manually added the initial admin to the authorized-users.xml file. Adding new users is pretty easy. Simply have the new user attempt to access the https web address for your nifi 0.7 install. After authenticating successfully (Done via client certs, ldap, etc), they will see a screen telling them they are not authorized for access and giving them the opportunity to request access. Once they request access, the "Admin" user who does have access to the UI will need need to go into the users UI by clicking on the below Icon which can be found in the upper right corner of the NiFi UI: From within that UI you will see all existing users and any pending authorization users. Simply click on the pencil icon to the right of any pending users to authorize them for 1 or more of the available user roles (Administrator, Dataflow Manger, Read Only, or Provenance). The administration-guide included with your install can give you more details on each of the roles and what privileges each grants to the users. Thanks, Matt
... View more
09-01-2016
02:00 AM
1 Kudo
Just an update - the 'SelectHiveQL' has been added as part of Nifi 0.7
... View more
07-22-2016
05:16 AM
Thanks @Pierre Villard This works....
... View more
06-20-2016
03:36 PM
2 Kudos
Looks like the Twitter API puts hash tags into the following JSON: "entities":
{ "hashtags":[],
"urls":[],
"user_mentions":[]
} You could use EvaluteJsonPath to extract the value of the hashtags into FlowFile attributes, and then use RouteOnAttribute to route the ones matching your tag to a PutFile processor. This blog shows an example of extracting values from the Twitter JSON and making routing decisions: https://blogs.apache.org/nifi/entry/indexing_tweets_with_nifi_and
... View more
06-08-2016
06:44 AM
now working... Thanks Iyappan
... View more
06-02-2016
11:46 AM
@Iyappan Gopalakrishnan Quick reference: http://www.unix.com/shell-programming-and-scripting/246793-writing-hive-scripts-bash-script-file.html
... View more
06-02-2016
01:18 PM
1 Kudo
There are a few things you can do here if i am understanding correctly what you are trying to accomplish. 1. The logback.xml can be modified so specific processor component logs could be redirected to a specific new log file. You can specify where that new log is written. You could also specify the specific log level of those components (WARN level would get you just WARN and ERROR messages).
2. In your dataflow you could use the TailFile processor to monitor that new log and route any generated FlowFiles to a putEmail processor to send them to your Admin. In addition to email you can route those FlowFiles to a processor of your choice to put a copy to a specific location as well either locally or remotely. Thanks, Matt
... View more
05-31-2016
09:12 AM
i tried to change core-site.xml and hdfs-site.xml files sandbox.hortonworks.com:8020 to 192.168.1.158:8020 its working fine
... View more
05-31-2016
09:31 AM
its ipv4 and tried to put net.netfilter.nf_conntrack_tcp_timeout_time_wait = 30 and receive same "is an unknown key"
... View more
05-26-2016
04:18 AM
@ Sourygna Luangsay Thanks for your valuable post. i will try to understand NIFI with HDF and let you know.since I'm newer to big data technologies if i stuck up please help me....again thanks.
... View more