Member since
09-13-2015
59
Posts
18
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2713 | 12-19-2017 08:14 PM | |
2153 | 10-11-2017 02:21 PM | |
2943 | 06-12-2017 09:26 PM | |
4576 | 06-08-2017 01:36 PM | |
1728 | 11-04-2016 08:35 PM |
08-21-2018
06:50 PM
2 Kudos
Restarting NiFi nodes fails with an error message such as the one below:
<br>File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 278, in
Master().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute
method(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 993, in restart
self.start(env, upgrade_type=upgrade_type)
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 152, in start
nifi_cli.create_or_update_reg_client(params.nifi_registry_host, params.nifi_registry_url)
File "/u/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_cli.py", line 175, in create_or_update_reg_client
existing_clients = list_reg_clients()
File "/u/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_cli.py", line 144, in list_reg_clients
outputType="json"
File "/u/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi_cli.py", line 73, in nifi_cli
raise Fail("Failed to execute nifi cli.sh command")
Cause: This occurs when the nifi.initial.admin.identity does not have permission to access the /controller API. Workaround: Create a local user in Ranger with the name of the initial admin idenity Add a Ranger Policy for NiFi with Read/Write permissions for /controller
... View more
Labels:
02-28-2018
11:02 PM
Unfortunately the jolt spec isn't working as intended. Is is replacing the field names with their values. On to Plan B...
... View more
02-28-2018
10:51 PM
Thank you @Matt Burgess. I will give this a shot. My alternate strategy is to infer an avro schema, and then use @Timothy Spann 's attribute cleaner and then convert back to JSON. https://github.com/tspannhw/nifi-attributecleaner-processor
... View more
02-28-2018
09:34 PM
I have json content streaming in, and I would like to rename the field names, specifically I need to remove "." as I am inserting into MongoDB which does not support periods in key names. Requirements: Only field names are modified, not content. So {"host.ip":"192.168.1.1"} -> {"host_ip":"192.168.1.1"} Field names are unknown, so I can't explicitly replace I would prefer not to split the json array into individual flow files. Has anyone tackled an issue like this before?
... View more
Labels:
- Labels:
-
Apache NiFi
12-19-2017
08:47 PM
So if I am understanding this correctly, you want to do the following: Windows Files Share ----> NiFi -----> Hadoop Off the top of my head I can think of a couple ways to do it. 1) Setup the Windows directory to share via FTP. This can be done using IIS on the Windows machine, or a 3rd party FTP server 2) Install MiNiFi or NiFi on the Windows machine to transmit data using site-to-site protocol to the NiFi Cluster Is there a particular reason you don't want to mount the share to the NiFi host?
... View more
12-19-2017
08:14 PM
1 Kudo
There is no native processor to open access databases files. You can handle it a couple ways... Easiest would be to export the data from access into csv and ingest that. The other method would be to connect to the server running MS Access via JDBC. However, I believe this would require a 3rd party driver, as Microsoft only has ODBC drivers for Access (but this may no longer be the case)
... View more
11-21-2017
07:58 PM
I am attempting to query hive_table entities in Atlas using the Atlas webUI. One of the queries I would like to do is filter by db. However, db is not a filter option, and querying where db="name" throws an exception. The only workaround I have found is filtering on the qualifiedName begins_with dbname. Is there something I am missing
... View more
Labels:
- Labels:
-
Apache Atlas
11-15-2017
07:00 PM
@Chad Woodhead Yes, it was resolved. But I don't have a good explanation. It actually resolved itself by simply restarting the NiFi process on all nodes. After the restart they all connected and worked as expected.
... View more
10-11-2017
02:21 PM
2 Kudos
I am not aware of any way to do it natively in NiFi. You could always use a REST interface with MongoDB to allow interaction via InvokeHTTP. https://docs.mongodb.com/ecosystem/tools/http-interfaces/#rest-interface
... View more
09-29-2017
09:14 PM
The existing keytab should not require a password. The following command works, and doesn't prompt for a password. kinit -kt /etc/security/keytabs/NiFi_App_Prod.keytab NiFi_App_Prod@<REALM>.com Also, a similar configuration works in the dev environment without issue.
... View more