Member since
07-30-2019
898
Posts
195
Kudos Received
91
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
699 | 10-05-2021 01:53 PM | |
12912 | 09-23-2019 06:03 AM | |
4824 | 05-04-2019 08:42 PM | |
909 | 06-11-2018 12:45 PM | |
8925 | 06-04-2018 01:11 PM |
08-18-2017
06:57 PM
@Alvin Jin What happens when content exceeds the maximum size of repository? If you reach the configured memory limit in the Volatile Content Repository, then you will not be able to add any new data to the flow until some memory is freed. The only way you would see an Out Of memory exception would be if you configured the nifi.volatile.content.repository.max.size property to a larger value than the memory on the system. It does not auto purge from memory and it does not auto archive to disk. These properties are ignored when using the Volatile Content Repository
nifi.content.claim nifi.content.repository.archive nifi.content.viewer.url
... View more
08-18-2017
06:00 PM
@Denis Urbanavicius Try running the FetchFTP with a Completion Strategy of Delete File. Does that make any difference?
... View more
08-18-2017
12:04 PM
@sally sally If the answer helped, please accept it. Thanks
... View more
08-17-2017
08:24 PM
1 Kudo
@sally sally I don't have a specific link to a doc, but here is an example of what I did once using the ExecuteStreamCommand processor. Here is a a snapshot of the configuration of the ExecuteStreamCommand processor. My particular example stops and starts the processor. Also, you can put the script anywhere the NiFi process is able to access and execute it. Here is the script, this script had to retrieve a token, because my particular instance of NiFi was secured and used LDAP for authentication. If your instance of NiFi isn't secured then you could skip that first step and none of your curl commands will need the -H 'Authorization: Bearer'$token'' parameter. In addition, you'll have to change the processor uuid to match the uuid of the InvokeHttp processor and the URL of the NiFi instance should match yours. #!/bin/bash
# Get access token from LDAP server
token=$(curl 'https://nifi-server:9091/nifi-api/access/token' -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' --data 'username=username&password=password' --compressed --insecure --tlsv1.2)
#echo token = $token
# Get the latest version of the flow
version=$(curl 'https://nifi-server:9091/nifi-api/processors/62c34df2-015b-1000-89e3-e2e77533331e' -X GET -H 'Content-Type: application/x-www-form-urlencoded; charset=UTF-8' -H 'Authorization: Bearer '$token'' --compressed --insecure --tlsv1.2 | awk -F'[/:]' '{print $4}' | head -c2)
#echo version = $version
# This command is stopping the processor
curl 'https://nifi-server:9091/nifi-api/processors/62c34df2-015b-1000-89e3-e2e77533331e' -X PUT -H 'Host: nifi-ambari-02:9091' -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Firefox/52.0' -H 'Accept: application/json, text/javascript, */*; q=0.01' -H 'Accept-Language: en-US,en;q=0.5' --compressed -H 'Referer: https://nifi-ambari-02:9091/nifi/' -H 'Content-Type: application/json' -H 'Authorization: Bearer '$token'' -H 'X-Requested-With: XMLHttpRequest' -H 'Connection: keep-alive' --data '{"revision":{"clientId":"6386076d-015b-1000-2a22-714f84689191","version":'$version'},"component":{"id":"62c34df2-015b-1000-89e3-e2e77533331e","state":"STOPPED"}}' --insecure --tlsv1.2
echo
sleep 15
# This step starts the processor
curl 'https://nifi-server:9091/nifi-api/processors/62c34df2-015b-1000-89e3-e2e77533331e' -X PUT -H 'Host: nifi-ambari-02:9091' -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:52.0) Gecko/20100101 Firefox/52.0' -H 'Accept: application/json, text/javascript, */*; q=0.01' -H 'Accept-Language: en-US,en;q=0.5' --compressed -H 'Referer: https://nifi-ambari-02:9091/nifi/' -H 'Content-Type: application/json' -H 'Authorization: Bearer '$token'' -H 'X-Requested-With: XMLHttpRequest' -H 'Connection: keep-alive' --data '{"revision":{"clientId":"6386076d-015b-1000-2a22-714f84689191","version":'$version'},"component":{"id":"62c34df2-015b-1000-89e3-e2e77533331e","state":"RUNNING"}}' --insecure --tlsv1.2
# Echo a blank line
echo
... View more
08-17-2017
06:17 PM
@dhieru singh
What does the config of the PublishKafka processor look like?
... View more
08-17-2017
12:52 PM
@sally sally You can use the response output to trigger another processor, you won't have to generate another flow file. A better processor to use would be the ExecuteScript or ExecuteStreamCommand processor to make the rest api call.
... View more
08-16-2017
02:57 PM
@Han Wo In order to use a DistributedMapCacheClientService, you also need to configure a DistributedMapCacheServer controller service. Then in the property "Server Hostname " in the Client service, make sure and put one server if running in a cluster. For example; You can use the default settings for the DistributedMapCacheServer Then configure the DistributedMapCacheClientService
... View more
08-15-2017
12:05 PM
@Denis Urbanavicius Are NiFi and Filezilla running on the same system or different systems?
... View more