Member since
03-26-2020
2
Posts
0
Kudos Received
0
Solutions
03-26-2020
08:58 PM
Here is my minifi config.ymlI was getting errors with "Connection with id fa448f5c-a210-3082-0000-000000000000 has invalid destination id 285396b9-e25b-3684-aea1-ec195056a759" using the minifi tool kit but I think I have fixed that now. MiNiFi Config Version: 3
Flow Controller:
name: minifi2Template
comment: ''
Core Properties:
flow controller graceful shutdown period: 10 sec
flow service write delay interval: 500 ms
administrative yield duration: 30 sec
bored yield duration: 10 millis
max concurrent threads: 1
variable registry properties: ''
FlowFile Repository:
partitions: 256
checkpoint interval: 2 mins
always sync: false
Swap:
threshold: 20000
in period: 5 sec
in threads: 1
out period: 5 sec
out threads: 4
Content Repository:
content claim max appendable size: 10 MB
content claim max flow files: 100
always sync: false
Provenance Repository:
provenance rollover time: 1 min
implementation: org.apache.nifi.provenance.MiNiFiPersistentProvenanceRepository
Component Status Repository:
buffer size: 1440
snapshot frequency: 1 min
Security Properties:
keystore: ''
keystore type: ''
keystore password: ''
key password: ''
truststore: ''
truststore type: ''
truststore password: ''
ssl protocol: ''
Sensitive Props:
key:
algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
provider: BC
Processors: []
Controller Services: []
Process Groups:
- id: c7ea9979-811a-3303-0000-000000000000
name: Minifi2
Processors:
- id: 63dbbe35-8982-3c34-0000-000000000000
name: TailFile
class: org.apache.nifi.processors.standard.TailFile
max concurrent tasks: 1
scheduling strategy: TIMER_DRIVEN
scheduling period: 0 sec
penalization period: 30 sec
yield period: 1 sec
run duration nanos: 0
auto-terminated relationships list: []
Properties:
File Location: Local
File to Tail: logs/minifi-app.log
Initial Start Position: Beginning of File
Rolling Filename Pattern:
tail-base-directory:
tail-mode: Single file
tailfile-lookup-frequency: 10 minutes
tailfile-maximum-age: 24 hours
tailfile-recursive-lookup: 'false'
Controller Services: []
Process Groups: []
Input Ports: []
Output Ports: []
Funnels: []
Connections:
- id: fa448f5c-a210-3082-0000-000000000000
name: TailFile/success/285396b9-e25b-3684-aea1-ec195056a759
source id: 63dbbe35-8982-3c34-0000-000000000000
source relationship names:
- success
destination id: 285396b9-e25b-3684-aea1-ec195056a759
max work queue size: 10000
max work queue data size: 1 GB
flowfile expiration: 0 sec
queue prioritizer class: ''
Remote Process Groups:
- id: 0a7fd66d-0d00-3e1a-0000-000000000000
name: ''
url: http://172.24.10.202:8080/nifi/
comment: ''
timeout: 30 sec
yield period: 10 sec
transport protocol: HTTP
proxy host: ''
proxy port: ''
proxy user: ''
proxy password: ''
local network interface: ''
Input Ports:
- id: 285396b9-e25b-3684-aea1-ec195056a759
name: From Minifi
comment: ''
max concurrent tasks: 1
use compression: false
Properties:
Port: 1026
Host Name: 172.24.10.202
Output Ports: []
Input Ports: []
Output Ports: []
Funnels: []
Connections: []
Remote Process Groups: []
NiFi Properties Overrides: {} }
... View more
03-26-2020
06:27 PM
Is anyone able to help with this issue. I have fllowed all the guides but cannot get my Pi to transmit data to nifi. The log from the Pi is shown below. Is that telling me that it is not reading the data? Thanks [2020-03-27 11:52:05.913] [main] [info] Loading FlowController [2020-03-27 11:52:05.914] [org::apache::nifi::minifi::FlowController] [info] Load Flow Controller from file /home/pi/Code/minifi/nifi-minifi-cpp-0.7.0/conf/config.yml [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Loaded root processor Group [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Initializing timers [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Loaded controller service provider [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Loaded flow repository [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Starting Flow Controller [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::core::controller::StandardControllerServiceProvider] [info] Enabling 0 controller services [2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Started Flow Controller [2020-03-27 11:52:05.917] [main] [info] MiNiFi started [2020-03-27 11:52:18.230] [org::apache::nifi::minifi::core::repository::FlowFileRepository] [info] Repository stats: key count: 0, table readers size: 324, all memory tables size: 364 [2020-03-27 11:52:24.123] [org::apache::nifi::minifi::provenance::ProvenanceRepository] [info] Repository stats: key count: 0, table readers size: 0, all memory tables size: 364 [2020-03-27 11:52:35.921] [org::apache::nifi::minifi::core::repository::FlowFileRepository] [info] Repository stats: key count: 0, table readers size: 0, all memory tables size: 364
... View more
Labels:
- Labels:
-
Apache MiNiFi
