Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Minifi C++ on a Raspberry Pi

Minifi C++ on a Raspberry Pi

New Contributor

Is anyone able to help with this issue.

I have fllowed all the guides but cannot get my Pi to transmit data to nifi. The log from the Pi is shown below. Is that telling me that it is not reading the data?

 

Thanks

 


[2020-03-27 11:52:05.913] [main] [info] Loading FlowController
[2020-03-27 11:52:05.914] [org::apache::nifi::minifi::FlowController] [info] Load Flow Controller from file /home/pi/Code/minifi/nifi-minifi-cpp-0.7.0/conf/config.yml
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Loaded root processor Group
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Initializing timers
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Loaded controller service provider
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Loaded flow repository
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Starting Flow Controller
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::core::controller::StandardControllerServiceProvider] [info] Enabling 0 controller services
[2020-03-27 11:52:05.917] [org::apache::nifi::minifi::FlowController] [info] Started Flow Controller
[2020-03-27 11:52:05.917] [main] [info] MiNiFi started
[2020-03-27 11:52:18.230] [org::apache::nifi::minifi::core::repository::FlowFileRepository] [info] Repository stats: key count: 0, table readers size: 324, all memory tables size: 364
[2020-03-27 11:52:24.123] [org::apache::nifi::minifi::provenance::ProvenanceRepository] [info] Repository stats: key count: 0, table readers size: 0, all memory tables size: 364
[2020-03-27 11:52:35.921] [org::apache::nifi::minifi::core::repository::FlowFileRepository] [info] Repository stats: key count: 0, table readers size: 0, all memory tables size: 364

1 REPLY 1
Highlighted

Re: Minifi C++ on a Raspberry Pi

New Contributor

Here is my minifi config.ymlI was getting errors with "Connection with id fa448f5c-a210-3082-0000-000000000000 has invalid destination id 285396b9-e25b-3684-aea1-ec195056a759" using the minifi tool kit but I think I have fixed that now.

 

MiNiFi Config Version: 3
Flow Controller:
  name: minifi2Template
  comment: ''
Core Properties:
  flow controller graceful shutdown period: 10 sec
  flow service write delay interval: 500 ms
  administrative yield duration: 30 sec
  bored yield duration: 10 millis
  max concurrent threads: 1
  variable registry properties: ''
FlowFile Repository:
  partitions: 256
  checkpoint interval: 2 mins
  always sync: false
  Swap:
    threshold: 20000
    in period: 5 sec
    in threads: 1
    out period: 5 sec
    out threads: 4
Content Repository:
  content claim max appendable size: 10 MB
  content claim max flow files: 100
  always sync: false
Provenance Repository:
  provenance rollover time: 1 min
  implementation: org.apache.nifi.provenance.MiNiFiPersistentProvenanceRepository
Component Status Repository:
  buffer size: 1440
  snapshot frequency: 1 min
Security Properties:
  keystore: ''  
  keystore type: ''
  keystore password: ''
  key password: ''
  truststore: ''
  truststore type: ''
  truststore password: ''
  ssl protocol: ''
  Sensitive Props:
    key:
    algorithm: PBEWITHMD5AND256BITAES-CBC-OPENSSL
    provider: BC
Processors: []
Controller Services: []
Process Groups:
- id: c7ea9979-811a-3303-0000-000000000000
  name: Minifi2
  Processors:
  - id: 63dbbe35-8982-3c34-0000-000000000000
    name: TailFile
    class: org.apache.nifi.processors.standard.TailFile
    max concurrent tasks: 1
    scheduling strategy: TIMER_DRIVEN
    scheduling period: 0 sec
    penalization period: 30 sec
    yield period: 1 sec
    run duration nanos: 0
    auto-terminated relationships list: []
    Properties:
      File Location: Local
      File to Tail: logs/minifi-app.log
      Initial Start Position: Beginning of File
      Rolling Filename Pattern:
      tail-base-directory:
      tail-mode: Single file
      tailfile-lookup-frequency: 10 minutes
      tailfile-maximum-age: 24 hours
      tailfile-recursive-lookup: 'false'
  Controller Services: []
  Process Groups: []
  Input Ports: []
  Output Ports: []
  Funnels: []
  Connections:
  - id: fa448f5c-a210-3082-0000-000000000000
    name: TailFile/success/285396b9-e25b-3684-aea1-ec195056a759
    source id: 63dbbe35-8982-3c34-0000-000000000000
    source relationship names:
    - success
    destination id: 285396b9-e25b-3684-aea1-ec195056a759
    max work queue size: 10000
    max work queue data size: 1 GB
    flowfile expiration: 0 sec
    queue prioritizer class: ''
  Remote Process Groups:
  - id: 0a7fd66d-0d00-3e1a-0000-000000000000
    name: ''
    url: http://172.24.10.202:8080/nifi/
    comment: ''
    timeout: 30 sec
    yield period: 10 sec
    transport protocol: HTTP
    proxy host: ''
    proxy port: ''
    proxy user: ''
    proxy password: ''
    local network interface: ''
    Input Ports:
    - id: 285396b9-e25b-3684-aea1-ec195056a759
      name: From Minifi
      comment: ''
      max concurrent tasks: 1
      use compression: false
      Properties:
        Port: 1026
        Host Name: 172.24.10.202
    Output Ports: []
Input Ports: []
Output Ports: []
Funnels: []
Connections: []
Remote Process Groups: []
NiFi Properties Overrides: {}

}

Don't have an account?
Coming from Hortonworks? Activate your account here