question Re: Can we specify multiple directories for Nifi local state store? in Archives of Support Questions (Read Only)

Can we specify multiple directories for Nifi local state store?

KuldeepK — Fri, 30 Jun 2017 01:49:58 GMT

Was reading this - https://nifi.apache.org/docs.html ( Configuring State Providers )

Can we specify more than one directory for WriteAheadLocalStateProvider?

E.g. By default it has below property in state-management.xml

    <local-provider>
        <id>local-provider</id>
        <class>org.apache.nifi.controller.state.providers.local.WriteAheadLocalStateProvider</class>
        <property name="Directory">/var/lib/nifi/state/local</property>
    </local-provider>

Can I add one more disk partition as a value of Directory in above xml? If yes, How to do that?

FYI: Below does not work.

    <local-provider>
        <id>local-provider</id>
        <class>org.apache.nifi.controller.state.providers.local.WriteAheadLocalStateProvider</class>
        <property name="Directory">/var/lib/nifi/state/local</property>
        <property name="Directory">/blahblah</property>
    </local-provider>

Re: Can we specify multiple directories for Nifi local state store?

KuldeepK — Fri, 30 Jun 2017 01:50:59 GMT

@Matt Clarke

@Wynner

Re: Can we specify multiple directories for Nifi local state store?

MattWho — Fri, 30 Jun 2017 01:54:37 GMT

@Kuldeep Kulkarni

No you can not specify more then one local state directory. There is not much in the way of local state that is store by NiFi, so i am not sure the use case for needing more then one.

Thanks,

Matt

Re: Can we specify multiple directories for Nifi local state store?

KuldeepK — Fri, 30 Jun 2017 01:58:47 GMT

@Matt Clarke - Perfect! Thanks.

Re: Can we specify multiple directories for Nifi local state store?

MattWho — Fri, 30 Jun 2017 01:59:33 GMT

NiFi allows you to specify multiple of the following:

- Content repositories directories

- Provenance repositories directories

- NiFi lib directories

- Variable registry files

Having multiple of any of these does not mean cloning of any data I going on.

Thanks,

Matt

Re: Can we specify multiple directories for Nifi local state store?

KuldeepK — Fri, 30 Jun 2017 02:09:07 GMT

@Matt Clarke

You already answered my next question 🙂

For all above mentioned directories, it stores data in round robin manner like Datanode stores blocks on local disks. Got it.