About rgelhausen

rgelhausen · ‎09-12-2016

Hi, @gkeys, following the RedShift example here, the properties in your JDBC interpreter settings would be phoenix.user, phoenix.driver, phoenix.url, instead. Since you have modified the "default" prefix, does the plain "%jdbc" not work for the interpreter setting?

rgelhausen · ‎09-02-2016

Yes, it does. If it didn't, your queries would return incorrect results. The code suggests to me that the PhoenixRecordWriter handles the responsibility of updating both the data tables and index tables during the MR job output, but I'm not sure the link is to exactly the right class.

rgelhausen · ‎09-01-2016

The PhoenixDriver is what provides the JDBC interface to HBase to begin with. I'm not aware of any JDBC HBase driver that doesn't involve Phoenix.

rgelhausen · ‎08-28-2016

I'm not running a cluster, so copying from a directory would be easier. Looking in $NIFI_HOME/conf, I have: [root@monitor nifi]# ls -all conf/ total 72 drwxr-xr-x. 3 root root 4096 Aug 28 21:38 . drwxr-xr-x. 14 root root 4096 Aug 28 21:37 .. drwxr-xr-x. 2 root root 4096 Aug 28 21:38 archive -rw-rw-r--. 1 root root 3781 Aug 5 18:48 authorizers.xml -rw-rw-r--. 1 root root 2119 Aug 5 18:48 bootstrap-notification-services.xml -rw-rw-r--. 1 root root 2906 Aug 5 18:48 bootstrap.conf -rw-r--r--. 1 root root 8300 Aug 28 21:38 flow.xml.gz -rw-rw-r--. 1 root root 8158 Aug 5 18:48 logback.xml -rw-rw-r--. 1 root root 6089 Aug 5 18:48 login-identity-providers.xml -rw-rw-r--. 1 root root 8407 Aug 28 21:36 nifi.properties -rw-rw-r--. 1 root root 3637 Aug 5 18:48 state-management.xml -rw-rw-r--. 1 root root 1437 Aug 5 18:48 zookeeper.properties Unfortunately none of these contains anything resembling my "Test" template. Where else should I look, @Andrew Grande?

rgelhausen · ‎08-27-2016

I've created a few templates and want to save them someplace. I'm aware of the ability to download from the Web UI, but for scripting's sake would prefer to copy them from a folder somewhere. Does NiFi save templates in a folder someplace?

rgelhausen · ‎08-17-2016

Thanks for the suggestions. On further thought, what about using a single PutHDFS with Directory set by flowfiles. Ranger HDFS permissions are set to allow the NiFi user to write to specific ingest directories, and downstream consumers should have Ranger HDFS read permissions on the ingest directories necessary for their application.

rgelhausen · ‎08-17-2016

No. Falcon is used for bulk data replication. For HBase, you should use HBase's own internally managed replication capability.

rgelhausen · ‎08-17-2016

This is a kerberized instance of HDFS. Is it possible for flowfiles themselves to specify the HDFS user, or only on a per processor basis? Some of our use cases call for allowing business users to define their own ingest streams and push to varying HDFS directories owned by different users, and generating and distributing keytabs to business users seems less than appealing.

rgelhausen · ‎08-17-2016

@Bryan Bende sounds better to me than parsing the Transit Uri 😃

rgelhausen · ‎08-16-2016

That attribute would be a great addition to Site2Site traffic. Today the upstream flow is responsible for including attributes specifying data origin. Downstream should be able to access data origin regardless of how the upstream flow is configured.

Online	Offline
Last Visited	‎01-23-2018 02:10 AM

Member Since	‎09-21-2015 08:50 PM
Last Visited	‎01-23-2018 02:10 AM
Posts	133
Kudos received	123

Cloudera Community

Re: Phoenix table design

Re: How to determine whether a hive script fails?

Re: Performance metrics phoenix bulk load vs hbase...

Re: What is recommended way of moving mainframe da...

Re: HBase Row Level Filtering

Re: Trying to create phoenix interpreter using %jd...

Re: Does phoenix update global index during bulk l...

Re: JDBC connection with your HBase bypassing the ...

Re: Where are NiFi templates stored?

Where are NiFi templates stored?

Re: How can I configure NiFi to PutHDFS as a user ...

Re: Can Apache Falcon be Used for HBase to HBase R...

How can I configure NiFi to PutHDFS as a user othe...

Re: Can I access event provenance metadata using e...

Re: Can I access event provenance metadata using e...