question Re: SAP HANA / SAP HANA Vora Processor for Apache NiFi in Archives of Support Questions (Read Only)

SAP HANA / SAP HANA Vora Processor for Apache NiFi

TimothySpann — Sat, 16 Jul 2016 02:20:56 GMT

Is there an official (or open source) NiFi Processor for SAP HANA or SAP HANA Vora?

Re: SAP HANA / SAP HANA Vora Processor for Apache NiFi

rgelhausen — Sat, 16 Jul 2016 02:23:29 GMT

To do what? Launch a Spark job? Run a query against Spark Thrift Server?

I haven't seen a mention of a processor with SAP or Vora in the name. You can always check the docs here to see what processors are supported out of the box.

Re: SAP HANA / SAP HANA Vora Processor for Apache NiFi

TimothySpann — Sat, 16 Jul 2016 02:34:41 GMT

I thinking SAP HANA as a source / sink going through VORA. Or launching VORA jobs.

Re: SAP HANA / SAP HANA Vora Processor for Apache NiFi

rgelhausen — Sat, 16 Jul 2016 02:46:11 GMT

I don't know what if any additional interfaces Vora supports, but traditional Spark has a JDBC/ODBC/Thrift server which you can use with ExecuteSQL. You can query/launch jobs that way.

If it's traditional programmatic jobs, you'd need to use InvokeHTTP to talk to YARN's RM to launch a job, OR, use ExecuteCommand to launch a job from the spark-submit scripts.

Re: SAP HANA / SAP HANA Vora Processor for Apache NiFi

vjain — Tue, 26 Jul 2016 03:03:05 GMT

@Timothy Spann

There is no officially supported processor to schedule VORA jobs using NiFi. However, A VORA agent communicates directly with the Spark Client when running in Yarn mode. You can write your program in Python or Scala which invokes the VORA classes and then call those scripts through spark-submit in NiFi using the ExecuteCommand processor.