question Re: Sum of Table Column in NiFi in Archives of Support Questions (Read Only)

Sum of Table Column in NiFi

dmueller1607 — Sun, 18 Aug 2019 07:57:04 GMT

I need to create checksums in my ETL process. Therefore I need to sum up a numeric column in my JDBC-connected table(s). Copying the data works fine so far, but I was not able to find the correct NiFi processor for this aggregation task.

How can I calculate the sum of a table column? Which processor to use (is there something similar for the SelectHiveQL processor, which works fine for the same aggregation task)? And how to compare these two results (from two different tables) to check if the sums are equal?

I already tried to use a ExecuteSQL processor but there I get an SchemaParseException:

I'm using NiFi 1.4.0 and Hive 1.2.1.

Re: Sum of Table Column in NiFi

Shu_ashu — Fri, 12 Jan 2018 00:26:57 GMT

@Daniel Müller

Can you create alias name for the aggregate column sum(menge) as menge then the processor will work.

Change the SQL Query as

Select sum(menge)menge from <table>

Re: Sum of Table Column in NiFi

dmueller1607 — Fri, 12 Jan 2018 18:54:57 GMT

Yes, that was the solution! Thank you very much!

Everything works fine with the following statement now:

SELECT SUM(menge) menge FROM mytable

question Re: ​Sum of Table Column in NiFi in Archives of Support Questions (Read Only)

​Sum of Table Column in NiFi

Re: ​Sum of Table Column in NiFi

Re: ​Sum of Table Column in NiFi

question Re: Sum of Table Column in NiFi in Archives of Support Questions (Read Only)

Sum of Table Column in NiFi

Re: Sum of Table Column in NiFi

Re: Sum of Table Column in NiFi