I'm developing custom processor, and i'm trying to use kitesdk in it. I added kite-data-core to my maven file but still i get errors like: Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringEscapeUtils
After i add this dependency to my processor i get error for Logger dependency. And i did some searching about kite-sdk but i did not found anything. Is this a normal thing? Do i need all these dependencies for kitesdk.
I'm building CSV to JSON processor, and the class that i use when i get these errors is CSVProperties.
This is more a dev question.
Nifi contains an entire package of Kite processors. Take a look at the pom file for the package to see its dependencies.
check out this processor
and NiFi Source
Interesting old use of Kite
Thank you all for responses, i will check the links and i hope after that will continue working on processor, and if i finish it i will publish it. CSV to JSON would be so nice to have.
with NIFI you can do CSV to AVRO and then AVRO to JSON. but JSON is not the best format as it is very verbose and not compressed
I'm already using CSV -> AVRO -> JSON. Avro is better but problem is when you want to write to SQL. Also, with JSON you have JOLT, which can be useful for basic transformations. I'm not testing nifi with large amount of data, just some basic ETL stuff.