There was some discussion on linkedin about the previous article being a good processor, so I decided to do that. This is pretty basic, but it handles most
types okay. Date and number processing is a bit hacky, but guesses some types.
To install, copy the NAR file that you build or download from Github to your NiFi/lib directories and restart those servers.
Add the New Processor to Your Flow
Configure the Processor with a table type (that is ignored in this version)
Configure the Processor with a table name (this is important)
JsonToDDLProcessor Generated Docs
I configured my table name to be the filename without an extension for JSON
Output in NiFi
Enhancements In Consideration:
Attribute Cleaner Enhancement
Deep Learning for Determining Types
Machine Learning for Type Inference
Make Fields Even Sized or Learn What Sizes Are Common Profiling Data
Call to the community, if this is interesting, please join. If you don't want to code, please suggest enhancements, open tickets on bugs, spread the word. Thanks.