Member since
05-12-2020
10
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1367 | 07-27-2020 10:52 AM | |
4508 | 06-19-2020 07:37 AM |
07-27-2020
10:52 AM
Ignore, I figured it out. Hate to say it, but I am working with the UCS satellite database as input - it has 36 fields - Eccentricity is one of the fields. I forgot to add a default value for this field for handling nulls.
... View more
06-19-2020
07:37 AM
This post does not need any more views, I have solved the problem: The first line of my data is column headers. In latter case, in CSVReader, when Schema Access Strategy is set to Use 'Schema Name' Property, then Treat First Line as Header needs to be set to True. The property Ignore CSV Header Column Names also needs to be set to True otherwise if there are field name mismatches between the input file and the schema, the input file names will be used instead of the schema. Alternative: I was able to set Schema Access Strategy to Use String Fields From Header, and that worked, but it ignores your schema, if you have one set up. jc
... View more
05-16-2020
05:33 AM
@johndcal A namespace is not required within the avro schema source in Schema Registry. In the context of avro spec. In order to create an avro schema in the Schema Registry, you have to send the first call to create the schema entity. The next call is then to add the actual avro schema to the existing entity. This is just the behavior of the Schema Registry. You can find some lessons I created in how to use the registry: https://community.cloudera.com/t5/Community-Articles/Using-the-Schema-Registry-API/ta-p/286194 I also have an article showing how to fully automate the creation of Avro Schemas from CSV file (column name and data type) using the Schema Registry, Hive, and NiFI: https://community.cloudera.com/t5/Community-Articles/How-to-automate-creation-of-Avro-and-Hive-Schemas-using-NiFi/ta-p/293183 If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post. Thanks, Steven @ DFHZ
... View more
05-12-2020
07:44 AM
Use query record processor, have CSVReader and JSONWriter output. do SELECT satellite_name FROM FLOWFILE Next processor can grab an attribute
... View more