<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Re: NiFi: Applying an Avro Schema in ConvertCSVToAvro in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/NiFi-Applying-an-Avro-Schema-in-ConvertCSVToAvro/m-p/148550#M111076</link>
    <description>&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="3996-hdfs.png" style="width: 2077px;"&gt;&lt;img src="https://community.cloudera.com/t5/image/serverpage/image-id/21321i77A7F6EE3FA585F7/image-size/medium?v=v2&amp;amp;px=400" role="button" title="3996-hdfs.png" alt="3996-hdfs.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;
 I ran the same flow myself and examined the AVRO file in HDFS using AVRO Cli.&lt;/P&gt;&lt;P&gt;
 Even though I didn't specify SNAPPY compression, it was there in the file.&lt;/P&gt;&lt;PRE&gt;[root@sandbox opt]# java -jar avro-tools-1.8.0.jar getmeta 23568764174290.avro
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See &lt;A href="http://logging.apache.org/log4j/1.2/faq.html#noconfig" target="_blank" rel="nofollow noopener noreferrer"&gt;http://logging.apache.org/log4j/1.2/faq.html#noconfig&lt;/A&gt; for more info.
avro.codec snappy
avro.schema {"type":"record","name":"people","doc":"Schema generated by Kite","fields":[{"name":"id","type":"long","doc":"Type inferred from '2'"},{"name":"first_name","type":"string","doc":"Type inferred from 'Gregory'"},{"name":"last_name","type":"string","doc":"Type inferred from 'Vasquez'"},{"name":"email","type":"string","doc":"Type inferred from 'gvasquez1@pcworld.com'"},{"name":"gender","type":"string","doc":"Type inferred from 'Male'"},{"name":"ip_address","type":"string","doc":"Type inferred from '32.8.254.252'"},{"name":"company_name","type":"string","doc":"Type inferred from 'Janyx'"},{"name":"domain_name","type":"string","doc":"Type inferred from 'free.fr'"},{"name":"file_name","type":"string","doc":"Type inferred from 'NonMauris.xls'"},{"name":"mac_address","type":"string","doc":"Type inferred from '03-FB-66-0F-20-A3'"},{"name":"user_agent","type":"string","doc":"Type inferred from '\"Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_7;'"},{"name":"lat","type":"string","doc":"Type inferred from ' like Gecko) Version/5.0.4 Safari/533.20.27\"'"},{"name":"long","type":"double","doc":"Type inferred from '26.98829'"}]}
&lt;/PRE&gt;&lt;P&gt;It's hard coded in NIFI.&lt;/P&gt;&lt;P&gt;
 &lt;A href="https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-kite-bundle/nifi-kite-processors/src/main/java/org/apache/nifi/processors/kite/ConvertCSVToAvro.java" rel="nofollow noopener noreferrer" target="_blank"&gt;https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-kite-bundle/nifi-kite-processors/src/main/java/org/apache/nifi/processors/kite/ConvertCSVToAvro.java&lt;/A&gt;&lt;/P&gt;&lt;P&gt;
 It always adds SnappyCompression to every AVRO file.  No options.&lt;/P&gt;&lt;PRE&gt;
 224   writer.setCodec(CodecFactory.snappyCodec());&lt;/PRE&gt;</description>
    <pubDate>Sun, 18 Aug 2019 13:12:34 GMT</pubDate>
    <dc:creator>TimothySpann</dc:creator>
    <dc:date>2019-08-18T13:12:34Z</dc:date>
  </channel>
</rss>

