b7373496-0156-1000-82d2-0516957e32eeHive Streaming Olympicsb73b3b5c-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000001 GB10000b7373496-0156-1000-0000-000000000000b737c1bd-0156-1000-0000-000000000000PROCESSOR0 sec1success0b73b5192-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000001 GB10000b7373496-0156-1000-0000-000000000000b7384287-0156-1000-0000-000000000000PROCESSOR0 sec1success0b73b8092-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000001 GB10000b7373496-0156-1000-0000-000000000000b73a66d4-0156-1000-0000-000000000000PROCESSOR0 sec1unsupported contentfailure0b92a5904-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000001 GB10000b7373496-0156-1000-0000-000000000000b73a66d4-0156-1000-0000-000000000000PROCESSOR0 sec1incompatiblefailure0b946dd2e-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000001 GB10000b7373496-0156-1000-0000-000000000000b738fdbd-0156-1000-0000-000000000000PROCESSOR0 sec1success0b9486e23-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000001 GB10000b7373496-0156-1000-0000-000000000000b73a66d4-0156-1000-0000-000000000000PROCESSOR0 sec1failure0b7374e09-0156-1000-0000-000000000000b7373496-0156-1000-0000-00000000000018.9522399902343750.0WARN1Keep Source FiletruetruefalsefalsefalseIf true, the file is not deleted after it has been copied to the Content Repository; this causes the file to be picked up continually and is useful for testing purposes. If not keeping original NiFi will need write permissions on the directory it is pulling from otherwise it will ignore the file.Keep Source FilefalseKeep Source FiletruefalsefalseMinimum File Age0 secThe minimum age that a file must be in order to be pulled; any file younger than this amount of time (according to last modification date) will be ignoredMinimum File AgefalseMinimum File AgetruefalsefalsePolling Interval0 secIndicates how long to wait before performing a directory listingPolling IntervalfalsePolling IntervaltruefalsefalseInput DirectoryThe input directory from which to pull filesInput DirectoryfalseInput DirectorytruefalsetrueMaximum File AgeThe maximum age that a file must be in order to be pulled; any file older than this amount of time (according to last modification date) will be ignoredMaximum File AgefalseMaximum File AgefalsefalsefalseBatch Size10The maximum number of files to pull in each iterationBatch SizefalseBatch SizetruefalsefalseMaximum File SizeThe maximum size that a file can be in order to be pulledMaximum File SizefalseMaximum File SizefalsefalsefalseMinimum File Size0 BThe minimum size that a file must be in order to be pulledMinimum File SizefalseMinimum File SizetruefalsefalseIgnore Hidden FilestruetruefalsefalsetrueIndicates whether or not hidden files should be ignoredIgnore Hidden FilesfalseIgnore Hidden FilestruefalsefalseRecurse SubdirectoriestruetruefalsefalsetrueIndicates whether or not to pull files from subdirectoriesRecurse SubdirectoriesfalseRecurse SubdirectoriestruefalsefalseFile Filter[^\.].*Only files whose names match the given regular expression will be picked upFile FilterfalseFile FiltertruefalsefalsePath FilterWhen Recurse Subdirectories is true, then only subdirectories whose path matches the given regular expression will be scannedPath FilterfalsePath Filterfalsefalsefalsefalse30 secKeep Source FilefalseMinimum File Age0 secPolling Interval0 secInput Directory/Users/nshawa/Downloads/olympicsMaximum File AgeBatch Size10Maximum File SizeMinimum File Size0 BIgnore Hidden FilestrueRecurse SubdirectoriestrueFile Filter[^\.].*Path Filter00 secTIMER_DRIVEN1 secGetFilefalsesuccessorg.apache.nifi.processors.standard.GetFileb737c1bd-0156-1000-0000-000000000000b7373496-0156-1000-0000-000000000000719.509246826171912.21566653251648WARN1Schema Output Destinationflowfile-attributeflowfile-attributeflowfile-contentflowfile-contentflowfile-contentControl if Avro schema is written as a new flowfile attribute 'inferred.avro.schema' or written in the flowfile content. Writing to flowfile content will overwrite any existing flowfile content.Schema Output DestinationfalseSchema Output DestinationtruefalsefalseGet CSV Header Definition From DatatruetruefalsefalsetrueThis property only applies to CSV content type. If "true" the processor will attempt to read the CSV header definition from the first line of the input data.Get CSV Header Definition From DatafalseGet CSV Header Definition From DatatruefalsefalseAvro Record NameValue to be placed in the Avro record schema "name" field.Avro Record NamefalseAvro Record NametruefalsetrueCharsetUTF-8Character encoding of CSV data.CharsetfalseCharsettruefalsefalseCSV Header Line Skip Count0This property only applies to CSV content type. Specifies the number of lines that should be skipped when reading the CSV data. Setting this value to 0 is equivalent to saying "the entire contents of the file should be read". If the property "Get CSV Header Definition From Data" is set then the first line of the CSV file will be read in and treated as the CSV header definition. Since this will remove the header line from the data care should be taken to make sure the value of "CSV header Line Skip Count" is set to 0 to ensure no data is skipped.CSV Header Line Skip CountfalseCSV Header Line Skip CounttruefalsetrueCSV delimiter,Delimiter character for CSV recordsCSV delimiterfalseCSV delimiterfalsefalsefalseCSV Escape String\This property only applies to CSV content type. String that represents an escape sequence in the CSV FlowFile content data.CSV Escape StringfalseCSV Escape StringtruefalsetrueCSV Header DefinitionThis property only applies to CSV content type. Comma separated string defining the column names expected in the CSV data. EX: "fname,lname,zip,address". The elements present in this string should be in the same order as the underlying data. Setting this property will cause the value of "Get CSV Header Definition From Data" to be ignored instead using this value.CSV Header DefinitionfalseCSV Header DefinitionfalsefalsetrueInput Content Typeuse mime.type valueuse mime.type valuejsonjsoncsvcsvuse mime.type valueContent Type of data present in the incoming FlowFile's content. Only "json" or "csv" are supported. If this value is set to "use mime.type value" the incoming Flowfile's attribute "MIME_TYPE" will be used to determine the Content Type.Input Content TypefalseInput Content TypetruefalsefalsePretty Avro OutputtruetruefalsefalsetrueIf true the Avro output will be formatted.Pretty Avro OutputfalsePretty Avro OutputtruefalsefalseCSV Quote String'This property only applies to CSV content type. String that represents a literal quote character in the CSV FlowFile content data.CSV Quote StringfalseCSV Quote StringtruefalsetrueNumber Of Records To Analyze10This property only applies to JSON content type. The number of JSON records that should be examined to determine the Avro schema. The higher the value the better chance kite has of detecting the appropriate type. However the default value of 10 is almost always enough.Number Of Records To AnalyzefalseNumber Of Records To Analyzetruefalsetruefalse30 secSchema Output Destinationflowfile-attributeGet CSV Header Definition From DatafalseAvro Record NameOlympicsCharsetUTF-8CSV Header Line Skip Count0CSV delimiter,CSV Escape String\CSV Header DefinitionCity,Edition,Sport,sub_sport,Athlete,country,Gender,Event,Event_gender,MedalInput Content TypecsvPretty Avro OutputtrueCSV Quote String"Number Of Records To Analyze1000 secTIMER_DRIVEN1 secInferAvroSchemafalsefailuretrueoriginalfalsesuccessfalseunsupported contentorg.apache.nifi.processors.kite.InferAvroSchemab7384287-0156-1000-0000-000000000000b7373496-0156-1000-0000-000000000000751.5623474121094241.3683567047119WARN1CSV quote character"Quote character for CSV valuesCSV quote characterfalseCSV quote characterfalsefalsefalseUse CSV header linefalseWhether to use the first line as a headerUse CSV header linefalseUse CSV header linefalsefalsefalseCSV charsetutf8Character set for CSV filesCSV charsetfalseCSV charsetfalsefalsefalseLines to skip0Number of lines to skip before reading header or dataLines to skipfalseLines to skipfalsefalsefalseCSV delimiter,Delimiter character for CSV recordsCSV delimiterfalseCSV delimiterfalsefalsefalseHadoop configuration filesA comma-separated list of Hadoop configuration filesHadoop configuration filesfalseHadoop configuration filesfalsefalsefalseCSV escape character\Escape character for CSV valuesCSV escape characterfalseCSV escape characterfalsefalsefalseRecord schemaOutgoing Avro schema for each record created from a CSV rowRecord schemafalseRecord schematruefalsetruefalse30 secCSV quote character"Use CSV header linefalseCSV charsetutf8Lines to skip0CSV delimiter,Hadoop configuration filesCSV escape character\Record schema${inferred.avro.schema}00 secTIMER_DRIVEN1 secConvertCSVToAvrofalsefailurefalseincompatiblefalsesuccessorg.apache.nifi.processors.kite.ConvertCSVToAvrob738fdbd-0156-1000-0000-000000000000b7373496-0156-1000-0000-000000000000677.7328796386719535.5723361968994WARN1Kerberos KeytabKerberos keytab associated with the principal. Requires nifi.kerberos.krb5.file to be set in your nifi.propertiesKerberos KeytabfalseKerberos Keytabfalsefalsefalsehive-stream-partition-colsA comma-delimited list of column names on which the table has been partitioned. The order of values in this list must correspond exactly to the order of partition columns specified during the table creation.Partition Columnsfalsehive-stream-partition-colsfalsefalsefalsehive-stream-metastore-uriThe URI location for the Hive Metastore. Note that this is not the location of the Hive Server. The default port for the Hive metastore is 9043.Hive Metastore URIfalsehive-stream-metastore-uritruefalsefalseKerberos PrincipalKerberos principal to authenticate as. Requires nifi.kerberos.krb5.file to be set in your nifi.propertiesKerberos PrincipalfalseKerberos Principalfalsefalsefalsehive-stream-table-nameThe name of the database table in which to put the data.Table Namefalsehive-stream-table-nametruefalsefalsehive-stream-transactions-per-batch100A hint to Hive Streaming indicating how many transactions the processor task will need. This value must be greater than 1.Transactions per Batchfalsehive-stream-transactions-per-batchtruefalsetruehive-stream-autocreate-partitiontruetruefalsefalsetrueFlag indicating whether partitions should be automatically createdAuto-Create Partitionsfalsehive-stream-autocreate-partitiontruefalsefalsehive-config-resourcesA file or comma separated list of files which contains the Hive configuration (hive-site.xml, e.g.). Without this, Hadoop will search the classpath for a 'hive-site.xml' file or will revert to a default configuration. Note that to enable authentication with Kerberos e.g., the appropriate properties must be set in the configuration files. Please see the Hive documentation for more details.Hive Configuration Resourcesfalsehive-config-resourcesfalsefalsefalsehive-stream-database-nameThe name of the database in which to put the data.Database Namefalsehive-stream-database-nametruefalsefalsehive-stream-max-open-connections8The maximum number of open connections that can be allocated from this pool at the same time, or negative for no limit.Max Open Connectionsfalsehive-stream-max-open-connectionstruefalsefalsehive-stream-heartbeat-interval60Indicates that a heartbeat should be sent when the specified number of seconds has elapsed. A value of 0 indicates that no heartbeat should be sent.Heartbeat Intervalfalsehive-stream-heartbeat-intervaltruefalsefalsefalse30 secKerberos Keytabhive-stream-partition-colshive-stream-metastore-urithrift://sandbox.hortonworks.com:9083Kerberos Principalhive-stream-table-nameolympicshive-stream-transactions-per-batch100hive-stream-autocreate-partitiontruehive-config-resources/Users/nshawa/dev/bhp/hive-site.xmlhive-stream-database-namedefaulthive-stream-max-open-connections8hive-stream-heartbeat-interval6000 secTIMER_DRIVEN1 secPutHiveStreamingfalsefailuretrueretrytruesuccessorg.apache.nifi.processors.hive.PutHiveStreamingb73a66d4-0156-1000-0000-000000000000b7373496-0156-1000-0000-0000000000000.0278.8172092437744WARN1GroupSets the group on the output file to the value of this attribute. You may also use expression language such as ${file.group}.GroupfalseGroupfalsefalsetrueOwnerSets the owner on the output file to the value of this attribute. You may also use expression language such as ${file.owner}.OwnerfalseOwnerfalsefalsetrueCreate Missing DirectoriestruetruefalsefalsetrueIf true, then missing destination directories will be created. If false, flowfiles are penalized and sent to failure.Create Missing DirectoriesfalseCreate Missing DirectoriestruefalsefalsePermissionsSets the permissions on the output file to the value of this attribute. Format must be either UNIX rwxrwxrwx with a - in place of denied permissions (e.g. rw-r--r--) or an octal number (e.g. 644). You may also use expression language such as ${file.permissions}.PermissionsfalsePermissionsfalsefalsetrueMaximum File CountSpecifies the maximum number of files that can exist in the output directoryMaximum File CountfalseMaximum File CountfalsefalsefalseLast Modified TimeSets the lastModifiedTime on the output file to the value of this attribute. Format must be yyyy-MM-dd'T'HH:mm:ssZ. You may also use expression language such as ${file.lastModifiedTime}.Last Modified TimefalseLast Modified TimefalsefalsetrueDirectoryThe directory to which files should be written. You may use expression language such as /aa/bb/${path}DirectoryfalseDirectorytruefalsetrueConflict Resolution StrategyreplacereplaceignoreignorefailfailfailIndicates what should happen when a file with the same name already exists in the output directoryConflict Resolution StrategyfalseConflict Resolution Strategytruefalsefalsefalse30 secGroupOwnerCreate Missing DirectoriestruePermissionsMaximum File CountLast Modified TimeDirectory/Users/nshawa/Downloads/olympics_failedConflict Resolution Strategyfail00 secTIMER_DRIVEN1 secPutFiletruefailuretruesuccessorg.apache.nifi.processors.standard.PutFile08/24/2016 07:25:13 AEST