ba1e8e93-015e-1000-10b6-d6d3c5b262db
CSV_to_JSON_to_ES5_with_ID_CSVReader
868c4a40-a2dc-36f3-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
1d17e88b-ed96-31f8-0000-000000000000
PROCESSOR
0 sec
1
success
0
96c2baf1-deca-3731-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
5ae06b54-a7ff-3409-0000-000000000000
PROCESSOR
0 sec
1
success
0
ab562f55-bc62-33eb-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
1a69acdf-f698-3d4e-0000-000000000000
PROCESSOR
0 sec
1
success
0
f21bd4db-62d4-3a71-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
8e935d57-e97f-3b4b-0000-000000000000
PROCESSOR
0 sec
1
success
0
f8667091-dff7-3faf-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
0edea561-fde6-30e3-0000-000000000000
PROCESSOR
0 sec
1
success
0
0aca0a65-84a1-3a31-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
18a371c8-21c1-3044-0000-000000000000
PROCESSOR
0 sec
1
success
0
0cfc6fb3-e334-3a11-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
bcfb414f-5c5a-3eda-0000-000000000000
PROCESSOR
0 sec
1
success
0
38098de3-f750-3146-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
9ecac3fe-ae40-311d-0000-000000000000
PROCESSOR
0 sec
1
split
0
43fd0b32-e2cf-3fb2-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1 GB
10000
5ab40d37-544c-3062-0000-000000000000
98d66981-4991-3bab-0000-000000000000
PROCESSOR
0 sec
1
success
0
9a0a7eb2-acb6-35b2-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
nifi-record-serialization-services-nar
org.apache.nifi
1.3.0
Schema Write Strategy
Schema Write Strategy
schema-access-strategy
schema-access-strategy
schema-registry
org.apache.nifi.schemaregistry.services.SchemaRegistry
schema-registry
schema-name
schema-name
schema-text
schema-text
Date Format
Date Format
Time Format
Time Format
Timestamp Format
Timestamp Format
Pretty Print JSON
Pretty Print JSON
JsonRecordSetWriter
false
Schema Write Strategy
schema-name
schema-access-strategy
schema-name
schema-registry
cd872092-7ebe-389e-0000-000000000000
schema-name
${schema.name}
schema-text
${avro.schema}
Date Format
Time Format
Timestamp Format
Pretty Print JSON
false
ENABLED
org.apache.nifi.json.JsonRecordSetWriter
cd872092-7ebe-389e-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
nifi-registry-nar
org.apache.nifi
1.3.0
ccr
ccr
AvroSchemaRegistry
false
ccr
${inferred.avro.schema}
ENABLED
org.apache.nifi.schemaregistry.services.AvroSchemaRegistry
e450597a-0f71-3d9e-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
nifi-ssl-context-service-nar
org.apache.nifi
1.3.0
Keystore Filename
Keystore Filename
Keystore Password
Keystore Password
key-password
key-password
Keystore Type
Keystore Type
Truststore Filename
Truststore Filename
Truststore Password
Truststore Password
Truststore Type
Truststore Type
SSL Protocol
SSL Protocol
StandardSSLContextService
false
Keystore Filename
D:\stuff\apache\nifi\nifi-1.3.0\server.keystore
Keystore Password
key-password
Keystore Type
JKS
Truststore Filename
D:\stuff\apache\nifi\nifi-1.3.0\nifitruststore
Truststore Password
Truststore Type
JKS
SSL Protocol
TLS
ENABLED
org.apache.nifi.ssl.StandardSSLContextService
7d9548be-8390-3402-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
nifi-record-serialization-services-nar
org.apache.nifi
1.3.0
schema-access-strategy
schema-access-strategy
schema-registry
org.apache.nifi.schemaregistry.services.SchemaRegistry
schema-registry
schema-name
schema-name
schema-text
schema-text
Date Format
Date Format
Time Format
Time Format
Timestamp Format
Timestamp Format
CSV Format
CSV Format
Value Separator
Value Separator
Skip Header Line
Skip Header Line
Quote Character
Quote Character
Escape Character
Escape Character
Comment Marker
Comment Marker
Null String
Null String
Trim Fields
Trim Fields
CSVReader
false
schema-access-strategy
schema-name
schema-registry
cd872092-7ebe-389e-0000-000000000000
schema-name
${schema.name}
schema-text
${avro.schema}
Date Format
Time Format
Timestamp Format
CSV Format
custom
Value Separator
,
Skip Header Line
true
Quote Character
"
Escape Character
\
Comment Marker
Null String
Trim Fields
true
ENABLED
org.apache.nifi.csv.CSVReader
8e935d57-e97f-3b4b-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
44.86318778193299
225.749109309736
nifi-standard-nar
org.apache.nifi
1.3.0
WARN
1
JsonPath Expression
JsonPath Expression
Null Value Representation
Null Value Representation
ALL
false
30 sec
JsonPath Expression
$
Null Value Representation
empty string
0
0 sec
TIMER_DRIVEN
1 sec
SplitJson
true
failure
true
original
false
split
org.apache.nifi.processors.standard.SplitJson
98d66981-4991-3bab-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
807.0504760742188
539.5880070835506
nifi-elasticsearch-5-nar
org.apache.nifi
1.3.0
WARN
1
el5-cluster-name
el5-cluster-name
el5-hosts
el5-hosts
el5-ssl-context-service
org.apache.nifi.ssl.SSLContextService
el5-ssl-context-service
el5-xpack-location
el5-xpack-location
el5-username
el5-username
el5-password
el5-password
el5-ping-timeout
el5-ping-timeout
el5-sampler-interval
el5-sampler-interval
el5-put-id-attribute
el5-put-id-attribute
el5-put-index
el5-put-index
el5-put-type
el5-put-type
el5-charset
el5-charset
el5-put-batch-size
el5-put-batch-size
el5-put-index-op
el5-put-index-op
ALL
false
30 sec
el5-cluster-name
agora_prod_cluster1
el5-hosts
10.11.16.250:9300
el5-ssl-context-service
e450597a-0f71-3d9e-0000-000000000000
el5-xpack-location
D:\stuff\data\nificonfig\es5dependencies\dependency-jars
el5-username
patrick.maggiulli
el5-password
el5-ping-timeout
5s
el5-sampler-interval
5s
el5-put-id-attribute
ID
el5-put-index
test_r2_idx
el5-put-type
r2_doc
el5-charset
UTF-8
el5-put-batch-size
100
el5-put-index-op
index
0
0 sec
TIMER_DRIVEN
1 sec
PutElasticsearch5
true
failure
true
retry
true
success
org.apache.nifi.processors.elasticsearch.PutElasticsearch5
9ecac3fe-ae40-311d-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
13.781050666921601
460.30882400541986
nifi-standard-nar
org.apache.nifi
1.3.0
WARN
1
Hash Attribute Name
Hash Attribute Name
Hash Algorithm
Hash Algorithm
ALL
false
30 sec
Hash Attribute Name
hash.value
Hash Algorithm
MD5
0
0 sec
TIMER_DRIVEN
1 sec
HashContent
true
failure
false
success
org.apache.nifi.processors.standard.HashContent
bcfb414f-5c5a-3eda-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
643.9870764953785
309.8239000440899
nifi-standard-nar
org.apache.nifi
1.3.0
WARN
1
record-reader
org.apache.nifi.serialization.RecordReaderFactory
record-reader
record-writer
org.apache.nifi.serialization.RecordSetWriterFactory
record-writer
ALL
false
30 sec
record-reader
7d9548be-8390-3402-0000-000000000000
record-writer
9a0a7eb2-acb6-35b2-0000-000000000000
0
0 sec
TIMER_DRIVEN
1 sec
ConvertRecord
true
failure
false
success
org.apache.nifi.processors.standard.ConvertRecord
c6e3c453-2491-3263-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
0.0
22.49330340923393
nifi-standard-nar
org.apache.nifi
1.3.0
INFO
1
Input Directory
Input Directory
File Filter
File Filter
Path Filter
Path Filter
Batch Size
Batch Size
Keep Source File
Keep Source File
Recurse Subdirectories
Recurse Subdirectories
Polling Interval
Polling Interval
Ignore Hidden Files
Ignore Hidden Files
Minimum File Age
Minimum File Age
Maximum File Age
Maximum File Age
Minimum File Size
Minimum File Size
Maximum File Size
Maximum File Size
ALL
false
30 sec
Input Directory
D:\stuff\data\CCR\raw
File Filter
[^\.].*
Path Filter
Batch Size
10
Keep Source File
false
Recurse Subdirectories
true
Polling Interval
0 sec
Ignore Hidden Files
true
Minimum File Age
0 sec
Maximum File Age
Minimum File Size
0 B
Maximum File Size
0
0 sec
TIMER_DRIVEN
1 sec
GetFile
false
success
org.apache.nifi.processors.standard.GetFile
0edea561-fde6-30e3-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1269.6556234735685
0.0
nifi-update-attribute-nar
org.apache.nifi
1.3.0
WARN
1
Delete Attributes Expression
Delete Attributes Expression
Store State
Store State
Stateful Variables Initial Value
Stateful Variables Initial Value
schema.name
schema.name
ALL
false
30 sec
Delete Attributes Expression
Store State
Do not store state
Stateful Variables Initial Value
schema.name
ccr
0
0 sec
TIMER_DRIVEN
1 sec
UpdateAttribute
false
success
org.apache.nifi.processors.attributes.UpdateAttribute
18a371c8-21c1-3044-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
30.03173828125
713.8302174717337
nifi-update-attribute-nar
org.apache.nifi
1.3.0
WARN
1
Delete Attributes Expression
Delete Attributes Expression
Store State
Store State
Stateful Variables Initial Value
Stateful Variables Initial Value
filename
filename
ID
ID
ALL
false
30 sec
Delete Attributes Expression
Store State
Do not store state
Stateful Variables Initial Value
filename
${filename:replace('.avro', ''):replace('.csv', '')}.${hash.value}.json
ID
${filename:replace('.avro', '')}.${hash.value}
0
0 sec
TIMER_DRIVEN
1 sec
UpdateAttribute
false
success
org.apache.nifi.processors.attributes.UpdateAttribute
1a69acdf-f698-3d4e-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
1281.3548068196583
297.0024621519847
nifi-standard-nar
org.apache.nifi
1.3.0
INFO
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
Attributes to Ignore
Attributes to Ignore
Log prefix
Log prefix
ALL
false
30 sec
Log Level
info
Log Payload
true
Attributes to Log
Attributes to Ignore
Log prefix
0
0 sec
TIMER_DRIVEN
1 sec
LogAttribute
false
success
org.apache.nifi.processors.standard.LogAttribute
1d17e88b-ed96-31f8-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
636.179952719096
13.4419062575206
nifi-kite-nar
org.apache.nifi
1.3.0
WARN
1
Schema Output Destination
Schema Output Destination
Input Content Type
Input Content Type
CSV Header Definition
CSV Header Definition
Get CSV Header Definition From Data
Get CSV Header Definition From Data
CSV Header Line Skip Count
CSV Header Line Skip Count
CSV delimiter
CSV delimiter
CSV Escape String
CSV Escape String
CSV Quote String
CSV Quote String
Pretty Avro Output
Pretty Avro Output
Avro Record Name
Avro Record Name
Number Of Records To Analyze
Number Of Records To Analyze
Charset
Charset
ALL
false
30 sec
Schema Output Destination
flowfile-attribute
Input Content Type
csv
CSV Header Definition
Get CSV Header Definition From Data
true
CSV Header Line Skip Count
0
CSV delimiter
,
CSV Escape String
\
CSV Quote String
'
Pretty Avro Output
true
Avro Record Name
ccr
Number Of Records To Analyze
10
Charset
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
InferAvroSchema
true
failure
true
original
false
success
true
unsupported content
org.apache.nifi.processors.kite.InferAvroSchema
5ae06b54-a7ff-3409-0000-000000000000
5ab40d37-544c-3062-0000-000000000000
806.4598999023438
708.7234364658743
nifi-hadoop-nar
org.apache.nifi
1.3.0
WARN
1
Hadoop Configuration Resources
Hadoop Configuration Resources
Kerberos Principal
Kerberos Principal
Kerberos Keytab
Kerberos Keytab
Kerberos Relogin Period
Kerberos Relogin Period
Additional Classpath Resources
Additional Classpath Resources
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Block Size
Block Size
IO Buffer Size
IO Buffer Size
Replication
Replication
Permissions umask
Permissions umask
Remote Owner
Remote Owner
Remote Group
Remote Group
Compression codec
Compression codec
ALL
false
30 sec
Hadoop Configuration Resources
D:\stuff\data\nificonfig\fwf-ag-pd-cdhn-conf\core-site.xml,D:\stuff\data\nificonfig\fwf-ag-pd-cdhn-conf\hdfs-site.xml
Kerberos Principal
Kerberos Keytab
Kerberos Relogin Period
4 hours
Additional Classpath Resources
Directory
/user/patrick.maggiulli/data/CCR/Proc
Conflict Resolution Strategy
fail
Block Size
IO Buffer Size
Replication
Permissions umask
Remote Owner
Remote Group
Compression codec
NONE
0
0 sec
TIMER_DRIVEN
1 sec
PutHDFS
true
failure
true
success
org.apache.nifi.processors.hadoop.PutHDFS
10/10/2017 11:56:40 EDT