4c7a2544-0159-1000-646c-0b1995ae1635
sysdig
0157105e-91d2-1dc1-0000-000000000000
4c7a2544-0159-1000-0000-000000000000
0.0
0.0
01571064-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
01571063-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
success
0
01571066-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
01571069-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
success
0
01571075-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
01571074-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
failure
sql
0
015710a0-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
01571071-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
success
0
015710ca-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
01571062-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
matched
0
015710cf-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
015710ce-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
failure
0
015710e4-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
015710db-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
matched
0
015710ea-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
015710e6-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
merged
0
015710eb-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
1 GB
10000
0157105e-91d2-1dc1-0000-000000000000
015710e8-91d2-1dc1-0000-000000000000
PROCESSOR
0 sec
1
success
0
01571072-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
Database Connection URL
Database Connection URL
Database Driver Class Name
Database Driver Class Name
database-driver-locations
database-driver-locations
Database User
Database User
Password
Password
Max Wait Time
Max Wait Time
Max Total Connections
Max Total Connections
Validation-query
Validation-query
DBCPConnectionPool - PHOENIX HBASE
Database Connection URL
jdbc:phoenix:tspanndev12.field.hortonworks.com:2181:/hbase-unsecure
Database Driver Class Name
org.apache.phoenix.jdbc.PhoenixDriver
database-driver-locations
file:///opt/demo/phoenix-client.jar
Database User
Password
Max Wait Time
500 millis
Max Total Connections
2
Validation-query
DISABLED
org.apache.nifi.dbcp.DBCPConnectionPool
01571060-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1053.2408071769642
70.17513918298584
WARN
1
Command
Command
Command Arguments
Command Arguments
Batch Duration
Batch Duration
Redirect Error Stream
Redirect Error Stream
Argument Delimiter
Argument Delimiter
ALL
false
30 sec
Command
/opt/demo/dig.sh
Command Arguments
Batch Duration
Redirect Error Stream
true
Argument Delimiter
0
0,15,30,45 * * * * ?
CRON_DRIVEN
10 sec
ExecuteProcess
false
success
org.apache.nifi.processors.standard.ExecuteProcess
01571062-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-430.41010459571453
377.87364415867137
WARN
1
Regular Expression
Regular Expression
Replacement Value
Replacement Value
Character Set
Character Set
Maximum Buffer Size
Maximum Buffer Size
Replacement Strategy
Replacement Strategy
Evaluation Mode
Evaluation Mode
ALL
false
30 sec
Regular Expression
(?s:^.*$)
Replacement Value
upsert into sysdigevents (evtcpu,evtdir,evtinfo,evtoutputtime,evttype,procname,threadtid,evtnum)
values ('${'evtcpu'}','${'evtdir'}','${evtinfo:replaceAll('\'', 'quot;')}','${'evtoutputtime'}','${'evttype'}','${'procname'}','${'threadtid'}','${'evtnum'}')
Character Set
UTF-8
Maximum Buffer Size
2 MB
Replacement Strategy
Regex Replace
Evaluation Mode
Entire text
0
0 sec
TIMER_DRIVEN
1 sec
ReplaceText
true
failure
false
success
org.apache.nifi.processors.standard.ReplaceText
01571063-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1034.6390543400225
495.27703460670045
WARN
1
JDBC Connection Pool
org.apache.nifi.dbcp.DBCPService
JDBC Connection Pool
Support Fragmented Transactions
Support Fragmented Transactions
Transaction Timeout
Transaction Timeout
Batch Size
Batch Size
Obtain Generated Keys
Obtain Generated Keys
ALL
false
30 sec
JDBC Connection Pool
01571072-91d2-1dc1-0000-000000000000
Support Fragmented Transactions
true
Transaction Timeout
Batch Size
1000
Obtain Generated Keys
false
0
0 sec
TIMER_DRIVEN
1 sec
Save to Apache Phoenix HBASE
false
failure
true
retry
true
success
org.apache.nifi.processors.standard.PutSQL
01571069-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1062.774698101574
297.6092703793745
ERROR
4
Destination
Destination
Return Type
Return Type
Path Not Found Behavior
Path Not Found Behavior
Null Value Representation
Null Value Representation
evtcpu
evtcpu
evtdir
evtdir
evtinfo
evtinfo
evtnum
evtnum
evtoutputtime
evtoutputtime
evttype
evttype
procname
procname
threadtid
threadtid
ALL
false
30 sec
Destination
flowfile-attribute
Return Type
auto-detect
Path Not Found Behavior
ignore
Null Value Representation
empty string
evtcpu
$['evt.cpu']
evtdir
$['evt.dir']
evtinfo
$['evt.info']
evtnum
$['evt.num']
evtoutputtime
$['evt.outputtime']
evttype
$['evt.type']
procname
$['proc.name']
threadtid
$['thread.tid']
25
0 sec
TIMER_DRIVEN
1 sec
Pull Key Attributes
true
failure
false
matched
true
unmatched
org.apache.nifi.processors.standard.EvaluateJsonPath
01571071-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1995.2242433523684
977.3003751182271
WARN
1
JDBC Connection Pool
org.apache.nifi.dbcp.DBCPService
JDBC Connection Pool
Statement Type
Statement Type
Table Name
Table Name
Catalog Name
Catalog Name
Schema Name
Schema Name
Translate Field Names
Translate Field Names
Unmatched Field Behavior
Unmatched Field Behavior
Unmatched Column Behavior
Unmatched Column Behavior
Update Keys
Update Keys
jts-quoted-identifiers
jts-quoted-identifiers
ALL
false
30 sec
JDBC Connection Pool
01571072-91d2-1dc1-0000-000000000000
Statement Type
INSERT
Table Name
sysdigevents
Catalog Name
Schema Name
Translate Field Names
true
Unmatched Field Behavior
Ignore Unmatched Fields
Unmatched Column Behavior
Ignore Unmatched Columns
Update Keys
jts-quoted-identifiers
false
0
0 sec
TIMER_DRIVEN
1 sec
ConvertJSONToSQL
false
failure
true
original
false
sql
org.apache.nifi.processors.standard.ConvertJSONToSQL
01571074-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1979.50791885512
1328.4726393788928
WARN
1
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Create Missing Directories
Create Missing Directories
Maximum File Count
Maximum File Count
Last Modified Time
Last Modified Time
Permissions
Permissions
Owner
Owner
Group
Group
ALL
false
30 sec
Directory
/opt/demo/sysdigfail
Conflict Resolution Strategy
ignore
Create Missing Directories
true
Maximum File Count
Last Modified Time
Permissions
Owner
Group
0
0 sec
TIMER_DRIVEN
1 sec
PutFile
true
failure
true
success
org.apache.nifi.processors.standard.PutFile
0157109e-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-2015.5228153217233
687.2684244908901
WARN
1
Attributes List
Attributes List
Destination
Destination
Include Core Attributes
Include Core Attributes
Null Value
Null Value
ALL
false
30 sec
Attributes List
evtcpu,evtdir,evtinfo,evtnum,evtoutputtime,evttype,procname,threadtid
Destination
flowfile-content
Include Core Attributes
false
Null Value
false
0
0 sec
TIMER_DRIVEN
1 sec
AttributesToJSON
true
failure
false
success
org.apache.nifi.processors.standard.AttributesToJSON
015710ce-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-403.2649829097336
577.4741328501004
WARN
1
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Create Missing Directories
Create Missing Directories
Maximum File Count
Maximum File Count
Last Modified Time
Last Modified Time
Permissions
Permissions
Owner
Owner
Group
Group
ALL
false
30 sec
Directory
/opt/demo/fail
Conflict Resolution Strategy
fail
Create Missing Directories
true
Maximum File Count
Last Modified Time
Permissions
Owner
Group
0
0 sec
TIMER_DRIVEN
1 sec
Failure Logs PutFile
true
failure
true
success
org.apache.nifi.processors.standard.PutFile
015710db-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1582.6836891174316
481.72741508483887
WARN
1
Hadoop Configuration Resources
Hadoop Configuration Resources
Kerberos Principal
Kerberos Principal
Kerberos Keytab
Kerberos Keytab
Kerberos Relogin Period
Kerberos Relogin Period
Additional Classpath Resources
Additional Classpath Resources
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Block Size
Block Size
IO Buffer Size
IO Buffer Size
Replication
Replication
Permissions umask
Permissions umask
Remote Owner
Remote Owner
Remote Group
Remote Group
Compression codec
Compression codec
ALL
false
30 sec
Hadoop Configuration Resources
/etc/hadoop/conf/core-site.xml
Kerberos Principal
Kerberos Keytab
Kerberos Relogin Period
4 hours
Additional Classpath Resources
Directory
/sysdig
Conflict Resolution Strategy
replace
Block Size
IO Buffer Size
Replication
Permissions umask
Remote Owner
Remote Group
Compression codec
NONE
0
0 sec
TIMER_DRIVEN
1 sec
Save Downloaded SysDigs to HDFS
true
failure
true
success
org.apache.nifi.processors.hadoop.PutHDFS
015710e6-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1240.2766456604004
1097.1726665496826
WARN
1
Hadoop Configuration Resources
Hadoop Configuration Resources
Kerberos Principal
Kerberos Principal
Kerberos Keytab
Kerberos Keytab
Kerberos Relogin Period
Kerberos Relogin Period
Additional Classpath Resources
Additional Classpath Resources
Directory
Directory
Conflict Resolution Strategy
Conflict Resolution Strategy
Block Size
Block Size
IO Buffer Size
IO Buffer Size
Replication
Replication
Permissions umask
Permissions umask
Remote Owner
Remote Owner
Remote Group
Remote Group
Compression codec
Compression codec
ALL
false
30 sec
Hadoop Configuration Resources
/etc/hadoop/conf/core-site.xml
Kerberos Principal
Kerberos Keytab
Kerberos Relogin Period
4 hours
Additional Classpath Resources
Directory
/demo/javalogs
Conflict Resolution Strategy
replace
Block Size
IO Buffer Size
Replication
Permissions umask
Remote Owner
Remote Group
Compression codec
NONE
0
0 sec
TIMER_DRIVEN
1 sec
Save Java Logs to HDFS
true
failure
true
success
org.apache.nifi.processors.hadoop.PutHDFS
015710e8-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1242.5040143754418
895.7624294227339
WARN
1
Merge Strategy
Merge Strategy
Merge Format
Merge Format
Attribute Strategy
Attribute Strategy
Correlation Attribute Name
Correlation Attribute Name
Minimum Number of Entries
Minimum Number of Entries
Maximum Number of Entries
Maximum Number of Entries
Minimum Group Size
Minimum Group Size
Maximum Group Size
Maximum Group Size
Max Bin Age
Max Bin Age
Maximum number of Bins
Maximum number of Bins
Delimiter Strategy
Delimiter Strategy
Header File
Header File
Footer File
Footer File
Demarcator File
Demarcator File
Compression Level
Compression Level
Keep Path
Keep Path
ALL
false
30 sec
Merge Strategy
Bin-Packing Algorithm
Merge Format
Binary Concatenation
Attribute Strategy
Keep Only Common Attributes
Correlation Attribute Name
Minimum Number of Entries
10
Maximum Number of Entries
1000
Minimum Group Size
0 B
Maximum Group Size
Max Bin Age
10 sec
Maximum number of Bins
100
Delimiter Strategy
Filename
Header File
/opt/demo/header.txt
Footer File
/opt/demo/footer.txt
Demarcator File
/opt/demo/delimiter.txt
Compression Level
1
Keep Path
false
0
0 sec
TIMER_DRIVEN
1 sec
MergeContent
true
failure
false
merged
true
original
org.apache.nifi.processors.standard.MergeContent
015710e9-91d2-1dc1-0000-000000000000
0157105e-91d2-1dc1-0000-000000000000
-1242.5041124433951
677.3317241229055
WARN
1
Local Network Interface
Local Network Interface
Port
Port
Receive Buffer Size
Receive Buffer Size
Max Size of Message Queue
Max Size of Message Queue
Max Size of Socket Buffer
Max Size of Socket Buffer
Character Set
Character Set
Max Batch Size
Max Batch Size
Message Delimiter
Message Delimiter
Sending Host
Sending Host
Sending Host Port
Sending Host Port
ALL
false
30 sec
Local Network Interface
Port
8881
Receive Buffer Size
65507 B
Max Size of Message Queue
10000
Max Size of Socket Buffer
1 MB
Character Set
UTF-8
Max Batch Size
1
Message Delimiter
\n
Sending Host
Sending Host Port
0
0 sec
TIMER_DRIVEN
1 sec
ListenUDP
false
success
org.apache.nifi.processors.standard.ListenUDP
Sysdig
02/02/2017 18:45:21 UTC