Cloudera Community
gizo
user rank
Explorer

How to prevent nifi-app logs from filling my drive...

by Explorer in Support Questions
‎11-06-2022 07:21 PM
‎11-06-2022 07:21 PM
Have been getting the below exception "ReplaceText[id=3fa43c98-5a5a-1c87-8e34-911a06de02aa] Processing failed: org.apache.nifi.processor.exception.ProcessException: IOException thrown from ReplaceText[id=3fa43c98-5a5a-1c87-8e34-911a06de02aa]: java.io.FileNotFoundException: /opt/nifi-1.17.0/content_repository/466/1666653401958-112082 (No space left on device) - Caused by: java.io.FileNotFoundException: /opt/nifi-1.17.0/content_repository/466/1666653401958-112082 (No space left on device)"   It seems like the disk is full which is not allowing the processors to update or modify the data. I notice that the logs directory on all the cluster have taken all the space.  Each node has 64G of storage space and log directory has taken almost 55G of space.    I recently notice my disk is getting full very quickly. I remove the logs and the repository and restart nifi and that seems to work but then again after a few hours it got filled up. I finally notice that the logs directly is taking all the space. How to prevent nifi-app logs from filling my drive. ... View more
Labels:

Re: I am getting error on putDynamodb

by Explorer in Support Questions
‎04-01-2022 07:12 AM
‎04-01-2022 07:12 AM
see below Attribute Values   RecId udhehdhhwgeueuhd73764hdhsh   executesql.query.duration 32   executesql.query.executiontime 24   executesql.query.fetchtime 8   executesql.resultset.index 0   executesql.row.count 100   filename 9c344c33-599e-4dfd-9eda-2006f6df0de5   fragment.count 100   fragment.identifier da135c88-697d-498f-a5e3-6a45f23eb44a   fragment.index 0   mime.type application/json   path ./   segment.original.filename 9c344c33-599e-4dfd-9eda-2006f6df0de5   uuid 34d005dc-09c2-446c-b7aa-963b31e9769a   ... View more

Re: I am getting error on putDynamodb

by Explorer in Support Questions
‎03-31-2022 06:16 AM
‎03-31-2022 06:16 AM
This is what I have.  sample json from the executesql after split json. { "CreatedBy" : "jdhjhehdhjdjs", "CreatedDateTime" : "2021-10-20 12:05:42.0", "LastModBy" : "dhjdjjwjsjds", "LastModDateTime" : "2021-12-01 17:41:31.0", "OwnerTeam" : null, "OwnerType" : null, "RecId" : "udhehdhhwgeueuhd73764hdhsh", "CloudServiceTag" : null, "SQLCores" : null }   ... View more

attribute name must not be null or empty in putdyn...

by Explorer in Support Questions
‎03-30-2022 12:15 PM
‎03-30-2022 12:15 PM
Getting this error when using evaluatejsonpath and putdynamodb.  2022-03-30 19:04:01,809 ERROR [Timer-Driven Process Thread-1] o.a.n.p.aws.dynamodb.PutDynamoDB PutDynamoDB[id=d8f73587-017f-1000-2455-aaff9f514cba] Failed to process session due to java.lang.IllegalArgumentException: Attribute name must not be null or empty; Processor Administratively Yielded for 1 sec: java.lang.IllegalArgumentException: Attribute name must not be null or empty java.lang.IllegalArgumentException: Attribute name must not be null or empty   Any help will be much appreciated. ... View more
Labels:

I am getting error on putDynamodb

by Explorer in Support Questions
‎03-30-2022 07:37 AM
‎03-30-2022 07:37 AM
2022-03-30 06:12:42,697 ERROR [Timer-Driven Process Thread-10] o.a.n.p.aws.dynamodb.PutDynamoDB PutDynamoDB[id=d8f73587-017f-1000-2455-aaff9f514cba] Hash key value '' is required for flow file StandardFlowFileRecord[uuid=eaf5b5ae-86c1-44b1-a253-00d44fdbbbff,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1648526788099-3, container=default, section=3], offset=0, length=45235],offset=44777,name=472d9a5c-9b9e-4a2e-91ae-589fbf7a5bec,size=458] 2022   Any help will be much appreciated. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎11-20-2022 10:31 PM
Community Statistics
Member Since ‎03-30-2022 07:05 AM
Last Visited ‎11-20-2022 10:31 PM
Posts 10