Member since
10-30-2017
32
Posts
5
Kudos Received
0
Solutions
02-10-2021
11:05 PM
Thanks @MattWho. Got it !!
... View more
02-09-2021
12:48 PM
Hello @tjangid, Thanks for your reply. When i search for "ignore" under NiFi Configurations i was not getting any results. I also i checked in advanced category and i could find only "NiFi Node Advanced Configuration Snippet (Safety Valve) for staging/bootstrap.conf.xml" not any ignored section. Please let me know if am missing anything here. Thanks, Bala
... View more
09-15-2020
09:38 AM
Hi, I was trying to use nifi.provenance.repository.implementation=org.apache.nifi.provenance.WriteAheadProvenanceRepository. To do so i have to comment java.arg.13=-XX:+UseG1GC to get rid of any performance issues as per https://community.cloudera.com/t5/Community-Articles/HDF-CFM-NIFI-Best-practices-for-setting-up-a-high/ta-p/244999 However i find it difficult on how to do it via Cloudera Manager. Please help.
... View more
Labels:
07-29-2020
09:54 PM
Hi, When i try to restart the cluster after installing a workflow, I end up getting ERROR org.apache.nifi.controller.StandardFlowService: Failed to load flow from cluster due to: org.apache.nifi.cluster.ConnectionException: Failed to connect node to cluster due to: org.apache.nifi.encrypt.EncryptionException: org.apache.nifi.encrypt.EncryptionException: Could not decrypt sensitive value (nifi-app.log). Not sure what would be the cause for this error.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
03-03-2020
10:57 AM
Thanks @venkatsambath. It worked.
... View more
03-02-2020
04:39 PM
Hi,
Which property in Cloudera manager should i update to toggle between the cluster and standalone mode for the nifi cluster? Also, the location of the nifi.properties in the CFM.... Its not under /var/lib/nifi/
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera Manager
06-21-2019
11:07 PM
1 Kudo
Hi, I have the following JSON Record in my incoming Flowfile to QueryRecord Processor and wanted specific fields from the content. I want Index, Sentiment and max(SentimentScore) {
"ResultList": [
{
"Index": 0,
"Sentiment": "NEUTRAL",
"SentimentScore": {
"Mixed": 0.014603961259126663,
"Positive": 0.2183697521686554,
"Neutral": 0.7095515727996826,
"Negative": 0.05747472867369652
}
},
{
"Index": 1,
"Sentiment": "NEGATIVE",
"SentimentScore": {
"Mixed": 0.20378299057483673,
"Positive": 0.11562751978635788,
"Neutral": 0.10683445632457733,
"Negative": 0.5737550258636475
}
},
{
"Index": 2,
"Sentiment": "NEGATIVE",
"SentimentScore": {
"Mixed": 0.007578125223517418,
"Positive": 0.004836051259189844,
"Neutral": 0.01562119647860527,
"Negative": 0.9719645380973816
}
},
{
"Index": 3,
"Sentiment": "POSITIVE",
"SentimentScore": {
"Mixed": 0.008649133145809174,
"Positive": 0.8763676881790161,
"Neutral": 0.11021242290735245,
"Negative": 0.004770802799612284
}
},
{
"Index": 4,
"Sentiment": "NEUTRAL",
"SentimentScore": {
"Mixed": 0.0017022271640598774,
"Positive": 0.03283606469631195,
"Neutral": 0.9602330327033997,
"Negative": 0.005228717811405659
}
},
{
"Index": 5,
"Sentiment": "NEGATIVE",
"SentimentScore": {
"Mixed": 0.02237289398908615,
"Positive": 0.2910439670085907,
"Neutral": 0.3056293725967407,
"Negative": 0.38095375895500183
}
},
{
"Index": 6,
"Sentiment": "POSITIVE",
"SentimentScore": {
"Mixed": 0.00902993232011795,
"Positive": 0.976735532283783,
"Neutral": 0.011653305031359196,
"Negative": 0.002581255976110697
}
},
{
"Index": 7,
"Sentiment": "NEGATIVE",
"SentimentScore": {
"Mixed": 0.011669524013996124,
"Positive": 0.0006034726393409073,
"Neutral": 0.17051522433757782,
"Negative": 0.8172117471694946
}
},
{
"Index": 8,
"Sentiment": "NEGATIVE",
"SentimentScore": {
"Mixed": 0.010518478229641914,
"Positive": 0.002629985800012946,
"Neutral": 0.01846659556031227,
"Negative": 0.9683849811553955
}
},
{
"Index": 9,
"Sentiment": "NEUTRAL",
"SentimentScore": {
"Mixed": 0.009224030189216137,
"Positive": 0.04947839304804802,
"Neutral": 0.7379242181777954,
"Negative": 0.20337335765361786
}
}
],
"ErrorList": []
} Am using the Following Schema in the JsonTreeReader, {
"type" : "record",
"name" : "SentimentOutput",
"fields" : [ {
"name" : "ResultList",
"type" : {
"type" : "array",
"items" : {
"type" : "record",
"name" : "ResultList",
"fields" : [ {
"name" : "Index",
"type" : "int",
"doc" : "Type inferred from '0'"
}, {
"name" : "Sentiment",
"type" : "string",
"doc" : "Type inferred from '\"NEUTRAL\"'"
}, {
"name" : "SentimentScore",
"type" : {
"type" : "record",
"name" : "ResultList",
"namespace" : "SentimentScore",
"fields" : [ {
"name" : "Mixed",
"type" : "double",
"doc" : "Type inferred from '0.014603961259126663'"
}, {
"name" : "Positive",
"type" : "double",
"doc" : "Type inferred from '0.2183697521686554'"
}, {
"name" : "Neutral",
"type" : "double",
"doc" : "Type inferred from '0.7095515727996826'"
}, {
"name" : "Negative",
"type" : "double",
"doc" : "Type inferred from '0.05747472867369652'"
} ]
},
"doc" : "Type inferred from '{\"Mixed\":0.014603961259126663,\"Positive\":0.2183697521686554,\"Neutral\":0.7095515727996826,\"Negative\":0.05747472867369652}'"
} ]
}
},
"doc" : "Type inferred from '[{\"Index\":0,\"Sentiment\":\"NEUTRAL\",\"SentimentScore\":{\"Mixed\":0.014603961259126663,\"Positive\":0.2183697521686554,\"Neutral\":0.7095515727996826,\"Negative\":0.05747472867369652}},{\"Index\":1,\"Sentiment\":\"NEGATIVE\",\"SentimentScore\":{\"Mixed\":0.20378299057483673,\"Positive\":0.11562751978635788,\"Neutral\":0.10683445632457733,\"Negative\":0.5737550258636475}},{\"Index\":2,\"Sentiment\":\"NEGATIVE\",\"SentimentScore\":{\"Mixed\":0.007578125223517418,\"Positive\":0.004836051259189844,\"Neutral\":0.01562119647860527,\"Negative\":0.9719645380973816}},{\"Index\":3,\"Sentiment\":\"POSITIVE\",\"SentimentScore\":{\"Mixed\":0.008649133145809174,\"Positive\":0.8763676881790161,\"Neutral\":0.11021242290735245,\"Negative\":0.004770802799612284}},{\"Index\":4,\"Sentiment\":\"NEUTRAL\",\"SentimentScore\":{\"Mixed\":0.0017022271640598774,\"Positive\":0.03283606469631195,\"Neutral\":0.9602330327033997,\"Negative\":0.005228717811405659}},{\"Index\":5,\"Sentiment\":\"NEGATIVE\",\"SentimentScore\":{\"Mixed\":0.02237289398908615,\"Positive\":0.2910439670085907,\"Neutral\":0.3056293725967407,\"Negative\":0.38095375895500183}},{\"Index\":6,\"Sentiment\":\"POSITIVE\",\"SentimentScore\":{\"Mixed\":0.00902993232011795,\"Positive\":0.976735532283783,\"Neutral\":0.011653305031359196,\"Negative\":0.002581255976110697}},{\"Index\":7,\"Sentiment\":\"NEGATIVE\",\"SentimentScore\":{\"Mixed\":0.011669524013996124,\"Positive\":6.034726393409073E-4,\"Neutral\":0.17051522433757782,\"Negative\":0.8172117471694946}},{\"Index\":8,\"Sentiment\":\"NEGATIVE\",\"SentimentScore\":{\"Mixed\":0.010518478229641914,\"Positive\":0.002629985800012946,\"Neutral\":0.01846659556031227,\"Negative\":0.9683849811553955}},{\"Index\":9,\"Sentiment\":\"NEUTRAL\",\"SentimentScore\":{\"Mixed\":0.009224030189216137,\"Positive\":0.04947839304804802,\"Neutral\":0.7379242181777954,\"Negative\":0.20337335765361786}}]'"
}, {
"name" : "ErrorList",
"type" : {
"type" : "array",
"items" : "null"
},
"doc" : "Type inferred from '[]'"
} ]
} And the Query i use is; select (ResultList, '/Index') as "index", (ResultList, '/Sentiment') as "sentiment", (ResultList, max('/SentimentScore')) as "score" from FLOWFILE While Executing i get the following Error, Can someone help me achieving this use case? Tagging : @Shu,@Matt Burgess,@Matt Clarke
... View more
Labels:
- Labels:
-
Apache NiFi
04-29-2019
08:48 PM
@Shu I have the read/write permissions to the config and creds files for NiFi user while setting the AWS CLI on the nifi nodes...
... View more
04-26-2019
08:18 PM
1 Kudo
Hi, Can someone please provide some directions on this issue? Will be really helpful.
... View more
04-23-2019
11:56 PM
Hi, Am trying to run the below aws comprehend CLI command using the ExecuteProcess. aws comprehend detect-sentiment \ --region us-west-2 \ --language-code "en" \ --text "It is raining today in Seattle." However End up getting the following error, Failed to create process due to Cannot run program "aws comprehend detect-sentiment --region us-west-2 --language-code "en" --text "It is raining today in Seattle."": error=13, Permission denied: java.io.IOException: Cannot run program "aws comprehend detect-sentiment --region us-west-2 --language-code "en" --text "It is raining today in Seattle."": error=13, Permission denied Execute Process Configs: When i run the command on the NiFi Nodes, Its was working fine. The issue is when trying to execute the same command using the execute processor. Please help.
... View more
Labels:
- Labels:
-
Apache NiFi