Member since
07-25-2024
3
Posts
2
Kudos Received
0
Solutions
08-14-2024
04:33 AM
1 Kudo
Hello, @CommanderLaus wrote: Hello everyone, do you happen to know if the GitHub integration of NiFi 2.0.0 M4 also works for GitLab? I think I have entered everything correctly, but I get the error message that my repo does not exist. With "normal" GitHub-API it Works fine! Best regards Simplify the Configuration: Start with a basic configuration and gradually add complexity. Enable Debugging: Use NiFi's logging and debugging features to gather more information about the issue. Consult the NiFi Community: Seek help from the NiFi community forums or mailing lists.
... View more
07-25-2024
10:47 PM
1 Kudo
Hello, @NagendraKumar My Indigo Cardwrote: We are facing the HttpClient error when we try to fetch data from the Hive using the SelectHiveQL NiFi Processor. Please find the error details below and help us resolve this with your expertise. Controller Service - HiveConnectionPool Database Connection URL: jdbc:hive2://localhost:10000/default;principal=hive@test@xyz.com Hive Configuration Resources: /etc/hive/conf/hive-site.xml,/etc/hadoop/conf/core-site.xml NiFi Processor - SelectHiveQL Error Message : SelectHiveQL[id=23er-1234-9999-4444-17] org.apache.nifi.processors.hive.SelectHiveQL$$Lambda$2132/2007351143@6ab4a383 failed to process due to java.lang.NoClassDefFoundError: org/apache/http/client/HttpClient - Caused by: java.lang.ClassNotFoundException: org.apache.http.client.HttpClient; rolling back session: {} SelectHiveQL[id=sge33-1234-9999-21-33] Processing halted: yielding [1 sec]: java.lang.NoClassDefFoundError: org/apache/http/client/HttpClient - Caused by: java.lang.ClassNotFoundException: org.apache.http.client.HttpClient Your NiFi isn't talking to Hive properly. It sounds like there's a missing piece in your software that's stopping them from connecting. Let's fix it: Check the connections: Make sure everything is plugged in correctly (figuratively speaking). Look for missing software: You might need to add something to NiFi to make it work. Restart NiFi: Sometimes, a simple restart can fix weird computer problems. If this doesn't work, you might need to ask for more help from NiFi experts. Let me know if you need more help!
... View more
07-25-2024
01:12 AM
Hello, @kelly01 wrote: When I use the GETMONGO processor to read source data from MongoDB with the output format set to Standard JSON, it converts the original date value to the local timestamp. However, when using the Extended JSON format, the original date value appears but in a different format. I need one of the following solutions: 1. Original date value in Standard JSON format: The date should appear as "createdAt": "2012-08-27T22:32:56Z". 2. Date format in Extended JSON: The date should appear as {"createdAt": "2012-08-27T22:32:56Z"}. 3. Transformation: Convert the Extended JSON format from "createdAt": {"$date": "2012-08-27T22:32:56Z"} to {"createdAt": "2012-08-27T22:32:56Z"}. Here are examples of the outputs: **Standard JSON output:** [ { "_id": "629f3a565f65e119263fa79e", "id": "46dd1621-910f-4eb6-91a0-5ae609a77b10", "firstName": "kelly", "createdAt": "2012-08-28T10:32:56Z", "modifiedAt": "2024-07-01T18:17:29Z", "suspended": false, "linkedAccounts": [ { "accountNumber": "100000000", "accountType": "SAV", "linkedAt": "2012-08-28T10:36:58Z" } ], "auth0Id": "46dd1621-910f-4eb6-91a0-5ae609a77b10", "gender": "FEMALE" } ] **Extended JSON output:** [ { "_id": {"$oid": "629f3a565f65e119263fa79e"}, "id": "46dd1621-910f-4eb6-91a0-5ae609a77b10", "firstName": "kelly", "createdAt": {"$date": "2012-08-27T22:32:56Z"}, "modifiedAt": {"$date": "2024-07-01T06:17:29.467Z"}, "suspended": false, "linkedAccounts": [ { "accountNumber": "100000000", "accountType": "SAV", "linkedAt": {"$date": "2012-08-27T22:36:58Z"} } ], "auth0Id": "46dd1621-910f-4eb6-91a0-5ae609a77b10", "gender": "FEMALE" } ] Thanks for the help. Your data is coming out in a weird format. You want the dates to look normal, not like a computer wrote them. Here's the deal: The easy way: Use a tool to fix the weird date format after you get the data. The complicated way: Change how you get the data so the dates come out normal from the start. Let me know if you want to try either of these!
... View more