Member since
02-01-2022
224
Posts
72
Kudos Received
48
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
168 | 08-17-2023 06:07 AM | |
227 | 08-14-2023 05:54 AM | |
290 | 08-07-2023 06:51 AM | |
219 | 07-17-2023 08:43 AM | |
384 | 07-17-2023 08:38 AM |
12-09-2022
05:33 AM
@KPG1 Here is a good post i found that describes the required steps to move postgres to mysql including a php to do the postgres to mysql conversion. https://cloudera.ericlin.me/2016/10/hive-metastore-migration-from-embedded-postgres-to-mysql/ You may need to find a more modern tool for that conversion, but the process to dump, convert, and move metastores should be very similar.
... View more
11-18-2022
09:02 AM
@Mosunmola In order to start Hive, you will need yarn and hdfs started first. Do not restart all. The sandbox environment is going to require a very robust computer to run the entire stack, like 32gb+ memory. That said, a 16gbs or less memory may not be enough to run multiple services depending on what else may be running on your machine. So start and stop only what you need to test, not the entire stack.
... View more
10-28-2022
06:15 AM
@Vickey You will need to investigate the differences in execution from nifi vs hue. You should be able to see some differences in tez between both queries. The return code 1 is often due to tez resource availability. Also, i would suggest that you NOT do anything with retry logic in nifi until you are sure the processor works as expected the first time. Bringing in the retry logic only hides the issue if it is intermittent. Sounds like it is consistently not working, so retry is not helpful. Another suggestion is to turn the process logging level to DEBUG. Last but not least, in future, try to screen shot your flow, and processor configs so all of us can see more details
... View more
10-28-2022
06:07 AM
@D5ha To specifically answer. your question:
is there any way to identify the specific content_repository location for each processor?
No, there is no such manner to do this.
... View more
10-28-2022
05:44 AM
1 Kudo
@sathish3389 Define a parameter context and parameter ("parameter_password") for your flow with your password string, define that as sensitive value, then use the parameter in the processor property value : ${http.headers.Authorization:equals(#{parameter_password}) This will hide the password and make it easy to update the password by just updating the parameter.
... View more
10-28-2022
05:31 AM
@Griggsy I would have to have working sample to test and provide better solution, that said i think you need to use function inside of the value, not the property. There you could also use ifElse making the NiFi Expression language operate for both scenarios. Chaining expressions together can be a challenge but should get you where you need to go.
... View more
10-28-2022
05:24 AM
@Ekodar You will need to use a driver to connect php to impala. Quick search and this looks promising: https://docs.cloudera.com/documentation/other/connectors/impala-jdbc/latest/Cloudera-JDBC-Driver-for-Impala-Install-Guide.pdf Here is another example with more details showing actual php code: https://www.cdata.com/kb/tech/impala-odbc-php.rst
... View more
10-28-2022
05:20 AM
If you are able to get the token and communicate with the api from postman, thats a great start. The PUT request must have some other issue. Are you passing the token correctly? Have you made sure that you are able to get the token, and make the put request from nifi node with command line? You always want to make sure you have working samples for any api system before you try to convert them to postman.
... View more
10-28-2022
05:16 AM
Are you sure the code is the same? Sounds like the clustered version is kicking off job and its never finishing (endless loop?) or the task is creating some performance or connectivity issue.. Depending on your processor, it may need to be flagged as Primary Only.
... View more
10-26-2022
05:41 AM
I believe so. Were you able to get a token using that user?
... View more