Member since
02-01-2022
223
Posts
71
Kudos Received
48
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
155 | 08-17-2023 06:07 AM | |
201 | 08-14-2023 05:54 AM | |
265 | 08-07-2023 06:51 AM | |
206 | 07-17-2023 08:43 AM | |
340 | 07-17-2023 08:38 AM |
03-16-2022
06:30 AM
@bdworld2 Being that HDP is EOL (End of Life) and M1 chip is new and breaking anything with linux amd/64 I would recommend a different learning path. Check out CDP and build new clusters to learn the asf components you are familiar with from HDP.
... View more
03-11-2022
05:24 AM
1 Kudo
@kumsath Yes, when i saw your post I started digging around too. The issue here is number manipulation and type casting a "number" versus a "string". That easy gets complicated in attributes and with nifi expression language functions. The solution i referenced would take the "number" and make a number in which the visual representation should then be correct. Its worth a try since that execute script should be very easy to test. The alternative is to do your "math" upstream or in an execute script processor not in updateattribute.
... View more
03-10-2022
10:52 AM
@RamaS Check out this documentation: https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/replication-manager/topics/rm-dc-backup-and-disaster-recovery.html Cloudera Manager provides an integrated, easy-to-use management solution to enable data protection on the Hadoop platform. Replication Manager enables you to replicate data across data centers for disaster recovery scenarios. Replications can include data stored in HDFS, data stored in Hive tables, Hive metastore data, and Impala metadata (catalog server metadata) associated with Impala tables registered in the Hive metastore. When critical data is stored on HDFS, Cloudera Manager helps to ensure that the data is available at all times, even in case of complete shutdown of a data center.
... View more
03-10-2022
10:47 AM
@kumsath This may not be the best way, but check out this solution here: https://community.cloudera.com/t5/Support-Questions/How-correct-convert-from-Decimal-with-E-to-float-in-Apache/m-p/236511
... View more
03-09-2022
06:12 AM
@snm1523 This may not be the direction you want to take, but I cannot help but wonder what the environment spec is. Starting/reStarting services should work nicely. Instead of trying to create logic around start/finish race conditions, maybe focus on why any certain services are not restarting quickly. This may identify that one or more nodes are doing too much, creating the race condition.
... View more
02-11-2022
08:24 AM
Right, you need another processor to extract the values to an attribute for it to work like this ${attribute}
... View more
02-11-2022
07:54 AM
Excellent progress. Can you try doing a single select to get both values? Like this: SELECT MAX(ID),MIN(ID) FROM FLOWFILE If you could do that, then you could extract those values into 2 separate attributes, then feed that flowfile to the next processor in the flow. Another alternative is to extractText for each value to an attribute, then MERGE 2 flowfiles into 1.
... View more
02-11-2022
06:09 AM
Ok great, then the issue is the QueryRecord. In your flow I can see that min and max are both routes to PutSQ, not attributes of a single flowfile. Have you inspected these flowfiles to see if they contain the correct values you need? Does it send 2 flowfiles to PutSQL? ${min} and ${max} is an attribute syntax. I believe you will need to get the min and max into a single flowfile and extracted as attributes to send to PutSQL
... View more
02-11-2022
06:01 AM
I would recommend do a test of the procedure without parameters by inserting test values directly to ensure it works. This will do 2 things, first; confirm the procedure works, and second; indicate the issue with min/max is in the QueryRecord. While testing flow, you should be able to see what the values of min/max are by inspecting the flowfile/attributes.
... View more
02-10-2022
06:17 AM
1 Kudo
@LejlaKM Please check out this solution: https://community.cloudera.com/t5/Support-Questions/Does-ExecuteSQL-processor-allow-to-execute-stored-procedure/m-p/285372/highlight/true#M211779 Found on this original thread: https://community.cloudera.com/t5/Support-Questions/Does-ExecuteSQL-processor-allow-to-execute-stored-procedure/td-p/158922/page/2
... View more
- « Previous
- Next »