Member since
11-17-2021
1108
Posts
251
Kudos Received
28
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 172 | 10-16-2025 02:45 PM | |
| 345 | 10-06-2025 01:01 PM | |
| 343 | 09-24-2025 01:51 PM | |
| 307 | 08-04-2025 04:17 PM | |
| 415 | 06-03-2025 11:02 AM |
05-11-2023
12:43 AM
Hi @cotopaul Thanks for your reply. I am familiar with Jolt (a json to json transformation library). I have been thinking to add the required padding using the funmctions in Jolt and then use the FreeFormTextRecordSetWriter controller service. This service take the name of the key in Json and prepare the file containing only the value. It also keeps the padding added in the previous Jolt Transform. I think using 10 UpdateAttribute will be tough and I have multiple fields that need the required padding/empty spaces. Thank you for your answers!
... View more
05-07-2023
05:05 PM
1 Kudo
@ThienTrinh, As workaround you can follow this scenario: https://stackoverflow.com/questions/55118389/i-have-two-json-payload-i-want-to-merge-them-in-a-single-json-object/55124212#55124212
... View more
05-04-2023
10:55 AM
Hi @SAMSAL , thanks for your response. You are right, changing to "Entire Text" worked I was in a hurry and didnt try changing the evaluation mode. I supposed that "Always Replace" would do the work. Thank you
... View more
05-04-2023
12:33 AM
1 Kudo
@danielhg1285, While the solution provided by @SAMSAL seems to be better for you and more production ready, you could also try the below things. This might work if you are using a stable statement all the time and if are not restricted to see the exact INSERT Statement but rather see the values trying to be inserted. - Shortly after RetryFlowFile, you can add an AttributesToJSON processor and manually define all the columns which you want to insert in the Attributes List Property. Make sure that you use the attribute name from your FlowFile (sql.args.N.value) in your correct order and you set Destination = flowfile-content. In this way, you will generate a JSON File with all the columns and all the values which you have tried to insert but failed. - After AttributesToJSON, you can keep your PutFile to save your file locally on your machine, hence opening it whenever and wherever you want 🙂 PS: This is maybe not the best solution, due to the following reasons, but it will get you started on your track: - You will need to know how many columns you have to insert and each time a new column will be added you will have to modify your AttributesToJSON processor. - You will not get the exact SQL INSERT/UPDATE Statement, but a JSON File containing the column-value pair, which can easily be analyzed by anybody.
... View more
05-03-2023
01:14 PM
Hello! SQOOP takes advantage of YARN to create a distributed IMPORT/EXPORT job To do so, it needs to compile your query for the mappers to actually execute the job Check out the following links for further information: https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html - Section 8.2 Table 18 https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/orm/CompilationManager.java#L50 Hope this helps, Sincerely, José M Martínez Poblete Cloudera Support Hive SME US/East/Shift5 my.cloudera.com/faq/support.html USA: 1-866-809-4659 INTL: 1-650-425-9421
... View more
05-03-2023
10:39 AM
@Abhay_Kumar Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our Spark experts @Gopinath and @smdas who may be able to assist you further. Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
... View more
05-02-2023
10:29 AM
@acasta Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks
... View more
05-02-2023
10:20 AM
@Vas_R Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks
... View more
05-02-2023
10:06 AM
@Amit_barnwal Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks
... View more
04-24-2023
09:37 AM
@wolfsilver00 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more