Member since
02-27-2020
173
Posts
42
Kudos Received
48
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2414 | 11-29-2023 01:16 PM | |
| 2956 | 10-27-2023 04:29 PM | |
| 2417 | 07-07-2023 10:20 AM | |
| 4934 | 03-21-2023 08:35 AM | |
| 1671 | 01-25-2023 08:50 PM |
01-13-2022
07:36 AM
Hi @grlzz , CDSW is typically installed/runs on edge nodes, so CM going down does not necessarily preclude you from accessing CDSW. However, if certs expired across the cluster then all services may be inaccessible. Regarding your question for command line access to CDSW. There is a CLI you can use for that: https://docs.cloudera.com/cdsw/1.9.2/cli-reference/topics/cdsw-cli-reference.html The first thing you'll need to do to use the CLI is to generate some access keys from CDSW UI, so if you can't access CDSW UI, then you may be stuck until that is resolved. Have you opened a support case for this? Kind regards, Alex Akulov
... View more
10-21-2021
11:00 AM
Hi Alexis, for CDP Experiences (aka Data Services) there is integration available. Please see the link below: https://docs.cloudera.com/cdp-private-cloud-experiences/1.1/installation/topics/cdppvc-installation-external-vault.html For CDP Base, I don't believe we support external vault. Hope this helps, Alex
... View more
07-08-2021
03:03 PM
1 Kudo
Strange.... As a test can you replace your hard-coded toppic name with something like ${tableName} or just try a different hardcoded string and see if that gets you further along. Not saying that's a solution, but trying to eliminate causes. Also, you mentioned you've implemented other flows already. Could it be that the topic name BUBB-MX_ALL_SOFT is already taken in your kafka cluster and thats why goldengate handler can't create the topic (though I would expect it to just write to the existing topic, instead of throwing an error). I also found this on Oracle site that may have your answer. You'll need an Oracle account to look if there is a solution though. https://support.oracle.com/knowledge/Middleware/2512462_1.html Could this also be an encoding or trailing character issue in the props file between Unix and AIX? Overall this sounds like a GoldenGate error that may be better answered by Oracle community. Regards, Alex
... View more
07-08-2021
02:24 PM
Hi @roshanbi , You can simply put your sqoop command in a shell file and then have Cron run that script according to your desired schedule (depending on how frequently you expect the data to be updated in the Oracle source table). Alternatively, you can use Oozie to orchestrate the running of the sqoop job. Regards, Alex
... View more
07-07-2021
04:30 PM
@TVR , in the link you shared, Step 11/12 shows how to setup .props file. Note that the property gg.handler.kafkaconnect.topicMappingTemplate is used, instead of TopicName. Check your .props file and see what is set there.
... View more
07-07-2021
04:04 PM
Hi @TVR , Next time please provide more details on what you have tried, what versions of Kafka and Oracle you are using, and what you are trying to achieve. In the meantime, it looks like TopicName is not a supported parameter since some version of Oracle GoldenGate. The alternative parameter is topicMappingTemplate. Please see Oracle documentation here: https://docs.oracle.com/goldengate/bd123110/gg-bd/GADBD/using-kafka-handler.htm#GADBD458 Hope that helps, Alex
... View more
07-06-2021
10:20 PM
Hi @Chakkara , What would you like the parser to do when it encounters an invalid date value? If this is a recurring problem, where multiple lines in your file have the same number of spaces to indicate missing date, then you can use ifElse in your replacement value command (something like this). Hope that helps, Alex
... View more
06-26-2021
07:03 AM
1 Kudo
Hi @roshanbi, There is no equivalent of oracle's EXTRACTVALUE in Kudu or Impala SQL. XML is not one of the supported formats. I think your approach of running the SQL with EXTRACTVALUE as part of the sqoop job is a good one. That way you are writing the fields you need into target Hive table and from there insert into Kudu. This would be the fastest path and would work if you are not planning to get more fields from your source XML table in the future. An alternative approach is to use Hive with a 3rd party SerDe for XML. Then let Hive do the conversion from XML format to something like Avro, and then create your Impala table based on that Avro data. This way is more involved, but gives you flexibility in terms of the schema. Hope that helps, Alex
... View more
06-18-2021
12:38 PM
Oh, I thought you had broken pipe in your Excel file, but this makes more sense. Thanks for clarifying. Do you need to use broken pipe delimiter on the output because the target process only accepts that character as the delimiter? Seems strange that you'd use broken pipe for a csv file. You can have ConvertExcelToCSVProcessor write out a simple comma-separated format. Then use a ReplaceTest processor to replace delimiter commas with your broken pipe hex code (see example here). Will that work for you?
... View more
06-18-2021
11:26 AM
The broken pipe character seems to be a special hex character that is longer than a single byte. The workaround here could be doing a ReplaceText processor on your Excel file first, replacing broken pipe character with something simple like a comma (,) and then doing conversion to CSV.
... View more