About aakulov

aakulov · ‎06-18-2021

@Stefi , could you please provide an example of what one input record looks like and what you want the output CSV record to look like, and also what output you are getting right now? That will help us understand what the problem you are facing is.

aakulov · ‎06-18-2021

Hi @Stefi , It could be as simple as setting the Include Trailing Delimiter parameter to False in your NiFi processor. Then NiFi should not include any delimiter at the end of each CSV record. See this documentation page for ConvertExcelToCSVProcessor. Hope this helps you out. Regards, Alex

aakulov · ‎06-17-2021

Hi @drgenious , I believe this is possible by providing impala-shell with the following parameter: impala-shell -f /path/ --query_option='mem_limit=3gb' Let me know if that works. Regards, Alex

aakulov · ‎06-16-2021

Hi @sakitha , What version of CDH/HDP/CDP are you using? If you are using Cloudera Manager (CM), please check the MirrorMaker parameter values for presence of any "}" characters. The error, as shown, indicates there is something wrong with Whitelist parameter or the like. Regards, Alex Akulov

aakulov · ‎06-15-2021

Hi Roshan, This is a good starting guide on Impala admission control management. Please review it first and see if you still have questions after. https://docs.cloudera.com/cdp-private-cloud-base/7.1.6/impala-manage/topics/impala-admission.html Kind regards, Alex

aakulov · ‎06-15-2021

Ok, so now it's a "connection refused error". Can you try without --ssl option, since you said Impala is not enabled with TLS/SSL. Are you able to ping the IP of your impalad server from the host where you are running impala-shell?

aakulov · ‎06-14-2021

Hi @sass, To use sqoop, you will need to combine the two columns, your CREATED_ON column and UPDATED_ON column. Unfortunately, sqoop is only able to look at one timestamp column as the control for incremental load. As for the error you are getting, that is expected due to SQOOP-2986. The alternative strategy is to do a regular sqoop import (without hive-import) and provide --target-dir to scoop that coincides with the Hive table location. Hope this helps, Alex

aakulov · ‎06-14-2021

Hello Roshan, THe official documentation for using impala-shell to connect to impala is available here for your version of CDP: https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/impala-manage/topics/impala-shell-connecting.html Note that the default port to connect to impalad is 21000 (not 27000). Please check which port you are using in your deployment (can be done by running netstat -tulpn | grep impalad on the host that's running impalad). Another thing to check if SSL is enabled on in Impala on your cluster, you'll need to use --ssl option when connecting via impala-shell. Regards, Alex

aakulov · ‎06-11-2021

Would be helpful to know which version of CDH or CDP you are using.

aakulov · ‎06-11-2021

Update, as promised, NiFi on IBM Power System is not currently supported. The legacy HDF product does support it, so there is possibility to use NiFi. Worth a chat with your account team. If this answers all of your questions. Please accept answer as a solution. Regards, Alex

Online	Offline
Last Visited	‎09-05-2024 02:11 AM

Member Since	‎02-27-2020 04:13 PM
Last Visited	‎09-05-2024 02:11 AM
Posts	173
Kudos received	42

Cloudera Community

Re: Changing Colours or adding a banner to WebUIs

Re: CDP Public Cloud - Resizing of Worker/Compute ...

Re: How to collect queries submitted by other user...

Re: CDH配置好以后，agent服务能够启动，但是server服务无法启动 (After CDH...

Re: How to increase timeout definition?

Re: Nifi ConvertExcelToCSVProcessor - broken pipe...

Re: Nifi ConvertExcelToCSVProcessor - broken pipe...

Re: MEM_LIMIT in impala shell command

Re: MirrorMaker wont start due to java.lang.Runtim...

Re: Impala tuning

Re: impala shell connection

Re: Incremental sqoop import into hive with tables...

Re: impala shell connection

Re: impala shell connection

Re: Cloudera applications Compatibility on the IBM...