About mszurap

VidyaSargur · ‎03-29-2022

@Sayed016, Thanks for providing the details on the issue and credits to @mszurap! I have accepted your response as a solution, which should surely help others in the future.

mszurap · ‎03-25-2022

Hi Rama, yes, you can configure that in the "Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini". OPSAPS-41615 is still open, in the future you can ask the status from any of your account team contacts. If you don't know who are those contacts, please ask/clarify that through the already open support case. Best regards, Miklos

VidyaSargur · ‎03-24-2022

@mhsyed Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

mszurap · ‎03-10-2022

Hi @M129 , the error message is not too descriptive. Can you please check the HiveMetaStore logs what is the complete error message - and reason for the failure? Thanks Miklos

mszurap · ‎02-24-2022

One more item to add to have a complete picture. SparkSQL does not support directly the usage of Hive ACID tables. For that in CDP you can use the Hive Warehouse Connector (HWC), please see: https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/integrating-hive-and-bi/topics/hive_hivewarehouseconnector_for_handling_apache_spark_data.html

Jmeks · ‎02-24-2022

Many Thanks. I finally managed to delete the partitions using your code

mszurap · ‎02-08-2022

Hi, Do you have any general information about the types of tasks that the driver performs after a job completes? I do not have a comprehensive list of such tasks, this is just what we usually observe through cases and slowness reports. Of course there may be completely different tasks what the driver does - any custom spark code which does not involve parallel execution / data processing might run on the Spark driver side only, for example connecting to an external system through JDBC, or doing some computation (not with RDDs or DataFrames).

grlzz · ‎02-03-2022

Hi @mszurap , thanks for the tool So, somehow the connection is now working , namely the command we tried to cloudera support, like: `sqoop eval --connect ...` or ` sqoop list-databases --connect` before running any sqoop command, we set up a ssh tunnel, with ssh -o ServerAliveInterval=60 -M -S mktemp -fN -L local_port:psql_fqdn:remote_p user@host_IP (which I was doing also before, so not sure why now it works... I will mark it now as solved thanks anyway, Gr

nagacg · ‎01-28-2022

Hi Mszurap, Thank you for your reply. yes I am worked with Cloudera team on this. Thank you .

mszurap · ‎01-27-2022

Hi @DataMo , I'm not an expert on this area, however the "Kerberos authentication" through a browser (SPNEGO) is a bit more complex than sending a username/password pair (HTTP Basic authentication). As I see https://issues.apache.org/jira/browse/NIFI-6250 - "Add Kerberos authentication support to InvokeHTTP Processor" is still open.

Online	Offline
Last Visited	‎12-04-2024 08:06 AM

Member Since	‎11-04-2015 11:53 PM
Last Visited	‎12-04-2024 08:06 AM
Posts	260
Kudos received	44

Cloudera Community

Re: Hive fails to start with "Caused by: java.lang...

Re: The heap memory usage of NameNode is much high...

Re: Hue and Sqoop white spaces in query

Re: straight SELECT and SELECT via CTE produce dif...

Re: Best practices for partition tables in Impala ...

Re: Spark job through Oozie is failing with - sche...

Re: Preserve Source client IP address when use Loa...

Re: 404 when Adding MKL wrapper parcel

Re: Error while Creating an external table in hive...

Re: Spark unsupported fearutes in CDP

Re: Delete partition Hive error

Re: Spark-Streaming stalls at regular intervals

Re: sqoop stuck at No connection paramenters speci...

Re: SAS -Impala connection error : Impala Thrift ...

Re: Kudu Metrics - SPENGO Authentication (kerberiz...