About mszurap

mszurap · ‎02-08-2022

Hi, Do you have any general information about the types of tasks that the driver performs after a job completes? I do not have a comprehensive list of such tasks, this is just what we usually observe through cases and slowness reports. Of course there may be completely different tasks what the driver does - any custom spark code which does not involve parallel execution / data processing might run on the Spark driver side only, for example connecting to an external system through JDBC, or doing some computation (not with RDDs or DataFrames).

grlzz · ‎02-03-2022

Hi @mszurap , thanks for the tool So, somehow the connection is now working , namely the command we tried to cloudera support, like: `sqoop eval --connect ...` or ` sqoop list-databases --connect` before running any sqoop command, we set up a ssh tunnel, with ssh -o ServerAliveInterval=60 -M -S mktemp -fN -L local_port:psql_fqdn:remote_p user@host_IP (which I was doing also before, so not sure why now it works... I will mark it now as solved thanks anyway, Gr

nagacg · ‎01-28-2022

Hi Mszurap, Thank you for your reply. yes I am worked with Cloudera team on this. Thank you .

mszurap · ‎01-27-2022

Hi @DataMo , I'm not an expert on this area, however the "Kerberos authentication" through a browser (SPNEGO) is a bit more complex than sending a username/password pair (HTTP Basic authentication). As I see https://issues.apache.org/jira/browse/NIFI-6250 - "Add Kerberos authentication support to InvokeHTTP Processor" is still open.

Kamil_Valko · ‎01-16-2022

Hello, problem was with OOO memory, after add some, it looks ok. Thank for advice. Best regards Kamil

DianaTorres · ‎01-07-2022

@cardozogp Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks

Donal_RC · ‎01-06-2022

This appears to be the cause. Switching to MS Edge avoided the HSTS feature in Chrome. Will look at enabling HTTPS on all UIs though since that is the correct solution in the longterm (spark.ssl.historyServer.enabled option is currently set to false).

christopher · ‎01-04-2022

@saurabh_ka It looks like you've got a solution, could you please mark the appropriate reply as the solution? It will make it easier for others to find the answer in the future. Thank you!

VidyaSargur · ‎11-30-2021

@npr73, have any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

VidyaSargur · ‎11-30-2021

@HareshAmin, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

Online	Offline
Last Visited	‎04-24-2026 02:08 AM

Member Since	‎11-04-2015 11:53 PM
Last Visited	‎04-24-2026 02:08 AM
Posts	261
Kudos received	44

Cloudera Community

Re: Hive fails to start with "Caused by: java.lang...

Re: The heap memory usage of NameNode is much high...

Re: Hue and Sqoop white spaces in query

Re: straight SELECT and SELECT via CTE produce dif...

Re: Best practices for partition tables in Impala ...

Re: Spark-Streaming stalls at regular intervals

Re: sqoop stuck at No connection paramenters speci...

Re: SAS -Impala connection error : Impala Thrift ...

Re: Kudu Metrics - SPENGO Authentication (kerberiz...

Re: Impala Catalog Server restarted with IllegalSt...

Re: Bind in Sqoop querys on import command

Re: Unable to connect to Spark History Server Web ...

Re: scm_prepare_database.sh, ERROR 4

Re: Impala query with limit 0

Re: Is there any way to cast string to map?