About Mike in Austin

Mike in Austin · ‎01-14-2021

Your path should not include the "/hdfs://myserver" section. Also, I think you want to use the --warehouse_dir option. –warehouse-dir is used to specify a base directory within hdfs where SQOOP will create a sub folder inside with the name of the source table, and import the data files into that folder.

Mike in Austin · ‎01-08-2021

Cloudera Streaming Analytics 1.2.0 ships w/ Apache Flink 1.10 https://docs.cloudera.com/csa/1.2.0/support-matrix/topics/csa-system-req.html

Mike in Austin · ‎01-08-2021

CM uses BitTorrent to distrubte parcels so it's already very efficient. My recommendation would be to let CM do the work and not bother with trying to save yourself a few minutes.

Mike in Austin · ‎01-08-2021

KT should be installed in it's own cluster. From a security standpoint, you don't want other services on the box.

Mike in Austin · ‎01-08-2021

Here's a useful article... https://community.cloudera.com/t5/Support-Questions/How-do-I-resolve-clock-offset-issue/td-p/14602/page/2

Mike in Austin · ‎12-11-2020

If I understand your response, you have an NFS Server that’s timing out and clock offsets are out of sync. For the former, the NFS admin needs to address this. It’s not typical to run NFS on a Namenode BTW. For time sync, you need to be running NTP or chrony

Mike in Austin · ‎12-09-2020

Is this happening on a node install or have this node previously worked? If the former... 1. Verify SELinux is disabled 2. Run "df" from the CLI to ensure it responds in a timely manner 3. Verify you can ssh to the machine with the credentials you used for install 4. Verify you can reach the agent port (7182) from the CM. 5. Restart the agent If the later... 1. Have there been any filesystem changes? Check "df" to make sure it responds properly. 2. Verify forward and reverse DNS is working. You can use the CM Network Inspector for this. 3. Restart the agent

Mike in Austin · ‎12-09-2020

This is the executive summary from the the CVE link.... A security feature bypass vulnerability exists in the way Key Distribution Center (KDC) determines if a service ticket can be used for delegation via Kerberos Constrained Delegation (KCD). To exploit the vulnerability, a compromised service that is configured to use KCD could tamper with a service ticket that is not valid for delegation to force the KDC to accept it. The update addresses this vulnerability by changing how the KDC validates service tickets used with KCD.

Mike in Austin · ‎12-09-2020

>From CML, you could access Greenplum via JDBC.

Mike in Austin · ‎12-07-2020

You need to distribute the Cloudera clients. HDP and Apache clients are not supported.

Mike in Austin · ‎12-04-2020

We have found out that MSFT has also released a fix for the Kerberos authentication issue. To fix the Windows AD, you can engage with the AD team to apply one of the following patches that MSFT has provided to fix the Kerberos authentication issue. Please link on the appropriate link based on the flavor of the Windows Server. Windows Server 2012: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594438 Windows Server 2012 R2: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594439Windows Server 2016: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594441 Windows Server 2019: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594442 Windows Server 1903: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594443 Windows Server 1909: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594443 Windows Server 2004: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594440 Windows Server 20H2: https://www.catalog.update.microsoft.com/Search.aspx?q=KB4594440 Once the patch is applied, the application will be able to renew the tickets without theneed to apply any patch for Hue. [1] https://msrc.microsoft.com/update-guide/vulnerability/CVE-2020-17049

Mike in Austin · ‎12-02-2020

Community support is the only free support option. You could reach out to Cloudera to get the cluster under support or roll back the change on the AD side. BTW, CDH 5 is reaching end of support (EOS) on Dec 31 so you'd need to upgrade to CDH 6 or CDP. Both of these will require a license for the most recent versions.

Mike in Austin · ‎12-02-2020

Cloudera.

Mike in Austin · ‎12-02-2020

CDW cannot use GreenPlum as a DW DB. You could ingest data from GreenPlum into the cluster and use Hive/Impala from CDW.

Mike in Austin · ‎12-02-2020

This is likely caused by a change in your AD servers. The CVE is CVE-2020-17049 You'll need to file a case with Support and get a patch.

Mike in Austin · ‎12-02-2020

I think you want to put the result set getWarnings() inside the while loop. while (rs. next ()){ System . out . println (rs. getInt ( "id" )); if (rs.getWarnings() != null ) { System . out . println (rs. getWarnings ()); System . out . println (rs. clearWarnings ()); } } According to the JDBC ResultSet docs, ResultSet warnings are set for each row when you call a method on the ResultSet which you haven't done yet in your current code. Also, warnings on multiple rows are appended which is why I added the clearWarning().

Mike in Austin · ‎12-02-2020

As a best practice, you should enable HDFS HA to avoid a single point of failure.

Mike in Austin · ‎12-01-2020

That's way too general a question to provide a useful response. Give us some background like: 1.Overview of the cluster config including CDH/HDP version, if HA is enabled 2. Any recent changes 3. Errors/Exceptions in the NN log files

Mike in Austin · ‎11-12-2020

IIRC, The ImpalaD process runs as the "impala". If you have sentry grants that enable access to roles the user is in any HDFL ACLs to the contrary will be ignored. The proper way to do this is to use Sentry to grant access to the roles which map to groups and users, you want to have access and then enable HDFS ACLs to sync the HDFS access.

Mike in Austin · ‎11-10-2020

Theres already a community answer on this... https://community.cloudera.com/t5/Support-Questions/Can-t-select-from-Impala-as-a-linked-server-on-SQL-Server/td-p/47218

Mike in Austin · ‎10-27-2020

Try this... https://docs.cloudera.com/documentation/enterprise/latest/topics/cn_admcfg_audit_publish.html#concept_bpk_rfc_dt__section_gnx_sf3_m4

Mike in Austin · ‎10-23-2020

I would think you'd set the log4j_safety_valve for Atlas for this. You should be able to configure this in CM.

Mike in Austin · ‎10-22-2020

Here's a relevant community answer... https://community.cloudera.com/t5/Support-Questions/How-to-use-merge-in-sqoop-import/td-p/161847 Mike

Mike in Austin · ‎10-20-2020

This looks like your sqoop job isn't authenticated w/ Kerberos. Here's a doc that may help... https://sqoop.apache.org/docs/1.99.7/security/AuthenticationAndAuthorization.html

Mike in Austin · ‎10-20-2020

There is no Kafka parcel in 6.x. Kafka was bundled with the core package. See the note at the top of this page... https://docs.cloudera.com/documentation/kafka/latest/topics/kafka_installing.html Mike

Mike in Austin · ‎10-20-2020

Cloudera has Streams Messaging Manager (SMM) that enables Kafka monitoring and management.

Mike in Austin · ‎10-20-2020

More that 100K partitions is not recommended with Impala. The Impala cookbook recommends some techniques to reduce the number.. https://blog.cloudera.com/latest-impala-cookbook/

Mike in Austin · ‎10-20-2020

You'll need to create local package an parcel repos. Docs here.. https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/installation/topics/cdpdc-local-package-parcel-repositories.html Mike

Mike in Austin · ‎10-20-2020

Here's the doc... https://docs.cloudera.com/cdp-private-cloud/latest/upgrade/topics/cdpdc-upgrade-paths.html I'd recommend getting Cloudera PS engaged to assist though. There are also a few on-demand CDP classes available... https://www.cloudera.com/about/training.html#?fq=training%3Atypes%2Fondemand Mike

Mike in Austin · ‎09-09-2020

According to this link, you should renew and replace the certificates and points to the procedure just above the link.

Online	Offline
Last Visited	‎09-28-2022 12:45 PM

Date Registered	‎03-21-2016 07:39 AM
Last Visited	‎09-28-2022 12:45 PM
Total Messages Posted	46
Total Kudos Received	5

Re: Can I install key trustee server to a cluster ...

Re: Kerberos Ticket Renewer

Re: Sqoop Merge in Hive External table with date p...

Re: HDP to CDP Migration

Re: Upgrade Impala to 3.2 in CDH 5.14

Re: sqoop script error "... is not a valid DFS fil...

Re: Selection of different versions of Apache Flin...

Re: can I have the parcels on NFS instead of remot...

Re: Can I install key trustee server to a cluster ...

Re: The host's NTP service could not be located or...

Re: Timed out waiting for worker process collectin...

Re: Timed out waiting for worker process collectin...

Re: Kerberos Ticket Renewer

Re: Can we use as Greenplum database in CDP privat...

Re: Edge node client compatibility

Re: Kerberos Ticket Renewer

Re: Kerberos Ticket Renewer

Re: Kerberos Ticket Renewer

Re: Can we use as Greenplum database in CDP priva...

Re: Kerberos Ticket Renewer

Re: How can I get warning from impala from JDBC?

Re: What all the reasons for NameNode Failure in ...

Re: What all the reasons for NameNode Failure in ...

Re: Do HDFS ACLs apply on impala queries?

Re: SQL Server Linked Server To Impala Setup

Re: How to publish audit event to Syslog?

Re: How to publish audit event to Syslog?

Re: Sqoop Merge in Hive External table with date p...

Re: GSSException: No valid credentials provided (M...

Re: kafka parcel details in cloudera 6.3x

Re: Kafka cluster monitoring

Re: Impala table having large of number of partiti...

Re: Do you have an installation procedure of CDP 7...

Re: HDP to CDP Migration

Re: Disable/remove auto TLS certificates and creat...