Member since
11-05-2018
32
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2079 | 07-10-2019 04:37 AM |
11-27-2019
11:03 PM
I use CDH6.2. impala-shell --version Impala Shell v3.2.0-cdh6.2.0 (edc1994) built on Thu Mar 14 00:14:35 PDT 2019 kudu --version kudu 1.9.0-cdh6.2.0 revision b4310ca4289bd207fd5b32f5fe001609b4093c27 build type RELEASE built by jenkins at 14 Mar 2019 00:03:44 PST on cldrn-ub1604-ec2-c5d-18xlarge-spotblk-0c10.vpc.cloudera.com
... View more
11-27-2019
09:50 PM
Hi, I'm trying to create Kudu table from impala. My Kudu instance is integrated with HMS (at least kudu hms check and precheck does not show any issues), but when I'm trying to create new table I have error as below: CREATE TABLE my_first_table (id BIGINT, name STRING, PRIMARY KEY(id)) PARTITION BY HASH PARTITIONS 16 STORED AS KUDU TBLPROPERTIES ('kudu.num_tablet_replicas' = '1'); Query: CREATE TABLE my_first_table (id BIGINT, name STRING, PRIMARY KEY(id)) PARTITION BY HASH PARTITIONS 16 STORED AS KUDU TBLPROPERTIES ('kudu.num_tablet_replicas' = '1') ERROR: ImpalaRuntimeException: Error creating Kudu table 'impala::default.my_first_table' CAUSED BY: NonRecoverableException: an error occurred while creating table impala::default.my_first_table in the HMS: when the Hive Metastore integration is enabled, Kudu table names must be a period ('.') separated database and table name identifier pair, each containing only ASCII alphanumeric characters, '_', and '/': impala::default.my_first_table It looks like table name should meet all name restriction (contains only '_') but kudu claims it does not. I tried to put also table in format <db_name>.<table_name> but no progress. Any advices? Regards, Bart
... View more
Labels:
- Labels:
-
Apache Kudu
08-19-2019
10:03 AM
Hi pollard, Did You try to use Cloudera REST API to do that? Regards, Bart
... View more
08-19-2019
09:59 AM
To be sure that your user have access to warehouse location please try run something like below val warehouseLocation = new File ( "spark-warehouse" ). getAbsolutePath
val spark = SparkSession
. builder ()
. appName ( "Spark Hive Example" )
. config ( "spark.sql.warehouse.dir" , warehouseLocation )
. enableHiveSupport ()
. getOrCreate () Regards, Bart
... View more
07-22-2019
02:33 AM
1 Kudo
Works good. Thanks. Regards, Bart
... View more
07-17-2019
04:00 AM
Hi All,
Is it possible to install CDSW on Cloudera Enterprise Trial license? I was trying to do that using Cloudera Director Altus putting CDSW service and roles:
For master: CDSW_MASTER, CDSW_APPLICATION, CDSW_DOCKER
For worker: CDSW_DOCKER, CDSW_WORKER
As described: https://github.com/cloudera/director-scripts/blob/master/configs/aws.cdsw.conf
In Cloudera Altus Director I see:
CDH
6.2.0-1.cdh6.2.0.p0.967373
CDSW
1.5.0.p1.849870
In Cloudera Altus Director logs I see:
[2019-07-17 10:34:20.878 +0000] INFO [p-28d2f405a864-DefaultBootstrapClusterJob] 7a97f76b-fcef-4ebe-9670-50a2f4e8a7d5 POST /api/v12/environments/dev/deployments/dev-deployment/clusters com.cloudera.launchpad.bootstrap.cluster.addServices.CreateServices - com.cloudera.launchpad.pipeline.AbstractJob: Invalid service type(s) specified. Ignored during service and role creation: CDSW CDSW: CDSW_WORKER,CDSW_DOCKER,CDSW_MASTER,CDSW_APPLICATION
I suspect that I need to have Cloudera Enterprise license, not Trial...
Regards,
Bart
... View more
07-15-2019
11:44 PM
Hi Bill, Looks better now. Thanks! Regards, Bart
... View more
07-15-2019
03:33 AM
I founded workaround for this by putting directly URL for repository and GPG in deployment template by adding below lines: "repository": "https://archive.cloudera.com/cm6/6.2.0/redhat7/yum", "repositoryKeyUrl": "https://archive.cloudera.com/cm6/6.2.0/redhat7/yum/RPM-GPG-KEY-cloudera", but still it does not work from Cloudera Altus Director UI. Regards, Bart
... View more
07-15-2019
01:42 AM
Hi All,
Has something been changed in deployment bootstrap script in Cloudera Altus Director during the last 2-3 days? I'm trying to create new deployment and I have error as below:
[2019-07-15 08:24:31.811 +0000] ERROR [p-3796be9eb1d6-DefaultBootstrapDeploymentJob] 6d5f5e0c-caac-4fe4-a1f2-a4db2361ba0b POST /api/v12/environments/dev/deployments com.cloudera.launchpad.pipeline.ssh.SshJobFailFastWithOutputLogging - com.cloudera.launchpad.pipeline.util.PipelineRunner: Attempt to execute job failed com.cloudera.launchpad.common.ssh.SshException: Script execution failed with code 1. Script: sudo sh -c "if [ -f '/opt/cloudera/director/rhel-key' ]; then rpm --import '/opt/cloudera/director/rhel-key'; else rpm --import 'https://archive.cloudera.com/cm6/6.2/redhat7/yum/RPM-GPG-KEY-cloudera'; fi"
URl https://archive.cloudera.com/cm6/6.2/redhat7/yum/RPM-GPG-KEY-cloudera is invalid because does not exist version 6.2, there is 6.2.0 and I have 404 error during deployment.
Thanks for any advices.
Regards,
Bart
... View more
07-11-2019
01:07 AM
Hi, I've ran this again and looks good. Probably it was some intermitent problem as You mentioned. Thanks, Bart
... View more