Q&A

Hello,I need some assistance / guidance related to Impala Audit & Lineage Logs.In our cluster I  see Impala Audit Logs (enable_audit_event_log) Un-checked, yet on the node level we see logs getting generated.[service1@myserver audit]# ls -ltrhtotal 215M-rw-r--r-- 1 impala impala 4.2M May 27 14:45 impala_audit_event_log_1.0-1622078304372-rw-r--r-- 1 impala impala 3.9M May 27 15:34 impala_audit_event_log_1.0-1622083537006-rw-r--r-- 1 impala impala 4.3M May 27 16:44 impala_audit_event_log_1.0-1622086468134-rw-r--r-- 1 impala impala 4.3M May 27 17:18 impala_audit_event_log_1.0-1622090691805-rw-r--r-- 1 impala impala 4.3M May 27 18:26 impala_audit_event_log_1.0-1622092726630-rw-r--r-- 1 impala impala 4.2M May 27 20:07 impala_audit_event_log_1.0-1622096799288-rw-r--r-- 1 impala impala 4.0M May 27 21:17 impala_audit_event_log_1.0-1622102850640-rw-r--r-- 1 impala impala 3.7M May 28 01:36 impala_audit_event_log_1.0-1622107032783-rw-r--r-- 1 impala impala 2.7M May 28 14:34 impala_audit_

Hi, is there a way we can change the datatype from int to double for a column on Impala? Table size is around 3 billion records. I do not plan to drop and recreate it. ALTER TABLE cbs.gprs_home_cdrs CHANGE percentage_val_n percentage_val_n double;AnalysisException: Cannot change the type of a Kudu column using an ALTER TABLE CHANGE COLUMN statement: (INT vs DOUBLE)impalad version 3.4.0-SNAPSHOT RELEASE (build 134517e42b7b6085e758195465f956f431e0e575) Built on Sat Dec 12 11:15:02 UTC 2020Version: Cloudera Enterprise 7.1.3 (#4999720 built by jenkins on 20200805-1701 git: fa596184790377f07ba80e9cd4da8b875237939c)Java VM Name: OpenJDK 64-Bit Server VMJava Version: 11.0.10 Thanks, Roshan

Hello,I signed up for Cloudera to install Hadoop with Ambari, and I got an email saying that the username is my Google email address.During the installation process, you need to download the repo file in the following way. wget -O /etc/apt/sources.list.d/ambari.list https://id@gmail.com:mypasswd@archive.cloudera.com/p/ambari/ubuntu14/2.x/updates/2.7.5.0/ambari.list But it doesn't work properly because of "@" in username.Can you help?

Dear Team, how can I mask last 5 digits in field below in Kudu? on Ranger?Thanks, Roshan

I wanted to know about this everchanging technology and its core advantages which can benefit a business

Can Sqoop export be used to create a table?

Hi experts,So I recently installed Hbase via ambari.I am able to start hbase master and regionserver.However, when I start the phoenix queryserver, ambari does not throw any errors, however, within a couple seconds, the phoenix queryserver stops. This is the error I found below:[root@test02 ~]# cat /var/log/hbase/phoenix-hbase-queryserver.outError: Could not find or load main class org.apache.phoenix.queryserver.server.QueryServerstarting Query Server, logging to /var/log/hbase/phoenix-hbase-queryserver.log2021-05-14 16:39:23.784483 launching /usr/jdk64/jdk1.8.0_112/bin/java -cp /etc/hbase/conf:/etc/hadoop/conf:/usr/lib/phoenix/bin/../phoenix-4.15.0-HBase-1.5-client.jar:::/etc/hadoop/conf:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/.//*:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-hdfs/.//*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-mapreduce/lib/*:/usr/lib/hadoop-mapreduce/.//*::mysql-connector-java.jar:/usr/lib/hadoop-mapreduce/*:/usr/li

I'm getting this error Error while processing statement: Cannot modify hive.msck.path.validation at runtime. It is not in list of params that are allowed to be modified at runtime how can I fixed it or configure it on hive config in CM?

Workflow  submit Failed: Failed to create deployment directory: 403 Client Error: Forbidden for url: Have you ever encountered such a mistake? How to improve?thank!

Hello, I am writing on behalf of Eustema Spa (partnership@eustema.it) which is currently a bronze level partner with Cloudera.I wanted to ask if it is possible to receive the certificate attesting to the partnership (as it was sent to us for the previous deadline before renewal) Thank you  Alessandro

Hi Team,In order to Schedule the exam for CCA 175, I am using my mail id to create new account in examlocal.com site, it says "Email id is already in use" and tried to sign in with mail id and it says "Failed in log in" and even though reset my password then tried again then getting the same error message . i am unable to sign in to schedule a exam. Please help me to resolve the issue.

Hi, I have noticed that when I restart impala in cloudera manager when I am trying to run queries the execution time is bigger than the usual.  Is there any way to warm up impala somehow and after run the queries ? 

Hello!  Will any kind user tell me where can I find using manual of HUE Platform?I am getting ready to develop Big Data applications on HUE but I find some cumbersome issues on it,Thanks in advance. 

Hello,I’m facing an issue while trying to connect with the hive ODBC driver through a proxy to access a hive database.The SNI field in the request is populated with the proxy url instead of the destination url.While performing a direct connection to the hive database, the SNI field is populated with the url of hive database, if I wanted to use a proxy between the server with Hive ODBC driver and the Hive database, the SNI field is populated with the proxy url.In that case, my hive database, is enable to recognize the database I wanted to access to. Is there any parameters for solved this issue?ThanksThierry  

I'm using CDH-6.2.0. and hue. HUE_LOAD_BALANCER is run fine.But HUE_SERVER does not run on each node(2 node).I've looked at the logs, but I can't find any problems. The strange thing is that even if you run the server once, it looks like it is running 4 times in the runcpserver.log as shown in the figure below, and in the supervisor log, you can see a log saying that it was executed too many times. That's my own log file.supervisord.log  2021-03-30 16:37:03,391 INFO spawned: '178-hue-HUE_SERVER' with pid 243782021-03-30 16:37:12,722 INFO exited: 178-hue-HUE_SERVER (exit status 0; not expected)2021-03-30 16:37:13,726 INFO spawned: '178-hue-HUE_SERVER' with pid 245862021-03-30 16:37:22,823 INFO exited: 178-hue-HUE_SERVER (exit status 0; not expected)2021-03-30 16:37:24,829 INFO spawned: '178-hue-HUE_SERVER' with pid 248572021-03-30 16:37:33,645 INFO exited: 178-hue-HUE_SERVER (exit status 0; not expected)2021-03-30 16:37:36,653 INFO spawned: '178-hue-HUE_SERVER' with

we have HDP cluster with 2 resource manager services , and 190 node managers servicesHDP version - 2.6.5YARN version - 2.7.3Hadoop platform - ambari 2.6.2.1 versioneach node manager is located on VM linux machinesnow we want to extend the node-managers machines to 220 machinesthe Question that I want to ask:dose resource-manager can support 220 node managers services ( when each node-manager service installed on one node manager linux machine ) ?what is the max limit of node-mangers services that one resource -manager can support?

Hi,   I am using Cloudera Sandbox for Hortonwork. Can anyone help me with Sqoop? I am trying to do an Oracle JDBC connection?   [root@sandbox-hdp lib]# sqoop list-databases --connect jdbc:oracle:thin:@10.124.0.70:1523/BI Warning: /usr/hdp/3.0.1.0-187/accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.                               &

We have a scenario where PG-A has child PGs like PG-A1, PG-A2. Everything works fine with versioning of all PGs along with importing PG-A which imports all child PGs into any other Nifi Development instance. However, when we move the registry content from dev to UAT enviroment. Importing of parent PG give error like below. However, child PGs get imported individually without any issue.  "The Flow Registry with ID f9eb8fe6-0176-1000-a53b-838685a98fb8 reports that no Flow exists with Bucket 29a08c71-a056-4e1a-8e8e-0f46abcc50c9, Flow fee2a7e1-3716-42ce-881f-071ef0240fd9, Version 10" Can you please suggest anything to take of when doing this migration? Any workaround? Thanks,PR 

Hello Everyone, In my CDP setup, I'm not able to run Analyze table commands on external tables. It first doesn't start a YARN application immediately, and after 5-10 mins, when it starts the application, it gets killed within 10 seconds with the following error stacktrace.  ERROR : Status: FailedERROR : Application application_1623850591633_0042 failed 2 times due to AM Container for appattempt_1623850591633_0042_000002 exited with exitCode: -104Failing this attempt.Diagnostics: [2021-06-18 18:32:52.722]Container [pid=32822,containerID=container_e49_1623850591633_0042_02_000001] is running 34230272B beyond the 'PHYSICAL' memory limit. Current usage: 2.0 GB of 2 GB physical memory used; 3.9 GB of 4.2 GB virtual memory used. Killing container.Dump of the process-tree for container_e49_1623850591633_0042_02_000001 : |- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE |- 32829 3

Hi folks,  After install Cloudera CDP 7.1.4 we access Altas and searched items .    When click any item we receive this error "Unknown Entity-Type" But, looking the searching options we can´t find any ENTITY-TYPE: Someone have any idea why  not show any ENTITY TYPE? ThanksEduardo 

Cloudera manager service starts to enter bad health state because of its roles bad state. For example, Activity Monitor started to have bad health because of below error and then the health state became good. Is there a way to investigate what could cause such issues? Mostly Cloudera manager and its roles` state is healthy, but bad health happens from time to time. I went over metrics and  don't see anything suspicious except garbage collection from time to time.  The health test result for ACTIVITY_MONITOR_SCM_DESCRIPTOR_FETCH has become bad: The Cloudera Manager descriptor was refreshed 2 minute(s), 40 second(s) ago. Critical threshold: 2 minute(s).  

Hi there,After reinstalling JDK and restrating cluster I got this error in the master node. Someone knows how to recover this host.Cheers, 

HDFS服务  /user/hive/warehouse整个目录被删，请协助  

Hello Team, I am working the tutorial on RDD. I am having some difficulties understanding some commands. Can you please advise what steps 3-8 do?. Encode the Schema in a stringval schemaString = "name age"4. Generate the schema based on the string of schemaval fields = schemaString.split(" ").map(fieldName => StructField(fieldName, StringType, nullable = true))val schema = StructType(fields)5. Convert records of the RDD (people) to Rowsval rowRDD = peopleRDD.map(_.split(",")).map(attributes => Row(attributes(0), attributes(1).trim))6. Apply the schema to the RDDval peopleDF = spark.createDataFrame(rowRDD, schema)6. Creates a temporary view using the DataFramepeopleDF.createOrReplaceTempView("people")7. SQL can be run over a temporary view created using DataFramesval results = spark.sql("SELECT name FROM people")8.The results of SQL queries are DataFrames and support all the normal RDD operations. The columns of a row in the result can be accessed by field index or

I'm using Hortonworks 2.6.5 in Oracle Virtualbox. I tried opening Hive View in Ambari UI, it is taking more than 3hours, and still, it is not opening. HiveServer Test is taking a lot of time!!I tried restarting the respective services but nothing worked out. I am in need of help with this issue!!