Q&A

Hi Team,I have recently migrated Kerberos principals using the below command from one KDC to another KDC, post-migration kinit is not working and it is throwing some error whereas the same identity is working in the original KDC. Can you please help us in identifying the error? Did I make any mistakes while migrating the principles?  Command Used - kdb5_util dump -verbose dumpfile  and logged in to other KDC and executed the restore kdb5_util restore -verbose /tmp/dumpfile Error:KRB5_TRACE=/dev/stdout kinit testuser[8962] 1645765308.654184: Getting initial credentials for testuser@EXAMPLE.COM[8962] 1645765308.654186: Sending unauthenticated request[8962] 1645765308.654187: Sending request (181 bytes) to EXAMPLE.COM[8962] 1645765308.654188: Resolving hostname stg-hdplucykrb101.phonepe.nb6[8962] 1645765308.654189: Sending initial UDP request to dgram 10.57.55.228:88[8962] 1645765308.654190: Received answer (163 bytes) from dgram 10.57.55.228:88[8962] 16

Hello,We were getting ‘DatabaseError: ORA-01017: invalid username/password; logon denied’ post our db upgrade, to fix that we have reset the hue password, which worked and that issue got fixed.Unfortunately one of our guys deleted a couple of logs from /var/log/hue. We have recreated runcpserver.log with the necessary permission, and restart Hue server, yet we fail to see the file being populated (file is still empty). Request assistance / guidance in fixing this issue. ThanksWert

Hello,How do I check the location where Kerberos is writing logs?I checked the location which is mentioned in krb5.conf (default = FILE:/var/log/krb5libs.logkdc = FILE:/var/log/krb5kdc.logadmin_server = FILE:/var/log/kadmind.log) however the log files mentioned in this location are empty. Am I checking an incorrect location? Secondly logs on Hue Server & KT renewer is not getting updated / current. Any help/guidance is appreciated.

Hello, I recently discovered the CM Rest API and how I can restart services and obtain some information just using the Linux console and not using the CM UI. I'm looking for some examples to delete and create the Impala Catalog Server and State Store (in a diferent node) by only using this feature.  I did not find any information about it in the internet, just some poor youtube videos to do simple actions. I'm using CDP 7.1.6 CM 7.3.1 API v43 This is the Cloudera documentation I could get from my installation http://my-CMhost.com:7180/static/apidocs/resource_RolesResource.html   I would really appreciate if anyone used this and could share some examples 🙂  

I have a use case where I want to Replace Value From My AttributeLike I have a Attribute Like :- 1. Header: A,B,C,D,E2. Index: 3Now I Want to replace the index Attribute Value from My header Attribute value with same Position like if I have 3 in my index attribute so it will replace the third aliment from my header attribute or if it's 5 so it should change the 5th one from header and make a new Attribute something like thisHeader_2 :- A,B,3,D,EBased on index attribute number it's needs to replaceThanks In Advance 

We are using zookeeper-3.4.6.jar and hbase-client-1.4.5.jar for connecting to hbase cluster in a kerberized environment.  All works fine except once in a while we get the following error.   ERROR ZooKeeperSaslClient:384 % An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Connection refused (Connectionrefused))]) occurred when evaluating Zookeeper Quorum Member's received SASL token. Zookeeper Client will go to AUTH_FAILED state   ERROR ClientCnxn:1015 % SASL authentication with Zookeeper Quorum member failed: javax.security.sasl.SaslException: An error: (java.security.PrivilegedActionException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Connection refused (Connection refused))]) occurred when evaluating ZookeeperQuorum Member's received SASL token. Zookeeper C

After the Cloudera patching against TSB 2021-545 - Critical vulnerability in log4j2 CVE-2021-44228 on hdp, we need to re-create the oozie share lib and after that, update these.So, after this steps, all the jobs schedule via OOZIE get the execption:ERROR org.apache.hadoop.hive.metastore.RetryingHMSHandler - HMSHandler Fatal error: java.lang.NoClassDefFoundError: com/codahale/metrics/Metric.Doing a rollback of previous libraries fixed the error. I've already checked the new and older paths on HDFS /user/oozie/share/lib/lib_<tms>/spark, but are the same. Any ideas about the problem? ThanksBR 

What is the available JDBC open-source driver to connect Apache NIFI with MS Access Database.@Nifi @ApacheNifi 

We upgraded from 7.1.6 to 7.1.7 GA and had similar issue and now we are trying to upgrade to hotfix and facing same issue and a bit unclear what fixed the first issue ! We copied the following files to /opt/cloudera/parcel-repo 8549720983 Jan 29 00:10 CDH-7.1.7-1.cdh7.1.7.p74.21057765-el7.parcel40 Jan 30 00:44 CDH-7.1.7-1.cdh7.1.7.p74.21057765-el7.parcel.sha164 Jan 30 00:44 CDH-7.1.7-1.cdh7.1.7.p74.21057765-el7.parcel.sha256 When we check parcels in CM we see the following Error CDH 77.1.7-1.cdh7.1.7.p74.21057765Unavailable Error for parcel CDH-7.1.7-1.cdh7.1.7.p74.21057765-el7.parcel : No valid hash file found.We tried copying the SHA files again ...compared bits with another download and still same error . Anything we are missing ? Is there supposed to be a "torrent" file ? Couldnt see it in archive .   

Hi ,After accessing the hbase master ui link in production , under hbck we see there are 967 regions under ophan regions in filesystem. Can someone please help us as to how can we clear them. Thanks.@gsharma 

I can see there are 89 ActiveNodes with each 231 GB of memory but still YARN is showing only 3.33 TB.Can someone help me outhere? 

Can someone suggest regarding nifi 1.15.3 setup in plain Linux. As I am able to setup 1.13 in Linux but not latest version As seems like some pre-request is needed on this version respect of security/keystore. If already Discussed share me the link.

hive has --database option to select database.--database <databasename> Specify the database to use What is the beeline equivalent of the same?

I am following the instructions to run hive tpch https://github.com/hortonworks/hive-testbench.git I am using Cloudera Enterprise Trial 7.3.1 I solved the initial error(https://community.cloudera.com/t5/Support-Questions/Error-while-running-hive-tpch-Exception-in-thread-quot-main/m-p/336879/thread-id/232418/highlight/false#M232465 ) and tried to rerun the tpch-setup.sh. I am running into following error. + echo 'TPC-H text data generation complete.'TPC-H text data generation complete.+ echo 'Loading text data into external tables.'Loading text data into external tables.+ runcommand 'beeline -u jdbc:hive2://techmach.com:10000/default -i settings/load-flat.sql -f ddl-tpch/bin_flat/alltables.sql -d DB=tpch_text_2 -d LOCATION=/tmp/tpch-generate/2'+ '[' X '!=' X ']'+ beeline -u jdbc:hive2://techmach.com:10000/default -i settings/load-flat.sql -f ddl-tpch/bin_flat/alltables.sql -d DB=tpch_text_2 -d LOCATION=/tmp/tpch-generate/2+ i=1+ total=8+ test 2 -le 1000+ SC

What is the beeline equivalent of hive cli -d option?-d,–define <key=value>Variable substitution to apply to Hive commands.

HI,  I am having an issue in LDAP integration with NIFI version 1.15.3.I can able to login the admin screen, i added policy for "modify component". but when i drag and drop the process or process group into the screen. it appear in read only ( with doted line). in the log it is saying"Unable to find access policy for write on /process-groups/2740a80a-017f-1000-a4b3-70d6580cdb38. Returning Not Found response"  My configuration belowlogin-identity-providers.xml   <provider> <identifier>ldap-provider</identifier> <class>org.apache.nifi.ldap.LdapProvider</class> <property name="Authentication Strategy">SIMPLE</property> <property name="Manager DN">cn=admin,dc=ae,dc=test,dc=com</property> <property name="Manager Password">a@psswd</property> <property name="TLS - Keystore"></property> <property name="TLS - Keystore Password"></p

I am following the instructions to run hive tpch https://github.com/hortonworks/hive-testbench.git  I am using Cloudera Enterprise Trial 7.3.1 I am running into following error. [root@test_mach hive-testbench]# ./tpch-setup.sh 3+ '[' X3 = X ']'+ '[' X = X ']'+ DIR=/tmp/tpch-generate+ '[' 3 -eq 1 ']'+ hdfs dfs -mkdir -p /tmp/tpch-generate+ hdfs dfs -ls /tmp/tpch-generate/3/lineitemls: `/tmp/tpch-generate/3/lineitem': No such file or directory+ '[' 1 -ne 0 ']'+ echo 'Generating data at scale factor 3.'Generating data at scale factor 3.+ cd tpch-gen+ hadoop jar target/tpch-gen-1.0-SNAPSHOT.jar -d /tmp/tpch-generate/3/ -s 3WARNING: Use "yarn jar" to launch YARN applications.Exception in thread "main" java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem cannot access its superinterface org.apache.hadoop.hdfs.web.TokenAspect$TokenManagementDelegatorat java.lang.ClassLoader.defineClass1(Native Method)at java.lang.ClassLoader.defineClass(ClassL

While looking into the Spark unsupported features in CDP private cloud, i can see below statement "Using the JDBC Datasource API to access Hive or Impala is not supported"Can you please explain this? If JDBC datasource is not supported, can't we access hive? Is this true?Is there any fix for this.Appreciate your quick response. 

Hi guys, i am trying some hive partitions but i am getting the following errors. kindly help figure out the problem. 0: jdbc:hive2://svdt5hadoopms02.bigdatadev.sa> ALTER TABLE customer_transaction_extract DROP IF EXISTS PARTITION (date='date=2019-11-13') PURGE;Error: Error while compiling statement: FAILED: ParseException line 1:67 cannot recognize input near 'date' '=' ''date=2019-11-13'' in drop partition statement (state=42000,code=40000)0: jdbc:hive2://svdt5hadoopms02.bigdatadev.sa> ALTER TABLE customer_transaction_extract DROP IF EXISTS PARTITION (date='date="2019-11-13"') PURGE;Error: Error while compiling statement: FAILED: ParseException line 1:67 cannot recognize input near 'date' '=' ''date="2019-11-13"'' in drop partition statement (state=42000,code=40000)0: jdbc:hive2://svdt5hadoopms02.bigdatadev.sa> ALTER TABLE customer_transaction_extract DROP IF EXISTS PARTITION (date=`2019-11-13`) PURGE;Error: Error while compiling statement: FAILED: ParseException line 1:

Hello everyone,I want to use the Publish Kafka processors and I need to specify the partition for each flow file. But when I choose Expression Language Partitioner class and add my partition info on Partition field, it does not publish my records to appropriate partitions. I realize that, instead, it gets my partition string and hashes. Then it publishes the records to partition with hashed value. I dont understand why it works like this. I want to choose a spesific partition for each flow file. How can I achieve this? Here is the code from nifi github repo. As we can see it hashes the partition value:   private Integer getPartition(final ProcessContext context, final FlowFile flowFile) { final String partitionClass = context.getProperty(PARTITION_CLASS).getValue(); if (EXPRESSION_LANGUAGE_PARTITIONING.getValue().equals(partitionClass)) { final String partition = context.getProperty(PARTITION).evaluateAttributeExpressions(flowFile).getValue();

Hello, Posting the question since i didn't see API command for CM to stop/start service on a specific host. I'm not asking for decommission/recommission as this will require blocks to be copied prior to eviction. This is to facilitate OS patching and will be pretty quick probably 2-3 hour downtime.

I'm currently new with Nifi but I have a task to achieve. My task is to insert a data in a Database via InvokeHTTP Processor. But I don't know where can I insert the json format, I tried to insert it inside the Put Response Body In Attribute field and Changed the Send Message Body to "true".    But when I tried to start it, It doesn't proceed to the queue or even sends an error.     

Hi everyone! I hope all is well. I have this json  {    "Data": {        "ID": "09878666",        "DATE": "2022-01-01",        "ARRAY_ONE": [            {                "NAME": "test_1",                "details": [                    {                        "address": "123123"                    }                ]            },            {                "NAME": "test_2",                "details": [               

Dear All, On one particular cluster we have spark 2.3 running(CDH 5.15.1). can it be possible to only upgrade spark to 2.4 ? by remaining on the same CDH version(5.15.1). will it compatible with existing service ?. kindly suggest  

Hi I'm using nifi 1.11.4 and I came across the following issue:  I'm dynamically reading a CSV file that contains 2 headers with the same name ( can't use avro schema registry as I don't the header names in advance). When I'm trying to use CSVReader to read the file "I'm getting duplicate header error". How can I handle this situation?Note: I need to maintain the same header name.