Member since
11-17-2021
1128
Posts
256
Kudos Received
29
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2817 | 11-05-2025 10:13 AM | |
| 481 | 10-16-2025 02:45 PM | |
| 1032 | 10-06-2025 01:01 PM | |
| 818 | 09-24-2025 01:51 PM | |
| 629 | 08-04-2025 04:17 PM |
07-20-2023
01:27 PM
@Aimen If you are still experiencing the issue, can you provide the information @steven-matison has requested? Thanks.
... View more
07-20-2023
08:54 AM
@SAMSAL my bad !!! I start to be old i need better glasses 🙂 You are right it works fantastically !!! THANKS!!!!!
... View more
07-20-2023
03:10 AM
We verified the same in the CDP environment, as we are uncertain about the Databricks Spark environment. As we have mixed of managed and external tables , extracted the necessary information through HWC. >>> database=spark.sql("show tables in default").collect()
23/07/20 10:04:45 INFO rule.HWCSwitchRule: Registering Listeners
23/07/20 10:04:47 WARN conf.HiveConf: HiveConf of name hive.masking.algo does not exist
Hive Session ID = e6f70006-0c2e-4237-9a9e-e1d19901af54
>>> desiredColumn="name"
>>> tablenames = []
>>> for row in database:
... cols = spark.table(row.tableName).columns
... listColumns= spark.table(row.tableName).columns
... if desiredColumn in listColumns:
... tablenames.append(row.tableName)
...
>>>
>>> print("\n".join(tablenames))
movies
tv_series_abc
cdp1
tv_series
spark_array_string_example
>>>
... View more
07-19-2023
01:08 PM
Hi @Dataengineer1 , This has been asked before , please refer to : https://community.cloudera.com/t5/Support-Questions/NIFI-Is-it-possible-to-make-a-x-www-form-urlencoded-POST/m-p/339398 Thanks
... View more
07-19-2023
11:30 AM
@mohanm Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our NiFi expert @steven-matison who may be able to assist you further. Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
... View more
07-19-2023
06:07 AM
Can we have the full stacktrace of this exception. If you can upload the logs I can get the same. Generally it means manifest file is not present for the parcel or CM has trouble accessing the manifest file in the repo. Are you able to manually browse through the repo in browser? Can you attach the screenshot of the content you see in the repo from browser?
... View more
07-18-2023
04:39 PM
Here are some highlights from the month of June
COMING NEXT!
Streaming Data Pipeline Development
Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details!
149 new support questions
34 new community articles
423 new members
Rank
Community Article
Author
Components/ Labels
#1
Spark in CML: Recommendations for using Spark in Cloudera Machine Learning
Paul de Fusco
@pauldefusco
Apache Spark
Cloudera Machine Learning (CML)
#2
Explaining "block missing" and "block corruption" alerts in HDFS
Karthik Palanisamy
@kpalanisamy
HDFS
#3
NIFI SSL in Modern Versions of NiFi
Steven Matison
@steven-matison
Apache NiFi
#4
Sizing CML Workspaces: Must-Knows for properly planning workspace resources
Paul de Fusco
@pauldefusco
Cloudera Data Platform (CDP) Cloudera Machine Learning (CML)
#5
Publish_Kafka_1_0 processor not stops working after upgrading to CFM 2.1.5 SP1
Usman Khan @usman35
Apache NiFi Cloudera Data Flow (CDF)
We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.
See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page.
@steven-matison @MattWho @smruti @Scharan @RangaReddy @SAMSAL @cotopaul @drewski7 @Juanes @yagoaparecidoti
Share your expertise and answer some of the below open questions. Also, be sure to bookmark the unanswered question page to find additional open questions.
Unanswered Community Post
Components/ Labels
How to access Spark Thrift server via jdbc from apache nifi?
Apache Hive
Apache NiFi
Apache Spark
"org.apache.zookeeper.Login: TGT renewal thread has been interrupted and will exit" Messages on HBase Region Server Log
Apache HBase
Apache Zookeeper
Cloudera Data Platform Private Cloud (CDP-Private)
Cloudera CDH 6.3 Kerberos Wizard FreeIPA Error missing Script
Cloudera Manager
Kerberos
Change owner of CDSW job
Cloudera Data Science Workbench (CDSW)
Failed to start role of YARN Queue Manager
Apache Yarn
Cloudera Data Platform Private Cloud (CDP-Private)
... View more
07-18-2023
11:30 AM
Hi @dcardenas In CDH/CDP clusters, the integration between Spark and Hive service is get done by implementing Spark SQL API for Hive External tables through HiveMetastore and HWC (Hive Warehouse Connector) to Hive Managed/ACID tables. Therefore, Spark accessing Hive with JDBC is not supported, please check Unsupported Apache Spark Features
... View more
07-18-2023
09:47 AM
Hi @pragz Not sure how you usually start HMS, but I would start with something like: ./bin/start-metastore >/var/tmp/hms-stdout.log 2>/var/tmp/hms-stderr.log or nohup ./bin/start-metastore >/var/tmp/hms-stdout.log 2>/var/tmp/hms-stderr.log & to start in the background. With that you should have a separate stdout and and stderr logfile. If a process suddenly exits, usually it is because the OS killed it, so look in dmesg or messages if there is a sign for the oomkiller. Also check your $HIVE_CONF_DIR/hive-log4j.properties is there and verify where the ordinary log4j based HMS logging messages are going. Hope this helps. Miklos
... View more
07-17-2023
05:14 PM
@I_Mesh01 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more