Member since
10-18-2023
30
Posts
19
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
842 | 04-11-2024 09:23 PM | |
416 | 02-19-2024 04:12 PM |
03-13-2024
09:15 PM
1 Kudo
I have tried this code on jupyter of Cloudera Machine Learning. ============================================================ import cml.data_v1 as cmldata from pyspark import SparkContext #Optional Spark Configs SparkContext.setSystemProperty('spark.executor.cores', '4') SparkContext.setSystemProperty('spark.executor.memory', '8g') #Boilerplate Code provided to you by CML Data Connections CONNECTION_NAME = "go01-dl" conn = cmldata.get_connection(CONNECTION_NAME) spark = conn.get_spark_session() # Sample usage to run query through spark EXAMPLE_SQL_QUERY = "show databases" spark.sql(EXAMPLE_SQL_QUERY).show() ================================================= I cheched enable spark, as well when I tried to create session However the result was failed with error message 'No data connection named go01-dl found' While I am trying this, I thought I have to get information of spark. BUT I CANNOT. Where Can I get the connection name of SPARK? What should I do to do run job on Spark of CML? Please let me know There is no 'Data' tab on CML session. There is no 'Data connectors' on Project setting and Site Administration of CML, as well.
... View more
Labels:
- Labels:
-
Cloudera Machine Learning (CML)
02-21-2024
06:15 AM
After deployed Impala Virtual data warehouse of Data service. I faced Error "401 client Error: Unauthorized for url: http://coordinator:28000/cliservice" Sometimes It works well. To solve this problem what should I check?
... View more
Labels:
- Labels:
-
Cloudera Data Warehouse (CDW)
02-19-2024
04:12 PM
I solved this problem. need por 389 option in LDAP URL. for example ldap://ad.server.com:389 instead of ldap://ad.server.com
... View more
02-18-2024
05:35 PM
1 Kudo
When I try 'Activate' Environment to create virtual datawarehouse of CDW The error occurred below image. This is Authentication page This is environment This is role of cm_admin accout The cm_admin account has all permission on ActiveDirectory. And all ports related LDAP of Activedirectory server. Please let me know what shoul I have to do.
... View more
Labels:
- Labels:
-
Cloudera Data Warehouse (CDW)
12-18-2023
01:06 AM
I am trying run query via HUE api of cloudera data warehouse on azure. However I couldn't get token for authentication. I tried enter ID and password started with csso_ and machine user. Tried enter token made from knox as well. How could I get token for access Hue API??
... View more
Labels:
11-29-2023
12:19 AM
It works. However processor was spit "record has failed the validation on broker and hence will be rejected" with fail when if "complete,delete" set clean up policy on SMM. It works after change cleanup policy to "delete" Thanks
... View more
11-26-2023
08:50 PM
I deployed NiFi and Kafka cluster of cdp public cloud on the azure. And I am trying to publish data to kafka(kafka-poc) user nifi(datahub-poc). I am facing "Topic XXX not present in metadata after 0000ms" when I set 'Use transaction=false' And I am facing "Timeout expired after 0000milliseconds while awaiting InitProducerId" after "Invaid transition attempted from state INITIALIZING to state ABORTING_TRANSACTION" error when i set 'Use transaction=true' Anything should I try to solve this problems?
... View more
Labels:
10-18-2023
09:19 PM
In case of imgae, only one single value(number) in second queue(name: matched). How can I insert data(value in queue) into table use SQL? "insert into table values ( queue )" I want insert 1321 into table in this case. I mean i want make like as "insert into table values (1321)" Which variable or parameter can I use? insert into table values ( ${???????}) Thank you for your answer.
... View more
Labels:
- Labels:
-
Apache NiFi
-
NiFi Registry
- « Previous
- Next »