Member since
12-07-2018
22
Posts
0
Kudos Received
0
Solutions
03-02-2022
04:17 AM
Hi Team, I have configured my CDP and Keycloak. First I took my Keycloak XML file from "SAML 2.0 Identity Provider Metadata" and with this I have created one Identity provider. And I got one JSON from cloudera community and with this JSON created one client. Json file pasted atlast. With the client I created I pasted my CDP Identity provider ID in " Assertion Consumer Service POST Binding URL " in Keycloak client. After doing these steps with the provided " Target IDP initiated SSO URL " I tried to login all I get is "404 Misconfigured account. IdentityProviderConnector for ID '{39XXX08}' not found" . But if I copy my cloudera Manager URL and paste that in incognito this will redirect me to my keycloak server with this error "We are sorry... Invalid Request". JSON FILE: { "clientId": "cdp-client", "surrogateAuthRequired": false, "enabled": true, "clientAuthenticatorType": "client-secret", "redirectUris": [ "https://consoleauth.altus.cloudera.com/saml" ], "webOrigins": [ "https://consoleauth.altus.cloudera.com" ], "notBefore": 0, "bearerOnly": false, "consentRequired": false, "standardFlowEnabled": true, "implicitFlowEnabled": false, "directAccessGrantsEnabled": false, "serviceAccountsEnabled": false, "publicClient": false, "frontchannelLogout": true, "protocol": "saml", "attributes": { "saml.assertion.signature": "true", "saml.force.post.binding": "true", "saml.multivalued.roles": "false", "saml.encrypt": "false", "saml_assertion_consumer_url_post": "https://consoleauth.altus.cloudera.com/saml?samlProviderId={ID}", "saml.server.signature": "true", "saml_idp_initiated_sso_url_name": "cdp-sso", "saml.server.signature.keyinfo.ext": "false", "exclude.session.state.from.auth.response": "false", "saml.signature.algorithm": "RSA_SHA256", "saml_force_name_id_format": "false", "saml.client.signature": "true", "tls.client.certificate.bound.access.tokens": "false", "saml.authnstatement": "true", "display.on.consent.screen": "false", "saml_name_id_format": "username", "saml.onetimeuse.condition": "false", "saml_signature_canonicalization_method": "http://www.w3.org/2001/10/xml-exc-c14n#" }, "authenticationFlowBindingOverrides": {}, "fullScopeAllowed": true, "nodeReRegistrationTimeout": -1, "protocolMappers": [ { "name": "my-email-id-mapper", "protocol": "saml", "protocolMapper": "saml-user-property-mapper", "consentRequired": false, "config": { "attribute.nameformat": "URI Reference", "user.attribute": "email", "friendly.name": "my-email-friendly-name", "attribute.name": "urn:oid:0.9.2342.19200300.100.1.3" } }, { "name": "my-groups-mapper", "protocol": "saml", "protocolMapper": "saml-group-membership-mapper", "consentRequired": false, "config": { "single": "true", "attribute.nameformat": "URI Reference", "full.path": "false", "friendly.name": "my-groups-friendly-name", "attribute.name": "https://cdp.cloudera.com/SAML/Attributes/groups" } }, { "name": "my-firstname-mapper", "protocol": "saml", "protocolMapper": "saml-user-property-mapper", "consentRequired": false, "config": { "attribute.nameformat": "URI Reference", "user.attribute": "firstName", "friendly.name": "my-firstname-friendly-name", "attribute.name": "https://cdp.cloudera.com/SAML/Attributes/firstName" } }, { "name": "my-lastname-mapper", "protocol": "saml", "protocolMapper": "saml-user-property-mapper", "consentRequired": false, "config": { "attribute.nameformat": "URI Reference", "user.attribute": "lastName", "friendly.name": "my-lastname-friendly-name", "attribute.name": "https://cdp.cloudera.com/SAML/Attributes/lastName" } } ], "defaultClientScopes": [ "web-origins", "role_list", "profile", "roles", "email" ], "optionalClientScopes": [ "address", "phone", "offline_access", "microprofile-jwt" ], "access": { "view": true, "configure": true, "manage": true } }
... View more
Labels:
12-16-2019
09:07 PM
Hi Anibal, Please find the screenshot. While executing a python file, I receive this error. I have done all the steps from spark2 configuration inside hdfs oozie. Regards, C
... View more
12-13-2019
02:40 AM
Hi Team,
I have created a oozie workflow. When I try to execute it shows an error saying class not found.
Please help me with this.
Regards,
C
... View more
Labels:
- Labels:
-
Apache Oozie
-
Cloudera Hue
08-05-2019
10:43 PM
Hi Vyanamandra, Thanks for the response In my case when I click Hiveserver Web UI it will redirect to "Server not found page". I'm going to write a script for it. So if I had a API that would help me. That script will be in my edgenode. So please suggest any API for it. Thanks,
... View more
08-05-2019
02:34 AM
Hi Team,
Is there any API to get the count of open connection from all available hiveserver2 with its private IP.
Thanks in advance.
... View more
Labels:
- Labels:
-
Apache Hive
07-25-2019
11:54 PM
Hi, Thanks a lot. This is very helpful. But, in HAProxy config there are 3 server that are given. I tested with 10 user, the query are withstanding for the specified time 1h. But all the 10 user are getting routed to one hive server and not the other 2. My assumption was roundrobin. When the first user is getting routed to the first hive server, then the second user to another server. For this is there any config to be given. I want to load to be splitted with specified time 1h. Thanks, C
... View more
07-24-2019
05:36 AM
Hi, The timeout config that I have given in HAproxy config file are default value. timeout http-request 10s timeout queue 1m timeout connect 10s timeout client 1m timeout server 1m timeout http-keep-alive 10s timeout check 10s maxconn 3000 But for hive, the config for Idle Session Timeout is 1hr. So now I have to change the config as timeout http-request 10s timeout queue 1m timeout connect 10s timeout client 1h timeout server 1h timeout http-keep-alive 10s timeout check 10s maxconn 3000 Is this correct? Should we give as 1h or 1hr? Thanks, C
... View more
07-21-2019
11:02 PM
Hi Team, Is there any solution for my issue. I'm still facing issue with my load balancer. Please suggest some solution. As this is very priority for my work. Regards, C
... View more
07-15-2019
11:50 PM
Hi Eric, Among the 3 hive server the configuration that was given in clouderamanager are, hive.server2.idle.operation.timeout 30Min hive.server2.idle.session.timeout 1Hr Is there any other timeout value that should be checked? I found that all 3 server has Unexpected Exits Monitoring Period 5Min & Pause Duration Monitoring Period 5Min, is this has something to do with the hive query expiration? In HAProxy config, listen beeline :10001 mode tcp option tcplog balance roundrobin stick-table type ip size 200k expire 120m stick on src server hiveserver2a x.x.x.x:10000 cookie hiveserver1 check server hiveserver2b x.x.x.x:10000 cookie hiveserver2 check server hiveserver2c x.x.x.x:10000 cookie hiveserver3 check Is there someting else that should be added? Regards, C
... View more
07-12-2019
07:45 AM
Hi Team, Few weeks before I had a dedicated Hiveserver and configured another Hiveserver in slavenode. But the problem is the traffic was directed only to the dedicated Hiveserver and not the other. So I have configured HAProxy in masternode which now acts as a loadbalancer and configured 3 dedicated Hiveserver. Now the traffic is being routed to the all the server. But the hive query that is being executed from hue is getting expired withing 4 to 5 Min. When I give one of the dedicated Hiveserver IP and Port in the hive loadbalancer configuration the query is there for an hour. But when I give the loadbalancer IP and Port in hive loadbalancer configuration thats when the hive query is geting expired soon. Is there some change that need to be done in haproxy config in order to make sure all the 3 dedicated Hiveserver can withstand query for a specified time. If so that will be much helpful. Thanks in advance.
... View more
Labels:
- Labels:
-
Cloudera Labs
-
Cloudera Manager
-
Hive
-
Hue
06-29-2019
04:42 AM
Hi, I have launched a single node cluster with OS as Centos 7.5, 4vcpu, 16GB RAM in azure. But when I create a table and insert some values into the table in hive its gets to pending state with zero resources while seeing in resource manager. And also when I open up resource manager port to all. Some unknown jobs by dr.who is getting created. No idea of what to do. Please help me with this 2 issue. Thanks in advance.
... View more
12-29-2018
03:51 AM
Hi, Normally for packages or parcel to add a new host it takes minimum 15 min, is there a way to reduce this timing. Thank You,
... View more
Labels:
- Labels:
-
Cloudera Manager
12-25-2018
11:02 PM
Hi Satz, Thanks for your responce, I am not getting the full executed job details. It shows spark, But I need the executed query and its details. Can you also tell me whether, we take HUE ACTIVE USERS count via API. Thanks,
... View more
12-21-2018
11:14 PM
Hi, I wanted to get all spark job details like Job ID, Job Name, Query, Start Time, End Time. Is there an API to get these details. If there is one, do tell me please asap.
... View more
Labels:
- Labels:
-
Spark
12-09-2018
10:41 PM
Is there a way to get job id and start and finished time from that xml file.
... View more
12-09-2018
10:41 PM
Is there a way to get job id and start and finished time from that xml file.
... View more
12-08-2018
04:48 AM
Thank you so much, Is there a way to take all the users queries, users name,time of execution through API. Its is difficult to get all the xml file and extract its queries for one user, we have many users and there are several queries for the user. Even though I manage to get all the users query, the old query will get deleted. If i write a script, I want all the extracted queries and its username,time from the xml into a single file. So all the users, Query, uses name and time of execution will be in a single file. Lets us consider a scenario that if I write a script like that, If a users has 5 xml and the script took all the query and the users details, If I execute again the new query only should append the file and not the old query. Can you suggest any solution for my scenario?, please
... View more
12-07-2018
03:55 AM
Hi, I am trying to get Hive query and its details, But i can get its details not the full query. I need to get all the data by API or command, please give me an perfect solution asap. Thanks,
... View more
Labels:
- Labels:
-
Hive