Member since
09-12-2023
21
Posts
16
Kudos Received
0
Solutions
10-02-2024
09:14 AM
1 Kudo
@steinsgate Its definitely not recommended to disable Kerberos for Hive. However if you still want to disable Kerberos please do it at a cluster level and not at Hive level. This is not a supported / certified combination. Thats to have your cluster kerberos but Hive not kerberized. Its either you cluster is Kerberos enabled or not.
... View more
09-26-2024
03:30 AM
1 Kudo
Hi everyone, I would like some clarification. Thank you. Embedded Container Service 1.5.1, CML installation keeps getting stuck and eventually fails with a timeout check the CML pod: /var/lib/rancher/rke2/bin/kubectl --kubeconfig /etc/rancher/rke2/rke2.yaml -n cml get po We found that the status of the s2i-builder pod is CrashLoopBackOff. check log: /var/lib/rancher/rke2/bin/kubectl --kubeconfig /etc/rancher/rke2/rke2.yaml -n cml logs s2i-builder-97d946b65-46fhc Defaulted container "fluent-bit" out of: fluent-bit, s2i-builder, update-ca-trust (init), chowndockersock (init), chowndockercert (init)
Fluent Bit v1.9.10
* Copyright (C) 2015-2022 The Fluent Bit Authors
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io
[2024/09/26 08:19:29] [ info] [fluent bit] version=1.9.10, commit=, pid=1
[2024/09/26 08:19:29] [ info] [storage] version=1.3.0, type=memory-only, sync=normal, checksum=disabled, max_chunks_up=128
[2024/09/26 08:19:29] [ info] [cmetrics] version=0.3.7
[2024/09/26 08:19:29] [ info] [output:stdout:stdout.0] worker #0 started
[2024/09/26 08:19:29] [ info] [sp] stream processor started
[2024/09/26 08:19:29] [ info] [output:forward:forward.1] worker #0 started
[2024/09/26 08:19:29] [ info] [output:forward:forward.1] worker #1 started
[2024/09/26 08:21:59] [ info] [input:tail:tail.0] inotify_fs_add(): inode=207397062 watch_fd=1 name=/var/fluentbit/log/s2i-builder.log
[0] cml.var.fluentbit.log.s2i-builder.log: [1727338919.286419977, {"log"=>"2024-09-26 08:21:51.465 7 INFO S2I.Builder Start getting config from env ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[1] cml.var.fluentbit.log.s2i-builder.log: [1727338919.286428247, {"log"=>"2024-09-26 08:21:51.466 7 INFO S2I.Builder Finish getting config from env ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[2] cml.var.fluentbit.log.s2i-builder.log: [1727338919.286429226, {"log"=>"2024-09-26 08:21:51.466 7 INFO S2I.Builder Using external registry for S2I pushing ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[3] cml.var.fluentbit.log.s2i-builder.log: [1727338919.286430482, {"log"=>"2024-09-26 08:21:51.466 7 INFO S2I.Builder Start install registry creds to hosts for :0 ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[4] cml.var.fluentbit.log.s2i-builder.log: [1727338919.286431468, {"log"=>"2024-09-26 08:21:51.466 7 INFO S2I.Utils Start connecting to CDHClient GRPC endpoint ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[0] cml.var.fluentbit.log.s2i-builder.log: [1727338971.497535623, {"log"=>"2024-09-26 08:22:51.496 7 ERROR GRPC.Server gRPC connection did not become ready ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[1] cml.var.fluentbit.log.s2i-builder.log: [1727338971.497543971, {"log"=>"2024-09-26 08:22:51.497 7 ERROR S2I.Utils Finish installing s2i registry certs, Error while installing external docker pull registry certs ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[2] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500920770, {"log"=>"panic: unable to install internal docker registry certificates for :0 to this host: [gRPC connection did not become ready]", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[3] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500926289, {"log"=>"", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[4] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500927612, {"log"=>"goroutine 1 [running]:", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[5] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500928729, {"log"=>"main.runS2iBuilder()", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[6] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500929763, {"log"=>" /root/workspace/src/github.infra.cloudera.com/Sense/cloudera-sense/services/s2i/s2i-builder/main.go:68 +0xd67", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[7] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500930716, {"log"=>"main.main()", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[8] cml.var.fluentbit.log.s2i-builder.log: [1727338971.500931786, {"log"=>" /root/workspace/src/github.infra.cloudera.com/Sense/cloudera-sense/services/s2i/s2i-builder/main.go:36 +0x32", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[0] cml.var.fluentbit.log.s2i-builder.log: [1727338972.599122768, {"log"=>"2024-09-26 08:22:52.598 7 INFO S2I.Builder Start getting config from env ", "namespace"=>"cml", "pod"=>"s2i-builder"}] This is an error message : 08:22:51.496 7 ERROR GRPC.Server gRPC connection did not become ready ", "namespace"=>"cml", "pod"=>"s2i-builder"}] [1] cml.var.fluentbit.log.s2i-builder.log: [1727339032.627617491, {"log"=>"2024-09-26 08:23:52.627 7 ERROR S2I.Utils Finish installing s2i registry certs, Error while installing external docker pull registry certs ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[2] cml.var.fluentbit.log.s2i-builder.log: [1727339032.630074058, {"log"=>"panic: unable to install internal docker registry certificates for :0 to this host: [gRPC connection did not become ready]", "namespace"=>"cml", "pod"=>"s2i-builder"}] After a while, connect to GRPC. [0] cml.var.fluentbit.log.s2i-builder.log: [1727342182.219944841, {"log"=>"2024-09-26 09:16:22.218 7 INFO S2I.Utils Finish connecting to CDHClient GRPC endpoint ", "namespace"=>"cml", "pod"=>"s2i-builder"}] Then there is this error: [1] cml.var.fluentbit.log.s2i-builder.log: [1727342182.227297224, {"log"=>"2024-09-26 09:16:22.227 7 ERROR S2I.Utils failed to write external registry cert ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[2] cml.var.fluentbit.log.s2i-builder.log: [1727342182.227304019, {"log"=>"2024-09-26 09:16:22.227 7 ERROR S2I.Utils Finish installing s2i registry certs, Error while installing external docker pull registry certs ", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[3] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229502149, {"log"=>"panic: unable to install internal docker registry certificates for :0 to this host: [open /etc/docker/certs.d/ecsworker1.clover.com:5000/registry.crt: permission denied]", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[4] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229507778, {"log"=>"", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[5] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229509027, {"log"=>"goroutine 1 [running]:", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[6] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229510284, {"log"=>"main.runS2iBuilder()", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[7] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229511427, {"log"=>" /root/workspace/src/github.infra.cloudera.com/Sense/cloudera-sense/services/s2i/s2i-builder/main.go:68 +0xd67", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[8] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229512764, {"log"=>"main.main()", "namespace"=>"cml", "pod"=>"s2i-builder"}]
[9] cml.var.fluentbit.log.s2i-builder.log: [1727342182.229513716, {"log"=>" /root/workspace/src/github.infra.cloudera.com/Sense/cloudera-sense/services/s2i/s2i-builder/main.go:36 +0x32", "namespace"=>"cml", "pod"=>"s2i-builder"}] We use Cloudera Default Docker Repository to install:
... View more
08-02-2024
08:15 AM
2 Kudos
@steinsgate According to Cloudera documentation check the Security Best Practice ACLs/Permissions Can you add the below line in your SERVER_JVMFLAGS in zookeeper-env template please substitute the value for YOUR_REALM -Dzookeeper.security.auth_to_local=RULE:[2:\$1@\$0](hbase@ YOUR_REALM)s/.*/hbase/RULE:[2:\$1@\$0](infra-solr@ YOUR_REALM)s/.*/infra-solr/RULE:[2:\$1@\$0](rm@ YOUR_REALM)s/.*/rm/ Please revert
... View more
04-23-2024
01:02 AM
1 Kudo
Hello @upadhyayk04 I see, thank you.
... View more
04-08-2024
09:18 PM
2 Kudos
Hello @upadhyayk04 Thank you, marked as resolved.
... View more
04-03-2024
05:55 PM
1 Kudo
Hello @steinsgate Thank you for your update Yes please ensure that the DNS configuration is correct on the nodes. I mean to say that it should adhere to our documentation. Also, try resolving the hostname manually using nslookup from the nodes and compare the output from the working nodes and see if that works
... View more
04-03-2024
04:14 AM
2 Kudos
Hello @steinsgate In case you want to completely remove the cluster. I would say we can think of the removing the namespace from the Openshift all together and then start fresh
... View more
04-03-2024
03:49 AM
1 Kudo
Hello @upadhyayk04 Thank you very much for your response. After reinstalling, we encountered this issue. https://community.cloudera.com/t5/Support-Questions/Failure-to-Install-Embedded-Container-Service-ECS/td-p/385954 Could you please take a look at it when you have some free time? Thank you.
... View more
03-05-2024
12:48 AM
1 Kudo
Hello @Babasaheb , I see, thank you.
... View more
02-27-2024
12:52 AM
2 Kudos
Hi everyone, I would like some clarification. Thank you. I have a question about accessing the CDP Private Cloud Data Services's web UI and understanding which pods or services are related to the web UI. The URL for the CDP Private Cloud Data Services is: https://console-[namespace].apps.am.ocp.poc/ I would like to know how we can determine which pod this web page is running on and under which service? Additionally, if we adopt this method to install the Cloud Data Service: https://docs.cloudera.com/cdp-private-cloud-data-services/1.5.2/installation/topics/cdppvc-installation-steps.html If our OCP is installed in a private network, do you have any suggestions on how to allow the web page to be accessed externally? (e.g., load balancer, ingress, or external gateway)
... View more