Member since
02-28-2022
171
Posts
14
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
419 | 07-07-2025 06:35 AM | |
420 | 06-17-2025 09:42 AM | |
1607 | 04-02-2025 07:43 AM | |
626 | 10-18-2024 12:29 PM | |
10842 | 09-05-2024 09:06 AM |
05-30-2023
11:09 AM
OK! @Juanes 😉 thanks for the clarification.
... View more
05-30-2023
11:00 AM
hi @Juanes, accessing a tablet server on port 8050 and checking the tablets, found more than 30 tablet id with the same name, each tablet id was using 4.4GB disk size in this case, according to cloudera's documentation, a tablet can have a maximum of 50GB, the size of the tablet id that was found is within the recommended range, right?
... View more
05-30-2023
05:35 AM
hi @Juanes , great! So, let's assume I have a 500GB table and that table was created with 240 tablets, would that value be within the recommended range? other point! I'm using the following calculates as an example: DATA_SIZE = (value taken from the graph "total_kudu_on_disk_size_across_kudu_replicas") NUM_REPLICAS = RF * Total Tablets (value taken from the ksck command) TABLET_SIZE = DATA_SIZE / NUM_REPLICAS DATA_SIZE = 147G (converted to bytes, getting "157840048128") NUM_REPLICAS = 3 * 240 = 360 Name | RF | State | Total Tablets | Healthy | Recovering | Underreplicated | not available impala::DATABASE01.TABLE01 | 3 | HEALTHY | 240 | 240 | 0 | 0 | 0 TABLET_SIZE = 157840048128 / 720 = 219222289 (which equals 2.04GB) the end result was 2.04GB, does that mean each tablet has 2.04GB?
... View more
05-29-2023
02:01 PM
hi @ChethanYM , I read this documentation, but the doubt is about the tablet and table if looking at the graph in cloudera and seeing tables above 50GB it would be out of the recommended
... View more
05-26-2023
01:58 PM
hello cloudera community, we check in the graph "total_kudu_on_disk_size_across_kudu_replicas" and there are tables with 500GB with that, we need to know what is the recommended size for a kudu table?
... View more
Labels:
- Labels:
-
Apache Kudu
-
Cloudera Manager
05-26-2023
12:35 PM
hello cloudera community, we have a problem we are not able to view the execution logs of the jobs that were executed in yarn by the resourcemanager of yarn when we click on logs it presents the error: "Error getting logs at hostname:8041" how can we solve this problem? we are using cdh express 5.16.2
... View more
Labels:
- Labels:
-
Apache YARN
-
Cloudera Manager
-
MapReduce
10-18-2022
05:35 AM
hi @ask_bill_brooks when I run the command to list the interpreters available for zeppelin, the list returns that python is supported. I run the command: install-interpreter.sh --list and returns the following: OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] alluxio Alluxio interpreter angular HTML and AngularJS view rendering beam Beam interpreter bigquery BigQuery interpreter cassandra Cassandra interpreter built with Scala 2.11 elasticsearch Elasticsearch interpreter file HDFS file interpreter flink Flink interpreter built with Scala 2.11 hbase Hbase interpreter ignite Ignite interpreter built with Scala 2.11 jdbc Jdbc interpreter kylin Kylin interpreter lens Lens interpreter livy Livy interpreter md Markdown support pig Pig interpreter python Python interpreter scio Scio interpreter shell Shell command with this, I think it is possible to use the python interpreter. the problem is that we are not able to make the python interpreter work.
... View more
10-17-2022
01:02 PM
hello cloudera community,
we are having problem installing python interpreter on zeppelin
when running the command:
install-interpreter.sh --name python
loads the following information:
OpenJDK 64-bit server VM warning: ignoring MaxPermSize=512m option; support was removed in 8.0 SLF4J: The classpath contains multiple SLF4J bindings. SLF4J: Link found in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/ impl/StaticLoggerBinder.class] SLF4J: Link found in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-simple-1.7.30.jar!/org/slf4j/ impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: The actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Install python(org.apache.zeppelin:zeppelin-python:0.8.0) in /opt/cloudera/parcels/CDH/lib/zeppelin/interpreter/python ...
stays at this message for almost 2 minutes and returns with the error:
OpenJDK 64-bit server VM warning: ignoring MaxPermSize=512m option; support was removed in 8.0 SLF4J: The classpath contains multiple SLF4J bindings. SLF4J: Link found in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/ impl/StaticLoggerBinder.class] SLF4J: Link found in [jar:file:/opt/cloudera/parcels/CDH-7.1.7-1.cdh7.1.7.p1000.24102687/jars/slf4j-simple-1.7.30.jar!/org/slf4j/ impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: The actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] Install python(org.apache.zeppelin:zeppelin-python:0.8.0) in /opt/cloudera/parcels/CDH/lib/zeppelin/interpreter/python ... org.sonatype.aether.RepositoryException: Unable to fetch dependencies for org.apache.zeppelin:zeppelin-python:0.8.0 in org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:179) in org.apache.zeppelin.dep.DependencyResolver.loadFromMvn(DependencyResolver.java:128) in org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:76) in org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:93) in org.apache.zeppelin.dep.DependencyResolver.load(DependencyResolver.java:85) in org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:170) in org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:134) in org.apache.zeppelin.interpreter.install.InstallInterpreter.install(InstallInterpreter.java:126) in org.apache.zeppelin.interpreter.install.InstallInterpreter.main(InstallInterpreter.java:278) Caused by: java.lang.NullPointerException in org.sonatype.aether.impl.internal.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:352) in org.apache.zeppelin.dep.DependencyResolver.getArtifactsWithDep(DependencyResolver.java:176) ... more 8
can help us solve this problem?
PS: zeppelin was installed by cloudera manager, version 7.6x, cdp version 7.1.x
... View more
Labels:
10-17-2022
09:14 AM
hello cloudera community,
I'm having trouble using python in zeppelin, when I run a simple script it returns the error below:
org.apache.thrift.transport.TTransportException: Socket is closed by peer. at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:130) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:455) at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:354) at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:243) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:182) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:165) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter$2.call(RemoteInterpreter.java:169) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter$2.call(RemoteInterpreter.java:165) at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:135) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.internal_create(RemoteInterpreter.java:165) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.open(RemoteInterpreter.java:132) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:299) at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:408) at org.apache.zeppelin.scheduler.Job.run(Job.java:188) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:315) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Could help to solve this problem?
PS¹: script simple:
%python
number1 = 2 number2 = 2 total = number1 + number2 print(total)
PS²: zeppelin was installed by cloudera manager, version 7.6x, cdp version 7.1.x
... View more
Labels:
- Labels:
-
Apache Zeppelin
10-14-2022
07:20 AM
hello cloudera community, we are having problem in impala after enabling kerberos on cdp cluster only the Impala StateStore role is started healthy, the other roles are in bad status checking the log of the Impala Catalog Server role, the following appears: ------------- 11:07:50.584 AM INFO cc:170 SASL message (Kerberos (internal)): GSSAPI client step 1 11:07:50.587 AM INFO cc:78 Couldn't open transport for hostname:24000 (No more data to read.) 11:07:50.587 AM INFO cc:94 Unable to connect to hostname:24000 11:07:50.587 AM INFO cc:274 statestore registration unsuccessful: Couldn't open transport for hostname:24000 (No more data to read.) 11:07:50.587 AM FATAL cc:87 Couldn't open transport for hostname:24000 (No more data to read.) . Impalad exiting. Wrote minidump to /var/log/impala-minidumps/catalogd/7ae4848b-cd34-4d4c-96cfeaa3-bd4a584f.dmp ------------- how can we solve this problem? this problem is urgent!
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Manager