Member since
11-11-2019
636
Posts
34
Kudos Received
27
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 967 | 10-09-2025 12:29 AM | |
| 8377 | 02-19-2025 09:43 PM | |
| 2443 | 02-28-2023 09:32 PM | |
| 5077 | 02-27-2023 03:33 AM | |
| 26763 | 12-24-2022 05:56 AM |
09-30-2021
01:07 AM
1 Kudo
@Mas_Jamie apologies. Unfortunately we dont have the document 😞
... View more
09-27-2021
10:32 PM
@nareshbattula, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
09-25-2021
11:57 AM
@mailsmail I am afraid authorisation tools might not be able to help us here. HIVE-18755 is talking about having two separate catalogs named hive and spark, under Hive metastore db for Hive and Spark services respectively. Here, you could either create databases with different names, or have multiple metastore instances, pointing them to different HMS databases. Then, you will need to have individual HS2 instance(with help of Config groups) connecting to separate Metastores.
... View more
09-21-2021
12:55 AM
Hi @dv_conan Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information that is requested?
... View more
09-16-2021
10:06 AM
1 Kudo
@Sayed016 This error occurs if the HDFS files are under replicated. Did you see HDFS is under replicated when the issue occurred? Wait for the HDFS to gets replicated and you can query
... View more
09-09-2021
09:07 AM
DISTCP or import/export is not supported for ACID tables. You need to follow below mechanism: Distscp for ACID is not supported ,you have 2 approaches: Approach 1 ============= 1. Assuming that you have ACID in source and target clusters. 2. Create a external in source and target clusters. 3. Copy the data from ACID TO external in SOURCE CLUSTER INSERT into external select * from acid. 4. Perfrom distscp from source to target for external table. 5. Copy the data from external TO ACID IN SOURCE CLUSTER INSERT into acid select * from external. Approach 2 ========= Use DLM Refrence: https://community.cloudera.com/t5/Support-Questions/HIVE-ACID-table-Not-enough-history-available-for-0-x-Oldest/td-p/204551
... View more
08-30-2021
01:01 AM
Thanks for the confirmation @syedshakir. Much appreciated.
... View more
08-25-2021
01:07 AM
You need to provide ALL access to the User in the Ranger. Please check the ranger permission settings in Ranger UI
... View more
08-24-2021
03:51 AM
I already followed these instructions but i still have the same issue, here is my tez-site.xml file and screenshots of the error for more details thank you <?xml version="1.0" encoding="UTF-8"?> <!--Autogenerated by Cloudera Manager--> <configuration> <property> <name>tez.am.am-rm.heartbeat.interval-ms.max</name> <value>250</value> </property> <property> <name>tez.am.container.idle.release-timeout-max.millis</name> <value>20000</value> </property> <property> <name>tez.am.container.idle.release-timeout-min.millis</name> <value>10000</value> </property> <property> <name>tez.am.container.reuse.enabled</name> <value>true</value> </property> <property> <name>tez.am.container.reuse.locality.delay-allocation-millis</name> <value>250</value> </property> <property> <name>tez.am.container.reuse.non-local-fallback.enabled</name> <value>false</value> </property> <property> <name>tez.am.container.reuse.rack-fallback.enabled</name> <value>true</value> </property> <property> <name>tez.am.launch.cluster-default.cmd-opts</name> <value>-server -Djava.net.preferIPv4Stack=true</value> </property> <property> <name>tez.am.launch.cmd-opts</name> <value>-XX:+PrintGCDetails -verbose:gc -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp</value> </property> <property> <name>tez.am.launch.env</name> <value>LD_LIBRARY_PATH=/opt/cloudera/parcels/CDH/lib/hadoop/lib/native</value> </property> <property> <name>tez.am.log.level</name> <value>INFO</value> </property> <property> <name>tez.am.max.app.attempts</name> <value>2</value> </property> <property> <name>tez.am.maxtaskfailures.per.node</name> <value>10</value> </property> <property> <name>tez.am.resource.memory.mb</name> <value>2048</value> </property> <property> <name>tez.am.tez-ui.history-url.template</name> <value>__HISTORY_URL_BASE__?viewPath=%2F%23%2Ftez-app%2F__APPLICATION_ID__</value> </property> <property> <name>tez.am.view-acls</name> <value>*</value> </property> <property> <name>tez.cluster.additional.classpath.prefix</name> <value></value> </property> <property> <name>tez.counters.max</name> <value>10000</value> </property> <property> <name>tez.counters.max.groups</name> <value>3000</value> </property> <property> <name>tez.generate.debug.artifacts</name> <value>false</value> </property> <property> <name>tez.grouping.max-size</name> <value>1073741824</value> </property> <property> <name>tez.grouping.min-size</name> <value>16777216</value> </property> <property> <name>tez.grouping.split-waves</name> <value>1.7</value> </property> <property> <name>tez.history.logging.proto-base-dir</name> <value>/warehouse/tablespace/managed/hive/sys.db</value> </property> <property> <name>tez.history.logging.timeline-cache-plugin.old-num-dags-per-group</name> <value>5</value> </property> <property> <name>tez.lib.uris</name> <value>/user/tez/0.9.1.7.1.4.0-203/tez.tar.gz</value> </property> <property> <name>tez.runtime.compress</name> <value>true</value> </property> <property> <name>tez.runtime.compress.codec</name> <value>org.apache.hadoop.io.compress.SnappyCodec</value> </property> <property> <name>tez.runtime.convert.user-payload.to.history-text</name> <value>false</value> </property> <property> <name>tez.runtime.io.sort.mb</name> <value>272</value> </property> <property> <name>tez.runtime.optimize.local.fetch</name> <value>true</value> </property> <property> <name>tez.runtime.pipelined.sorter.sort.threads</name> <value>2</value> </property> <property> <name>tez.runtime.shuffle.fetch.buffer.percent</name> <value>0.6</value> </property> <property> <name>tez.runtime.shuffle.keep-alive.enabled</name> <value>true</value> </property> <property> <name>tez.runtime.shuffle.memory.limit.percent</name> <value>0.25</value> </property> <property> <name>tez.runtime.unordered.output.buffer.size-mb</name> <value>100</value> </property> <property> <name>tez.session.am.dag.submit.timeout.secs</name> <value>300</value> </property> <property> <name>tez.session.client.timeout.secs</name> <value>-1</value> </property> <property> <name>tez.shuffle-vertex-manager.max-src-fraction</name> <value>0.4</value> </property> <property> <name>tez.shuffle-vertex-manager.min-src-fraction</name> <value>0.2</value> </property> <property> <name>tez.staging-dir</name> <value>/tmp/${user.name}/staging</value> </property> <property> <name>tez.task.am.heartbeat.counter.interval-ms.max</name> <value>4000</value> </property> <property> <name>tez.task.generate.counters.per.io</name> <value>true</value> </property> <property> <name>tez.task.get-task.sleep.interval-ms.max</name> <value>200</value> </property> <property> <name>tez.task.launch.cluster-default.cmd-opts</name> <value>-server -Djava.net.preferIPv4Stack=true</value> </property> <property> <name>tez.task.launch.cmd-opts</name> <value>-XX:+PrintGCDetails -verbose:gc -XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp</value> </property> <property> <name>tez.task.launch.env</name> <value>LD_LIBRARY_PATH=/opt/cloudera/parcels/CDH/lib/hadoop/lib/native</value> </property> <property> <name>tez.task.max-events-per-heartbeat</name> <value>500</value> </property> <property> <name>tez.task.resource.memory.mb</name> <value>1536</value> </property> <property> <name>tez.use.cluster.hadoop-libs</name> <value>true</value> </property> <property> <name>yarn.timeline-service.enabled</name> <value>false</value> </property> <property> <name>tez.runtime.sorter.class</name> <value>PIPELINED</value> </property> <property> <name>tez.history.logging.service.class</name> <value>org.apache.tez.dag.history.logging.proto.ProtoHistoryLoggingService</value> </property> </configuration>
... View more
08-12-2021
05:10 AM
@vidanimegh, Sure. Thanks for your response, will wait for your update.
... View more