Member since
11-19-2025
9
Posts
0
Kudos Received
0
Solutions
12-29-2025
05:18 AM
@adhishankarit @VR46 @zaun : i think this is also relevant to previous issue. After getting valid kerberos ticket for the user still facing the same , Knox SSO is enforced here. When using: # curl -k -u "k164prda:ep8gv=rG" https://sitlxdvdlap099.saibsit.com:8443/gateway/knoxsso/api/v1/websso -> Gives no result # curl -k -u k164prda https://sitlxdvdlap099.saibsit.com:8443/gateway/knoxsso/api/v1/token -> Gives no result # curl -k -v --negotiate -u : https://sitlxdvdlap099.saibsit.com:8443/gateway/cdp-proxy/oozie/v2/admin/status HTTP/1.1 302 Found 1-What exact Cloudera Manager configurations are required to enable Kerberos (SPNEGO) authentication for Knox API access (non-browser) or browser , so that curl --negotiate is honored instead of redirecting to KnoxSSO? 2-What are the exact prerequisites for enabling /gateway/knoxsso/api/v1/token in CDP? not able to generate token please share specific commands if you want me to try. For our use case triggering oozie workflow using REST API from within cluster and from Informatica DEI server , or which method is supported when Knox SSO is enabled?
... View more
12-25-2025
12:35 AM
@Shelton still same JDK version used in the Hadoop cluster( for both 7.1.9 & 7.3.1 ). dev - 7.3.1 -> java --version openjdk 17.0.16 2025-07-15 LTS OpenJDK Runtime Environment (Red_Hat-17.0.16.0.8-1) (build 17.0.16+8-LTS) OpenJDK 64-Bit Server VM (Red_Hat-17.0.16.0.8-1) (build 17.0.16+8-LTS, mixed mode, sharing) Prod 7.1.9 -> java -version openjdk version "1.8.0_462" OpenJDK Runtime Environment (build 1.8.0_462-b08) OpenJDK 64-Bit Server VM (build 25.462-b08, mixed mode) https://supportmatrix.cloudera.com/ https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/cdp-private-cloud-base-installation/topics/cdpdc-java-requirements.html From cloudera docs: If you are using JDK 17 on your cluster, you must add the following JVM options to the service: --add-opens=java.base/java.lang=ALL-UNNAMED
--add-opens=java.management/com.sun.jmx.mbeanserver=ALL-UNNAMED
--add-exports=java.management/com.sun.jmx.mbeanserver=ALL-UNNAMED
--add-exports=java.base/sun.net.dns=ALL-UNNAMED
--add-exports=java.base/sun.net.util=ALL-UNNAMED
to ensure the jobs run successfully. any guidance on this might the issue for job failures.
... View more
12-21-2025
02:14 AM
Hi again, We tried re run after updating jars, raised with infa support also, they suggested to roll back old path which CDH 7.2.18 in infa , and follow this KB : https://knowledge.informatica.com/s/article/000251302?language=en_US add these : In order to resolve this error add below post sql query in Hive target: set tez.am.launch.cmd-opts="-XX:+UseNUMA -XX:+UseG1GC -XX:+ResizeTLAB -Xmx20480m \ --add-opens=java.base/java.net=ALL-UNNAMED \ --add-opens=java.base/java.util=ALL-UNNAMED \ --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED \ --add-opens=java.base/java.util.regex=ALL-UNNAMED \ --add-opens=java.base/java.lang=ALL-UNNAMED \ --add-opens=java.base/java.time=ALL-UNNAMED \ --add-opens=java.base/java.io=ALL-UNNAMED \ --add-opens=java.base/java.nio=ALL-UNNAMED";
... View more
12-10-2025
02:55 AM
@Shelton after following shared steps mentioned, we re run the mapping getting this error now: java.lang.NoSuchMethodError: 'org.apache.hadoop.hive.ql.parse.ParseResult org.apache.hadoop.hive.ql.parse.ParseDriver.parse(java.lang.String, org.apache.hadoop.conf.Configuration)' please also note this that old jars for hive-exec also there in path : /data1/informatica/dei/services/shared/hadoop/CDH_7.218 data1/informatica/dei/clients/DeveloperClient/hadoop/CDH_7.218/lib/hive-exec-3.1.3000.7.2.18.0-641.jar /data1/informatica/dei/clients/DeveloperClient/hadoop/CDH_7.218/lib/hive-exec-3.1.3000.7.3.1.100-57.jar /data1/informatica/dei/clients/DeveloperClient/hadoop/CDH_7.218/spark/jars/hive-exec-3.1.3000.7.2.18.0-641.jar *****/data1/informatica/dei/clients/DeveloperClient/hadoop/CDH_7.1/lib/hive-exec-3.1.3000.7.1.9.0-387.jar /data1/informatica/dei/externaljdbcjars/hive-exec-3.1.3000.7.3.1.100-57.jar /data1/informatica/dei/services/shared/hadoop/CDH_7.218/lib/hive-exec-3.1.3000.7.1.9.0-387.jar /data1/informatica/dei/services/shared/hadoop/CDH_7.218/lib/hive-exec-3.1.3000.7.2.18.0-641.jar /data1/informatica/dei/services/shared/hadoop/CDH_7.218/lib/hive-exec-3.1.3000.7.3.1.100-57.jar /data1/informatica/dei/services/shared/hadoop/CDH_7.218/spark/jars/hive-exec-3.1.3000.7.1.9.0-387.jar /data1/informatica/dei/services/shared/hadoop/CDH_7.218/spark/jars/hive-exec-3.1.3000.7.2.18.0-641.jar /data1/informatica/dei/services/shared/hadoop/CDH_7.218/spark/jars/hive-exec-3.1.3000.7.3.1.100-57.jar *** /data1/informatica/dei/services/shared/hadoop/CDH_7.1/lib/hive-exec-3.1.3000.7.1.9.0-387.jar *** /data1/informatica/dei/services/shared/hadoop/CDH_7.1/spark/jars/hive-exec-3.1.3000.7.1.9.0-387.jar /data1/informatica/dei/services/shared/spark/lib_spark/hive-exec-3.1.3000.7.1.9.0-387.jar /data1/informatica/dei/services/shared/spark/lib_spark/hive-exec-3.1.3000.7.2.18.0-641.jar /data1/informatica/dei/services/shared/spark/lib_spark/hive-exec-3.1.3000.7.3.1.100-57.jar
... View more
12-09-2025
07:10 AM
@Shelton , First Many thanks for sharing your insights with me much appreciated. we have re run this workflow again from informatica now again with some new details same errors are coming. Logs: SEVERE: The Integration Service failed to run the Hive task [Write_test_76ti7ctz]. See the additional error messages for more information. com.informatica.sdk.dtm.ExecutionException: [[HIVE_1070] The Integration Service failed to run Hive query [Write_test_76ti7ctz_query_3] for task [Write_test_76ti7ctz] due to following error: Hive error code [2], Hive message [Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1764836049228_0036_1_00, diagnostics=[Vertex vertex_1764836049228_0036_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, java.util.concurrent.ExecutionException: org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator 2025-12-09 16:44:25,009 AST <LdtmWorkflowTask-pool-6-thread-8> INFO: Could not rename /tmp/sqoop-infadpdev/673817950266090/Fact_Bills_DD.java to /tmp/sqoop-infadpdev/673817950266090/Fact_Bills_DD.java. Error: File element in parameter 'null' already exists: '/tmp/sqoop-infadpdev/673817950266090/Fact_Bills_DD.java' 2025-12-09 16:44:21,704 AST <MappingCompiler-pool-4-thread-3> INFO: [LDTMCMN_0037] The Hadoop distribution directory is defined in Data Integration Service properties at the path [/data1/informatica/dei/services/shared/hadoop/CDH_7.218]. 2025-12-09 16:44:21,704 AST <MappingCompiler-pool-4-thread-3> INFO: [CLUSTERCONF_10024] The cluster configuration [Cloudera_Dev] is unchanged from the last export. Using the existing export file [/data1/informatica/dei/tomcat/bin/disTemp/DOM_IDQ_DEV/DIS_DEI_DEV/node02_DEI_DEV/cloudera_dev/SPARK/665d244e-0368-4d51-8ac9-01e1ac851a1f/infacco-site.xml]. 2025-12-09 16:44:21,704 AST <MappingCompiler-pool-4-thread-3> INFO: [CLUSTERCONF_10028] Based on the distribution [CLOUDERA] and the run-time engine [SPARK], the Data Integration Service will override the following cluster configuration properties at run time: \n - fs.file.impl.disable.cache: true\n - fs.hdfs.impl.disable.cache: true\n - yarn.timeline-service.enabled: false -------------------- run this and locate command for hive-exec.jar on informatica server and see that all hive-exec.jars were on older cloudera version which was 7.1.9 sudo find / -type f -name "hive-exec.jar" 2>/dev/null Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator is in hive-exec.jar which is pointing to old path.
... View more
11-26-2025
05:51 AM
Please find the below screenshot and attached logs. Error: SEVERE: The Integration Service failed to run the Hive task [Write_test_1jiq2sdd]. See the additional error messages for more information. com.informatica.sdk.dtm.ExecutionException: [[HIVE_1070] The Integration Service failed to run Hive query [Write_test_1jiq2sdd_query_3] for task [Write_test_1jiq2sdd] due to following error: Hive error code [2], Hive message [Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1764063775281_0054_1_00, diagnostics=[Vertex vertex_1764063775281_0054_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, java.util.concurrent.ExecutionException: org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator 2025-11-26 14:25:24,278 AST <LdtmWorkflowTask-pool-6-thread-3> INFO: HADOOP_MAPRED_HOME is /data1/informatica/dei/services/shared/hadoop/CDH_7.218/lib 2025-11-26 14:25:24,524 AST <LdtmWorkflowTask-pool-6-thread-3> INFO: Could not rename /tmp/sqoop-infadpdev/887867565228272/vrp_branch.java to /tmp/sqoop-infadpdev/887867565228272/vrp_branch.java. Error: File element in parameter 'null' already exists: '/tmp/sqoop-infadpdev/887867565228272/vrp_branch.java' 2025-11-26 14:25:24,524 AST <LdtmWorkflowTask-pool-6-thread-3> INFO: Writing jar file: /tmp/sqoop-infadpdev/887867565228272/vrp_branch.jar 2025-11-26 14:25:24,655 AST <LdtmWorkflowTask-pool-6-thread-3> INFO: Destination directory hdfs://saibdev/data_lakehouse/tables/raw/SPARK_k164prda/sqoop_staging/S7943081602786963440/CUSOMTER_DO_SRC_20698ca1de97472bbab0dfa0331a4a93 is not present, hence not deleting. _write_ing_m_dynamic_create.vrp_BranchSubnet as a58, w7943081602786963440_write_ing_m_dynamic_create.vrp_BranchTypeCode as a59, w7943081602786963440_write_ing_m_dynamic_create.vrp_DefaultOfficerCode as a60, w7943081602786963440_write_ing_m_dynamic_create.vrp_DefaultSundryCode as a61, w7943081602786963440_write_ing_m_dynamic_create.vrp_Reserved as a62, w7943081602786963440_write_ing_m_dynamic_create.vrp_Unitmnemonic as a63, w7943081602786963440_write_ing_m_dynamic_create.vrp_Zipcode as a64, w7943081602786963440_write_ing_m_dynamic_create.vrp_SalesQueue as a65, w7943081602786963440_write_ing_m_dynamic_create.vrp_BranchApproverQueue as a66, w7943081602786963440_write_ing_m_dynamic_create.vrp_CustomerClassification as a67, w7943081602786963440_write_ing_m_dynamic_create.vrp_SeniorBSRQueue as a68, w7943081602786963440_write_ing_m_dynamic_create.vrp_seniorbsrteam as a69, w7943081602786963440_write_ing_m_dynamic_create.vrp_BranchAccountNumber as a70 FROM default.w7943081602786963440_write_ing_m_dynamic_create 2025-11-26 14:31:10,660 AST <LdtmWorkflowTask-pool-6-thread-4> WARNING: java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1764063775281_0133_1_00, diagnostics=[Vertex vertex_1764063775281_0133_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, java.util.concurrent.ExecutionException: org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:592) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:571) at com.google.common.util.concurrent.FluentFuture$TrustedFuture.get(FluentFuture.java:91) at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializerWrappers(RootInputInitializerManager.java:140) at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:111) at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:4147) at org.apache.tez.dag.app.dag.impl.VertexImpl.access$3100(VertexImpl.java:210) Caused by: java.lang.ExceptionInInitializerError at org.apache.hadoop.hive.ql.plan.TableDesc.setProperties(TableDesc.java:131) at org.apache.hadoop.hive.ql.plan.TableDesc.<init>(TableDesc.java:69) at org.apache.hadoop.hive.ql.exec.Utilities.<clinit>(Utilities.java:706) at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.<init>(HiveSplitGenerator.java:150) ... 21 more
... View more
Labels:
11-23-2025
10:49 PM
Hi Kshitij Upadhyay, Thanks, >> Could you please confirm the exact upgrade path you followed? Was it for CDP or CM? 7.1.9 runtime 7.11.3 CM upgraded to 7.3.1 runtime 7.13.1 CM i will collect other information as well
... View more
11-23-2025
04:55 AM
I am facing below error all jobs are failing because of this. this is the error give guidance why it occurs because of this error all jobs failed also please share what other relevant information needed. Data integration service failed to create DIM instance because of the following error: jave.lang runtime exception java.IOException [error while authentication with endpoint. https://sitlxdvdlap097/kms/v1?op=GETDELEGATIONTOKEN&doAs=k164prda&renewer=K164PRDA%40SAIBSIT.COM] AUTHENTICATION FAILED, URL https://sitlxdvdlap097.saibsit.com:9494/kms/v1/?op==GETDELEGATIONTOKEN&doAs=k164prda&re newer==K164PRDA%40SAIBSIT.COM&user.name=K164PRDA, status=403 message: null ]
... View more
- Tags:
- KMS
Labels:
- Labels:
-
Apache Ranger
-
Cloudera on premises
11-23-2025
04:51 AM
Hi everyone, Can i have something for Cloudera CDP 7.3.1 sandbox and practice env for deploying and upgrade. and other tasks like adding data services. Please do let me know
... View more
Labels:
- Labels:
-
Cloudera on premises