2018-07-10 08:20:23.966 INFO: [HIVE_1067] The Integration Service started running the Hive command [exec0_command_29] with the command line [!../../services/shared/bin/pmsuid infa /u02/informatica/10.1.1/services/shared/hadoop/hortonworks_2.3/scripts/FileCopyUtil --hadoop.home /u02/informatica/10.1.1/services/shared/hadoop/hortonworks_2.3 --hdfsUser svcmdb_sttrans --copyFromLocal --spn infa@DEVADMIN.DEV.CO.UK --keytab /u02/informatica/10.1.0/isp/config/keys/SVCINF1.keytab file:///u02/informatica/10.1.1/externaljdbcjars/readme.txt hdfs://HDPDEV01/apps/hive/warehouse/Sqoop_6715208368960744011/readme.txt] for the task [exec0]. 2018-07-10 08:20:26.234 INFO: [HIVE_1053] The Integration Service finished running the Hive task [exec0]. 2018-07-10 08:20:26.239 INFO: [HIVE_1052] The Integration Service started running the Hive task [exec1]. 2018-07-10 08:20:26.247 INFO: [HIVE_1063] A Hive session log [/u02/informatica/10.1.1/tomcat/bin/disTemp/hiveSession_m_idw_proc_stg_dynamic_sqoop_m_idw_proc_stg_dynamic_sqoop_11_3.log] was created for the task [exec1]. 2018-07-10 08:20:37.771 INFO: [HIVE_1120] The Integration Service started a Hive session [011a87cb-ad3f-4e4e-87cd-9b0df7bd83b6] for the task [exec1]. The Hive session history logging is disabled, session history will not be logged. 2018-07-10 08:20:37.786 INFO: [HIVE_1072] The Integration service initialized task [exec1]. 2018-07-10 08:20:37.788 INFO: [HIVE_1069] The Integration Service started running the Hive query [exec1_query_1] with the query [CREATE TEMPORARY FUNCTION infaNativeUDFCallDate AS 'com.informatica.platform.dtm.executor.hive.boot.udf.infanativeudf.InfaNativeUDFCallDate'] for the task [exec1]. 2018-07-10 08:20:37.838 INFO: [Hive task exec1] : OK 2018-07-10 08:20:37.843 INFO: [HIVE_1067] The Integration Service started running the Hive command [exec1_command_2] with the command line [ADD FILE file:///u02/informatica/10.1.1/tomcat/bin/disTemp/Write_ALIAS_ICL_UCB_UCBBOREXMASTER_STG1_MAPPING_125615620298755_125615649140858.bin] for the task [exec1]. 2018-07-10 08:20:37.882 INFO: [Hive task exec1] : Added resources: [file:///u02/informatica/10.1.1/tomcat/bin/disTemp/Write_ALIAS_ICL_UCB_UCBBOREXMASTER_STG1_MAPPING_125615620298755_125615649140858.bin] 2018-07-10 08:20:37.887 INFO: [HIVE_1069] The Integration Service started running the Hive query [exec1_query_3] with the query [CREATE TABLE w6715208368960744011_infa_write_alias_icl_ucb_ucbborexmaster_stg1_m_idw_proc_stg_dynamic_sqoop (col0 STRING, col1 BIGINT, col2 INT, col3 INT, col4 STRING, col5 TIMESTAMP, col6 DECIMAL(18, 2), col7 INT, col8 STRING, col9 STRING, col10 STRING, col11 STRING, col12 STRING, col13 STRING, col14 STRING, col15 STRING, col16 STRING, col17 DECIMAL(18, 2), col18 DECIMAL(28, 9), col19 STRING, col20 STRING, col21 INT, col22 INT, col23 INT, col24 STRING, col25 STRING, col26 STRING, col27 INT, col28 STRING, col29 DECIMAL(28, 9), col30 STRING, col31 STRING, col32 STRING, col33 DECIMAL(18, 4), col34 DECIMAL(18, 3), col35 STRING, col36 STRING, col37 INT, col38 TIMESTAMP, col39 STRING, col40 STRING, col41 DECIMAL(18, 2), col42 INT, col43 STRING, col44 STRING, col45 STRING, col46 STRING, col47 STRING, col48 STRING, col49 STRING, col50 STRING, col51 STRING, col52 STRING, col53 STRING, col54 STRING, col55 STRING, col56 STRING, col57 STRING, col58 STRING, col59 STRING, col60 INT, col61 INT, col62 STRING, col63 STRING, col64 STRING, col65 TIMESTAMP, col66 INT, col67 STRING, col68 STRING, col69 STRING, col70 STRING, col71 STRING, col72 STRING, col73 STRING, col74 STRING, col75 STRING, col76 TIMESTAMP, col77 TIMESTAMP, col78 INT, col79 INT, col80 INT, col81 INT, col82 TIMESTAMP, col83 TIMESTAMP, col84 STRING, col85 STRING, col86 TIMESTAMP) STORED BY 'com.informatica.platform.dtm.executor.hive.boot.storagehandler.INFAStorageHandler' LOCATION 'hdfs://HDPDEV01/apps/hive/warehouse/W6715208368960744011_infa_Write_ALIAS_ICL_UCB_UCBBOREXMASTER_STG1_m_idw_proc_stg_dynamic_sqoop' TBLPROPERTIES ('limit_mappers_reln'='true', 'pwx.mapping.file.path'='./Write_ALIAS_ICL_UCB_UCBBOREXMASTER_STG1_MAPPING_125615620298755_125615649140858.bin', 'pwx.skip.serialization'='true', 'auto.purge'='true')] for the task [exec1]. 2018-07-10 08:20:38.112 INFO: [Hive task exec1] : OK 2018-07-10 08:20:38.117 INFO: [HIVE_1069] The Integration Service started running the Hive query [exec1_query_4] with the query [INSERT OVERWRITE TABLE w6715208368960744011_infa_write_alias_icl_ucb_ucbborexmaster_stg1_m_idw_proc_stg_dynamic_sqoop VALUES ('', 1, 1, 1, '', NULL, NULL, 1, '', '', '', '', '', '', '', '', '', NULL, NULL, '', '', 1, 1, 1, '', '', '', 1, '', NULL, '', '', '', NULL, NULL, '', '', 1, NULL, '', '', NULL, 1, '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', 1, 1, '', '', '', NULL, 1, '', '', '', '', '', '', '', '', '', NULL, NULL, 1, 1, 1, 1, NULL, NULL, '', '', NULL)] for the task [exec1]. 2018-07-10 08:20:38.330 INFO: [Hive task exec1] : Query ID = infa_20180710082038_b7b7f57c-9f50-411d-a8fb-6ae55d806b3b 2018-07-10 08:20:38.335 INFO: [Hive task exec1] : Total jobs = 1 2018-07-10 08:20:38.341 INFO: [Hive task exec1] : Launching Job 1 out of 1 2018-07-10 08:20:45.884 INFO: [Hive task exec1] : 2018-07-10 08:20:46.143 INFO: [Hive task exec1] : Status: Running (Executing on YARN cluster with App id application_1529513609431_7352) 2018-07-10 08:20:46.148 INFO: [Hive task exec1] : Map 1: -/- 2018-07-10 08:20:46.354 INFO: [Hive task exec1] : Map 1: 0/1 2018-07-10 08:20:49.380 INFO: [Hive task exec1] : Map 1: 0/1 2018-07-10 08:20:50.993 INFO: [Hive task exec1] : Map 1: 0(+1)/1 2018-07-10 08:20:54.014 INFO: [Hive task exec1] : Map 1: 0(+1)/1 2018-07-10 08:20:57.033 INFO: [Hive task exec1] : Map 1: 0(+1)/1 2018-07-10 08:21:00.056 INFO: [Hive task exec1] : Map 1: 0(+1)/1 2018-07-10 08:21:03.080 INFO: [Hive task exec1] : Map 1: 0(+1)/1 2018-07-10 08:21:06.104 INFO: [Hive task exec1] : Map 1: 0(+1)/1 2018-07-10 08:21:09.129 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:12.155 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:15.183 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:18.208 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:21.231 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:24.255 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:27.281 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:30.308 INFO: [Hive task exec1] : Map 1: 0(+1,-1)/1 2018-07-10 08:21:30.515 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:33.538 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:36.562 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:39.584 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:42.602 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:45.621 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:48.641 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:51.663 INFO: [Hive task exec1] : Map 1: 0(+1,-2)/1 2018-07-10 08:21:52.874 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:21:55.898 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:21:58.920 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:22:01.942 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:22:04.962 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:22:07.980 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:22:10.998 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:22:14.017 INFO: [Hive task exec1] : Map 1: 0(+1,-3)/1 2018-07-10 08:22:14.232 INFO: [Hive task exec1] : Map 1: 0(+0,-4)/1 2018-07-10 08:22:14.438 INFO: [Hive task exec1] : Status: Failed 2018-07-10 08:22:14.443 INFO: [Hive task exec1] : Vertex failed, vertexName=Map 1, vertexId=vertex_1529513609431_7352_1_00, diagnostics=[Task failed, taskId=task_1529513609431_7352_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Hive Runtime Error while closing operators at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:171) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:137) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:179) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:171) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:171) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:167) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: Hive Runtime Error while closing operators at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:335) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:162) ... 14 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: Mapping execution failed with the following error: Exception Class: [java.lang.IllegalArgumentException] Exception Message: [java.net.UnknownHostException: HDPDEV01]. java.lang.IllegalArgumentException: java.net.UnknownHostException: HDPDEV01 at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:411) at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310) at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176) at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:678) at org.apache.hadoop.hdfs.DFSClient.(DFSClient.java:619) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2722) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at com.informatica.platform.dtm.executor.hadoop.fs.impl.FilePathImpl.getFileSystem(FilePathImpl.java:61) at com.informatica.platform.dtm.executor.hadoop.security.HadoopSecurityUtil$NewFSHandler.run(HadoopSecurityUtil.java:747) at com.informatica.platform.dtm.executor.hadoop.security.HadoopSecurityUtil$NewFSHandler.run(HadoopSecurityUtil.java:1) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at com.informatica.platform.dtm.executor.hadoop.impl.AbstractIUserGroupInformationImpl.doAs(AbstractIUserGroupInformationImpl.java:117) at com.informatica.platform.dtm.executor.hadoop.security.HadoopSecurityUtil.newFileSystem(HadoopSecurityUtil.java:225) at com.infa.adapter.sqoop.runtime.adapter.SqoopCommandUtils.(SqoopCommandUtils.java:131) at com.infa.adapter.sqoop.runtime.adapter.SqoopDSOAdapter.initDataSourceOperation(SqoopDSOAdapter.java:89) Caused by: java.net.UnknownHostException: HDPDEV01 ... 19 more