Member since
06-16-2021
18
Posts
0
Kudos Received
0
Solutions
01-30-2023
06:17 PM
When I start restart Master is OK. but after 10s Master is shutdown. I don't see error in log. I only find CDH 6.3.2 enable kerberos
... View more
Labels:
- Labels:
-
Apache HBase
11-03-2021
05:37 PM
@ChethanYM thanks
... View more
11-01-2021
05:57 PM
in my Submission Access Control of Impala Admission Control I don't have any options,I can't select any options. in impala pool only have "Everyone is allowed to submit to this pool because of inherited settings.from the parent pools" but my root of yarn pool is "allow these users and groups to submit to pool" see my images I want to know in Submission Access Control of Impala Admission Control how can I have that two options?
... View more
10-31-2021
09:39 PM
In yarn
Impala Admission Control
... View more
Labels:
- Labels:
-
Apache Impala
-
Apache YARN
09-09-2021
11:22 PM
I increase heap size Java Heap Size of HBase RegionServer from 50m to 80m but I aslo use jdbc to connect Class. forName ( "org.apache.phoenix.jdbc.PhoenixDriver" ) ; Connection connection = DriverManager. getConnection (" jdbc:phoenix:bigdser5:/hbase ") ; getConnection is block
... View more
09-08-2021
05:43 PM
CDH 6.3.2
PHOENIX-5.0.0-cdh6.2.0.p0.1308267
add service phoenix
<property>
<name>hbase.regionserver.wal.codec</name>
<value>org.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec</value>
</property>
<property>
<name>phoenix.functions.allowUserDefinedFunctions</name>
<value>true</value>
<description>enable UDF functions</description>
</property>
adv service and adv client
set phoenix.schema.mapSystemTablesToNamespace=true
set phoenix.schema.isNamespaceMappingEnabled=true
when I run phoenix-sqlline
hbase region is OutOfMemory
2021-09-09T11:43:01.362+0800: [GC (CMS Initial Mark) [1 CMS-initial-mark: 34175K(34176K)] 48788K(49536K), 0.0309811 secs] [Times: user=0.04 sys=0.01, real=0.03 secs]
2021-09-09T11:43:01.393+0800: [CMS-concurrent-mark-start]
2021-09-09T11:43:01.398+0800: [Full GC (Allocation Failure) 2021-09-09T11:43:01.398+0800: [CMS2021-09-09T11:43:01.414+0800: [CMS-concurrent-mark: 0.018/0.020 secs] [Times: user=0.18 sys=0.00, real=0.02 secs]
(concurrent mode failure): 34175K->34175K(34176K), 0.2619832 secs] 49203K->48771K(49536K), [Metaspace: 68808K->68808K(1112064K)], 0.2621194 secs] [Times: user=0.38 sys=0.00, real=0.26 secs]
2021-09-09T11:43:01.663+0800: [Full GC (Allocation Failure) 2021-09-09T11:43:01.663+0800: [CMS: 34175K->34175K(34176K), 0.2232891 secs] 49535K->48937K(49536K), [Metaspace: 68811K->68811K(1112064K)], 0.2234088 secs] [Times: user=0.22 sys=0.00, real=0.22 secs]
2021-09-09T11:43:01.887+0800: [GC (CMS Initial Mark) [1 CMS-initial-mark: 34175K(34176K)] 48937K(49536K), 0.0326199 secs] [Times: user=0.04 sys=0.00, real=0.03 secs]
2021-09-09T11:43:01.920+0800: [CMS-concurrent-mark-start]
2021-09-09T11:43:01.927+0800: [Full GC (Allocation Failure) 2021-09-09T11:43:01.927+0800: [CMS2021-09-09T11:43:01.944+0800: [CMS-concurrent-mark: 0.023/0.025 secs] [Times: user=0.26 sys=0.01, real=0.03 secs]
(concurrent mode failure): 34175K->34175K(34176K), 0.2658440 secs] 49535K->48922K(49536K), [Metaspace: 68819K->68819K(1112064K)], 0.2659855 secs] [Times: user=0.40 sys=0.00, real=0.27 secs]
2021-09-09T11:43:02.201+0800: [Full GC (Allocation Failure) 2021-09-09T11:43:02.201+0800: [CMS: 34175K->34175K(34176K), 0.2263622 secs] 49535K->48954K(49536K), [Metaspace: 68830K->68830K(1112064K)], 0.2265067 secs] [Times: user=0.23 sys=0.00, real=0.22 secs]
2021-09-09T11:43:02.428+0800: [GC (CMS Initial Mark) [1 CMS-initial-mark: 34175K(34176K)] 48955K(49536K), 0.0318545 secs] [Times: user=0.04 sys=0.01, real=0.03 secs]
2021-09-09T11:43:02.460+0800: [CMS-concurrent-mark-start]
2021-09-09T11:43:02.467+0800: [Full GC (Allocation Failure) 2021-09-09T11:43:02.467+0800: [CMS2021-09-09T11:43:02.484+0800: [CMS-concurrent-mark: 0.022/0.023 secs] [Times: user=0.23 sys=0.00, real=0.03 secs]
(concurrent mode failure): 34175K->34175K(34176K), 0.2410237 secs] 49432K->49067K(49536K), [Metaspace: 68830K->68830K(1112064K)], 0.2411725 secs] [Times: user=0.36 sys=0.00, real=0.24 secs]
2021-09-09T11:43:02.709+0800: [Full GC (Allocation Failure) 2021-09-09T11:43:02.709+0800: [CMS: 34175K->34175K(34176K), 0.1938236 secs] 49067K->49059K(49536K), [Metaspace: 68830K->68830K(1112064K)], 0.1939479 secs] [Times: user=0.20 sys=0.00, real=0.20 secs]
java.lang.OutOfMemoryError: Java heap space
Dumping heap to /tmp/hbase_hbase-REGIONSERVER-da84ee7c6c5955f30c908d6d3c80fc67_pid19562.hprof ...
Heap dump file created [89278215 bytes in 0.692 secs]
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p
/opt/cloudera/cm-agent/service/common/killparent.sh"
# Executing /bin/sh -c "kill -9 19562
/opt/cloudera/cm-agent/service/common/killparent.sh"...
... View more
Labels:
07-21-2021
08:36 PM
my openldap can anonymous access I remove hadoop.security.group.mapping.ldap.bind.user hadoop.security.group.mapping.ldap.bind.password that I don't get WARN
... View more
07-21-2021
12:49 AM
in log I can see ./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:23:44,433 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hive) returned [hive]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:24:02,669 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(impala) returned [hive, impala]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:24:06,305 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(oozie) returned [oozie]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:24:45,912 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(jztwk) returned [jztwk, admin]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:24:54,996 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(yarn) returned [hadoop, spark, yarn]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:25:04,573 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hue) returned [hue]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:27:29,074 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hdfs) returned [hadoop, hdfs]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:27:53,362 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(mapred) returned [hadoop, mapred]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:28:14,267 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hbase) returned [hbase]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:28:15,444 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(spark) returned [spark]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:29:43,423 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(oozie) returned [oozie]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:30:02,530 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(impala) returned [hive, impala]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:30:04,808 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hue) returned [hue]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:32:30,027 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hdfs) returned [hadoop, hdfs]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:33:03,374 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(mapred) returned [hadoop, mapred]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:33:14,274 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hbase) returned [hbase]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:33:16,064 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(spark) returned [spark]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:34:48,481 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(oozie) returned [oozie]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:35:04,814 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hue) returned [hue]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:36:02,528 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(impala) returned [hive, impala]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:36:46,230 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(jztwk) returned [jztwk, admin]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:37:30,043 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hdfs) returned [hadoop, hdfs]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:37:39,400 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hive) returned [hive]
./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.out:2021-07-21 15:38:14,291 DEBUG org.apache.hadoop.security.LdapGroupsMapping: doGetGroups(hbase) returned [hbase]
... View more
07-21-2021
12:11 AM
I give every node all creds.localjceks "chmod a+r" I don't find Caused by: java.io.FileNotFoundException: /var/run/cloudera-scm-agent/process/5182-yarn-NODEMANAGER/creds.localjceks (Permission denied) but I aslo get WARN security.LdapGroupsMapping: Failed to get groups for user jztwk (retry=1) by javax.naming.OperationNotSupportedException: [LDAP: error code 53 - unauthenticated bind (DN with no password) disallowed]
... View more
07-20-2021
07:57 PM
2021-07-21 10:16:13,691 WARN [main] org.apache.hadoop.security.LdapGroupsMapping: Exception while trying to get password for alias hadoop.security.group.mapping.ldap.bind.password:
java.io.IOException: Configuration problem with provider path.
at org.apache.hadoop.conf.Configuration.getPasswordFromCredentialProviders(Configuration.java:2272)
at org.apache.hadoop.conf.Configuration.getPassword(Configuration.java:2191)
at org.apache.hadoop.security.LdapGroupsMapping.getPassword(LdapGroupsMapping.java:719)
at org.apache.hadoop.security.LdapGroupsMapping.setConf(LdapGroupsMapping.java:616)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
at org.apache.hadoop.security.Groups.<init>(Groups.java:106)
at org.apache.hadoop.security.Groups.<init>(Groups.java:102)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:451)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:352)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:314)
at org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:1973)
at org.apache.hadoop.security.UserGroupInformation.createLoginUser(UserGroupInformation.java:743)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:693)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:604)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.main(ContainerLocalizer.java:461)
Caused by: java.io.FileNotFoundException: /var/run/cloudera-scm-agent/process/5182-yarn-NODEMANAGER/creds.localjceks (Permission denied)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at org.apache.hadoop.security.alias.LocalJavaKeyStoreProvider.getInputStreamForFile(LocalJavaKeyStoreProvider.java:83)
at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321)
at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.<init>(AbstractJavaKeyStoreProvider.java:86)
at org.apache.hadoop.security.alias.LocalJavaKeyStoreProvider.<init>(LocalJavaKeyStoreProvider.java:58)
at org.apache.hadoop.security.alias.LocalJavaKeyStoreProvider.<init>(LocalJavaKeyStoreProvider.java:50)
at org.apache.hadoop.security.alias.LocalJavaKeyStoreProvider$Factory.createProvider(LocalJavaKeyStoreProvider.java:177)
at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73)
at org.apache.hadoop.conf.Configuration.getPasswordFromCredentialProviders(Configuration.java:2253)
... View more
07-20-2021
02:13 AM
I run hadoop with ldap
hadoop.security.group.mapping=org.apache.hadoop.security.LdapGroupsMapping
hadoop.security.group.mapping.ldap.bind.user=uid=ldapadmin,ou=people,dc=join,dc=com
hadoop.security.group.mapping.ldap.bind.password=00000
hadoop.security.group.mapping.ldap.base=dc=join,dc=com
hadoop.security.group.mapping.ldap.search.filter.user=(&(objectClass=posixAccount)(uid={0}))
hadoop.security.group.mapping.ldap.search.filter.group=(objectClass=posixGroup)
hadoop.security.group.mapping.ldap.search.attr.member=memberUid
hadoop.security.group.mapping.ldap.search.attr.group.name=cn
but I run spark,I get a WARN
(LdapGroupsMapping:290)2021-07-13 13:02:45,523 WARN - [pool-2-thread-4:] ~ Failed to get groups for user jztwk (retry=0) by javax.naming.OperationNotSupportedException: [LDAP: error code 53 - unauthenticated bind (DN with no password) disallowed]
and I ldapsearch -x -D "uid=ldapadmin,ou=people,dc=join,dc=com" -W -b "dc=join,dc=com"
can get result
hdfs groups yarn yarn : hadoop spark yarn
so How can I fix it
CDH 6.3.2
... View more
Labels:
06-27-2021
11:08 PM
Class.forName("com.cloudera.impala.jdbc41.Driver");
UserGroupInformation.setConfiguration(conf);
UserGroupInformation.loginUserFromKeytab(principal,keytabPath);
UserGroupInformation loginUser = UserGroupInformation.getLoginUser();
loginUser.doAs((PrivilegedAction<Void>) () -> {
try {
try (Connection connection = DriverManager.getConnection("jdbc:impala://tidb4ser:21051;AuthMech=1;KrbRealm=JOIN.COM;KrbHostFQDN=tidb4ser;KrbServiceName=impala;DelegationUID=read_hive")) {
try (Statement statement = connection.createStatement()) {
statement.execute("use hivetest");
ResultSet resultSet = statement.executeQuery("SELECT id,name,year FROM hivetest.chinese_par t where t.city='重庆'");
List dataList = resultSetToList(resultSet);
System.out.println(JSONObject.toJSON(dataList));
}catch (Exception err){
err.printStackTrace();
}
}
} catch (SQLException e) {
e.printStackTrace();
}
return null;
}); use ImpalaJDBC41 that is OK but I want use HIVE-JDBC
... View more
06-27-2021
09:48 PM
CDH 6.3.2 I use <dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-jdbc</artifactId>
<version>2.1.1-cdh6.3.2</version>
</dependency> I want proxy to user read_hi final String URL = "jdbc:hive2://tidb4ser:21051/;principal=impala/tidb4ser1@JOIN.COM;impala.doas.user=read_hi";
System.setProperty("java.security.krb5.conf",krb5Path);
Configuration conf = new Configuration();
conf.set("hadoop.security.authentication", "Kerberos");
UserGroupInformation.setConfiguration(conf);
UserGroupInformation.loginUserFromKeytab(principal,keytabPath);
Class.forName("org.apache.hive.jdbc.HiveDriver");
Connection connection = DriverManager.getConnection(URL);
Statement st = connection.createStatement();
st.execute("use hivetest");
ResultSet rs = st.executeQuery("SELECT id,name,year FROM hivetest.chinese_par t where t.city='重庆'"); but it dosen't work. I can use final String HIVE_URL = "jdbc:hive2://tidb4ser:11000/;principal=hive/tidb4ser1@JOIN.COM;hive.server2.proxy.user=read_hi"; to connect Hive so, How can I proxy user with impala Do I need use <dependency>
<groupId>com.cloudera.impala.jdbc</groupId>
<artifactId>ImpalaJDBC41</artifactId>
<version>2.6.20</version>
</dependency>
... View more
Labels:
- Labels:
-
Apache Impala
06-20-2021
06:56 PM
I use CDH 6.3.2
use oozie submit spark job,I get a error
.................................. at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141) Caused by: org.apache.hadoop.security.KerberosAuthException: failure to login: for principal: jztwk javax.security.auth.login.LoginException: Unable to obtain password from user at org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:1992) at org.apache.hadoop.security.UserGroupInformation.getUGIFromTicketCache(UserGroupInformation.java:649) ........................................ at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:93) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:104) at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60) ... 16 more Caused by: javax.security.auth.login.LoginException: Unable to obtain password from user
in Fixed Issues in CDH 6.3.3
I find
SPARK-29082 - [CORE] Skip delegation token generation if no credentials are available
so How can I fix it,only update to CDH 6.3.3
... View more
Labels:
06-17-2021
01:56 AM
cp /etc/hadoop/conf/hdfs-site.xml /opt/cloudera/parcels/CDH/etc/oozie/conf.dist/hadoop-conf/ I also get the same error
... View more
06-17-2021
01:38 AM
my job.properties nameNode=hdfs://nameservice1
jobTracker=bigdser3:8032
queueName=default
oozie.use.system.libpath=True
oozie.wf.application.path=${nameNode}/user/jztwk
security_enabled=True my workflow.xml <workflow-app name="Spark-example2" xmlns="uri:oozie:workflow:0.5">
<start to="SparkOozieAction1"/>
<action name="SparkOozieAction1">
<spark xmlns="uri:oozie:spark-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<master>yarn</master>
<mode>cluster</mode>
<name>Spark Example1</name>
<class>App</class>
<jar>JztCloudAnalyse.jar</jar>
<spark-opts>--jars hdfs://nameservice1/sparklib/*.jar --conf spark.executor.extraJavaOptions=-Dfile.encoding=UTF-8 --conf spark.driver.extraJavaOptions=-Dfile.encoding=UTF-8</spark-opts>
<arg>-r 10.3.87.31:7000,10.3.87.31:7001,10.3.87.32:7002,10.3.87.32:7003,10.3.87.36:7004,10.3.87.36:7005 -d 0 -k 22 -w http://10.3.87.49:8082/SendMsgApi.ashx -n JZTanalyse10_102 -h JZTanalyse -o jjj</arg>
<file>/user/jztwk/JztCloudAnalyse.jar#JztCloudAnalyse.jar</file>
</spark>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app> Run oozie manually ---- "menas without hue" it is also get the same error
... View more
06-17-2021
12:01 AM
I use CDH 6.3.2
hadoop is HA
I make a workflow with spark in hue
run workfolw I get a error
Failing Oozie Launcher, java.net.UnknownHostException: nameservice1 java.lang.IllegalArgumentException: java.net.UnknownHostException: nameservice1 at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:445) at org.apache.hadoop.hdfs.NameNodeProxiesClient.createProxyWithClientProtocol(NameNodeProxiesClient.java:132) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:351) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:285) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:168) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3237) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:123) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3286) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3254) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:478) at org.apache.spark.deploy.DependencyUtils$.org$apache$spark$deploy$DependencyUtils$$resolveGlobPath(DependencyUtils.scala:190) at org.apache.spark.deploy.DependencyUtils$$anonfun$resolveGlobPaths$2.apply(DependencyUtils.scala:146) at org.apache.spark.deploy.DependencyUtils$$anonfun$resolveGlobPaths$2.apply(DependencyUtils.scala:144) at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241) at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35) at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241) at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104) at org.apache.spark.deploy.DependencyUtils$.resolveGlobPaths(DependencyUtils.scala:144) at org.apache.spark.deploy.SparkSubmit$$anonfun$prepareSubmitEnvironment$3.apply(SparkSubmit.scala:355) at org.apache.spark.deploy.SparkSubmit$$anonfun$prepareSubmitEnvironment$3.apply(SparkSubmit.scala:355) at scala.Option.map(Option.scala:146) at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:355) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:143) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:926) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:935) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) at org.apache.oozie.action.hadoop.SparkMain.runSpark(SparkMain.java:186) at org.apache.oozie.action.hadoop.SparkMain.run(SparkMain.java:93) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:104) at org.apache.oozie.action.hadoop.SparkMain.main(SparkMain.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:410) at org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:55) at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:217) at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141) Caused by: java.net.UnknownHostException: nameservice1
in my hdfs-site.xml
<property>
<name>dfs.nameservices</name>
<value>nameservice1</value>
</property>
<property>
<name>dfs.client.failover.proxy.provider.nameservice1</name>
<value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
</property>
<property>
<name>dfs.ha.automatic-failover.enabled.nameservice1</name>
<value>true</value>
</property>
<property>
<name>ha.zookeeper.quorum</name>
<value>bigdser2:2181,bigdser3:2181,bigdser5:2181</value>
</property>
<property>
<name>dfs.ha.namenodes.nameservice1</name>
<value>namenode337,namenode369</value>
</property>
I can run workflow with hive in hue
and I can run spark-shell --jars hdfs://nameservice1/sparklib/*.jar
"hadoop fs -ls /user" works.
it just dose'nt work with oozie
so how can fix it.someone can helpe me.
... View more
Labels:
