Member since
02-17-2020
4
Posts
0
Kudos Received
0
Solutions
05-12-2020
05:46 PM
Hi there, Our product based on CDP will be ship to our customers and install by customers. But we want to limit the access for some HDFS directories(predefined) so that customers can't access the directories even they install the whole thing in their private data center(not allowed to connect any external server). In other words, we give customers the permission to install the CDP, but keep them away to access some hidden HDFS files/directories, is it possible and how to do it? Regards, Yong
... View more
04-21-2020
04:52 PM
Hi there, I added Atlas in my CDP cluster, and find can't connect the web UI. In the application.log, I found the error: Can not find the specified config set: vertex_index. I followed the instruction in the following links, but still couldn't get it to work. Any suggestions? https://issues.apache.org/jira/browse/AMBARI-18368 https://community.cloudera.com/t5/Support-Questions/Atlas-UI-not-available-Service-Unavailable/td-p/132435 Here is the application.log: Atlas Server (STARTUP) project.name: apache-atlas project.description: Metadata Management and Data Governance Platform over Hadoop build.user: jenkins build.epoch: 1574150696506 project.version: 2.0.0.7.0.3.0-79 build.version: 2.0.0.7.0.3.0-79 vc.revision: cbb309de67ee0215efa0763f03c2f32f40f1d8f3 vc.source.url: scm:git:git://git.apache.org/atlas.git/atlas-webapp ######################################################################################## (Atlas:215) 2020-04-21 16:41:34,562 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:216) 2020-04-21 16:41:34,562 INFO - [main:] ~ Server starting with TLS ? false on port 31000 (Atlas:217) 2020-04-21 16:41:34,562 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:218) 2020-04-21 16:41:35,236 INFO - [main:] ~ No authentication method configured. Defaulting to simple authentication (LoginProcessor:102) 2020-04-21 16:41:35,315 WARN - [main:] ~ Unable to load native-hadoop library for your platform... using builtin-java classes where applicable (NativeCodeLoader:60) 2020-04-21 16:41:35,397 INFO - [main:] ~ Logged in user atlas (auth:SIMPLE) (LoginProcessor:77) 2020-04-21 16:41:36,202 INFO - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189) 2020-04-21 16:41:38,552 WARN - [main:] ~ given scan urls are empty. set urls in the configuration (Reflections:181) 2020-04-21 16:41:38,635 WARN - [main:] ~ org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config' (Krb5HttpClientBuilder:142) 2020-04-21 16:41:39,523 INFO - [main:] ~ ==> KafkaNotification() (KafkaNotification:105) 2020-04-21 16:41:39,524 INFO - [main:] ~ <== KafkaNotification() (KafkaNotification:137) 2020-04-21 16:41:39,562 INFO - [main:] ~ Creating indexes for graph. (GraphBackedSearchIndexer:286) 2020-04-21 16:41:40,629 INFO - [main:] ~ Created index : vertex_index (GraphBackedSearchIndexer:291) 2020-04-21 16:41:40,645 INFO - [main:] ~ Created index : edge_index (GraphBackedSearchIndexer:297) 2020-04-21 16:41:40,655 INFO - [main:] ~ Created index : fulltext_index (GraphBackedSearchIndexer:303) 2020-04-21 16:41:40,775 ERROR - [main:] ~ GraphBackedSearchIndexer.initialize() failed (GraphBackedSearchIndexer:353) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://xxx:8983/solr: Can not find the specified config set: vertex_index at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
... View more
04-18-2020
03:08 PM
The Atlas service was successfully installed and I could see the web UI port is open by using netstat. But I can't connect the Atlas Web UI(503 error), in the /var/log/atlas I didn't find any suspicious information as well. Any ideas why the web UI didn't work?
... View more
04-10-2020
05:56 PM
Hi,
Is it possible to config the builtin user name in case the name is conflict with existing users?
cloudera-scm:x:985:979:Cloudera Manager:/var/lib/cloudera-scm-server:/sbin/nologin
httpfs:x:984:977:Hadoop HTTPFS:/var/lib/hadoop-httpfs:/sbin/nologin
sqoop:x:983:976:Sqoop:/var/lib/sqoop:/sbin/nologin
kafka:x:982:975:Kafka:/var/lib/kafka:/sbin/nologin
yarn:x:981:974:Hadoop Yarn:/var/lib/hadoop-yarn:/sbin/nologin
hbase:x:980:973:HBase:/var/lib/hbase:/sbin/nologin
knox:x:979:972:Knox:/var/lib/knox:/bin/bash
hdfs:x:978:971:Hadoop HDFS:/var/lib/hadoop-hdfs:/sbin/nologin
livy:x:977:970:Livy:/var/lib/livy:/sbin/nologin
kms:x:976:969:Hadoop HDFS:/var/lib/hadoop-kms:/sbin/nologin
atlas:x:975:968:Atlas:/var/lib/atlas:/bin/bash
flume:x:974:967:Flume:/var/lib/flume-ng:/sbin/nologin
hue:x:973:966:Hue:/usr/lib/hue:/sbin/nologin
zookeeper:x:972:965:ZooKeeper:/var/lib/zookeeper:/sbin/nologin
accumulo:x:971:964:Accumulo:/var/lib/accumulo:/bin/bash
phoenix:x:970:963:Phoenix User:/var/lib/phoenix:/sbin/nologin
mapred:x:969:962:Hadoop MapReduce:/var/lib/hadoop-mapreduce:/sbin/nologin
druid:x:968:961:Druid:/var/lib/druid:/bin/bash
ranger:x:967:960:Ranger:/var/lib/ranger:/bin/bash
zeppelin:x:966:959:Zeppelin:/var/lib/zeppelin:/bin/bash
oozie:x:965:958:Oozie User:/var/lib/oozie:/sbin/nologin
kudu:x:964:957:Kudu:/var/lib/kudu:/sbin/nologin
spark:x:963:956:Spark:/var/lib/spark:/sbin/nologin
superset:x:962:955:Superset:/var/lib/superset:/bin/bash
solr:x:961:954:Solr:/var/lib/solr:/sbin/nologin
hive:x:960:953:Hive:/var/lib/hive:/sbin/nologin
impala:x:959:952:Impala:/var/lib/impala:/sbin/nologin
... View more
Labels:
