Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

atlas webui is not accessible

avatar
New Contributor

Dear,

I am getting the below error on atlas role log, kindly support.

how to know if the vertex_index exists?

 

GraphBackedSearchIndexer.initialize() failed (GraphBackedSearchIndexer:376)
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://xxxxxxxxxxxxxx:8993/solr: Can not find the specified config set: vertex_index
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:668)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
	at 

 

Regards,

1 ACCEPTED SOLUTION

avatar
Contributor

Please follow the below mentioned steps whenever you face such issue:

Cloudera Manager provides Atlas action option to initialize Atlas, which creates all the required backend resources HBase table, Solr collection and Kafka topics.

  1. Navigate to Atlas from the Cloudera Manager UI. 
  2. Under actions, the Initialize Atlas option appears. Initiate it; it will create the required resources. 
  3. Once done, verify the Altas UI.

 

If the issue is still not resolved, perform the following steps:

 

  1. Login to Solr host and kinit with Solr principal as follows:
    1. # klist -kt /var/run/cloudera-scm-agent/process/XXX-solr-SOLR_SERVER/solr.keytab
      # kinit -kt /var/run/cloudera-scm-agent/process/XXX-solr-SOLR_SERVER/solr.keytab solr/host_name.principal.com@COE.CLOUDERA.COM
  2. Delete the /solr and /solr-infra znodes using Zookeeper client. Do the following:
    1. #/opt/cloudera/parcels/CDH/bin/zookeeper-client
    2. # ls /
    3. [solr, solr-infra]
    4. # deleteall /solr
    5. # deleteall /solr-infra
    6. # ls / (should not show any solr or solr-infra znodes)
      While performing the above steps, if you face error as "Authentication is not valid : /solr-infra/security" or "Node not empty: /solr-infra/security/zkdtsm/ZKDTSMRoot", kindly perform the following steps, or else skip to Step 3.
    7. Temporarily disable ACL by setting 'zookeeper.skipACL=yes' in ZooKeeper's Java Advance configuration in Cloudera Manager
      1. Navigate to Cloudera Manager > Zookeeper Service
      2. In Configuration, add '-Dzookeeper.skipACL=yes' to Java Configuration Options for Zookeeper Server
      3. Restart ZooKeeper with the new configuration. Run the following:#export JAVA_HOME=/usr/java/jdk1.8.0
        #/opt/cloudera/parcels/CDH-X.X.X/lib/solr/server/scripts/cloud-scripts/zkcli.sh -cmd clear -z "localhost:2181" /solr-infra
         Repeat Step a
  3. Stop Solr service
  4. Execute Initialize Solr action from Solr service.
  5. Start Solr service
  6. Stop the Atlas service
  7. Execute Initialize Atlas action from Atlas service
  8. On Solr host, check if the following command returns the atlas_configs instancedir:
    #solrctl instancedir --list
  9. #sample output
  10. _default
  11. atlas_configs
  12. managedTemplate
    If it returns atlas_configs, skip this create command. If it does not return atlas_configs, execute the following create command:
    #solrctl instancedir --create atlas_configs /opt/cloudera/parcels/CDH/etc/atlas/conf.dist/solr/
  13. Check if the following command returns the edge_indexfulltext_index, and vertex_index collections:
    #solrctl collection --list.
  14. #sample output
  15. vertex_index (5)
  16. edge_index (5)
  17. fulltext_index (5)
    If it does return the 3 collections above, skip the create commands below. If it does not return the 3 collections above, execute the following commands:#solrctl collection --create edge_index -c atlas_configs -s 1 -r 1 -m 1
  18. #solrctl collection --create fulltext_index -c atlas_configs -s 1 -r 1 -m 1
  19. #solrctl collection --create vertex_index -c atlas_configs -s 1 -r 1 -m 1
  20. Start the Atlas service and bring up the UI.

For Reference:

https://my.cloudera.com/knowledge/quotError-from-server-at-httpsolr-hostapacheorg8993solr-Can?id=300...

https://community.cloudera.com/t5/Customer/ERROR-quot-Can-not-find-the-specified-config-set-vertex/t...

View solution in original post

1 REPLY 1

avatar
Contributor

Please follow the below mentioned steps whenever you face such issue:

Cloudera Manager provides Atlas action option to initialize Atlas, which creates all the required backend resources HBase table, Solr collection and Kafka topics.

  1. Navigate to Atlas from the Cloudera Manager UI. 
  2. Under actions, the Initialize Atlas option appears. Initiate it; it will create the required resources. 
  3. Once done, verify the Altas UI.

 

If the issue is still not resolved, perform the following steps:

 

  1. Login to Solr host and kinit with Solr principal as follows:
    1. # klist -kt /var/run/cloudera-scm-agent/process/XXX-solr-SOLR_SERVER/solr.keytab
      # kinit -kt /var/run/cloudera-scm-agent/process/XXX-solr-SOLR_SERVER/solr.keytab solr/host_name.principal.com@COE.CLOUDERA.COM
  2. Delete the /solr and /solr-infra znodes using Zookeeper client. Do the following:
    1. #/opt/cloudera/parcels/CDH/bin/zookeeper-client
    2. # ls /
    3. [solr, solr-infra]
    4. # deleteall /solr
    5. # deleteall /solr-infra
    6. # ls / (should not show any solr or solr-infra znodes)
      While performing the above steps, if you face error as "Authentication is not valid : /solr-infra/security" or "Node not empty: /solr-infra/security/zkdtsm/ZKDTSMRoot", kindly perform the following steps, or else skip to Step 3.
    7. Temporarily disable ACL by setting 'zookeeper.skipACL=yes' in ZooKeeper's Java Advance configuration in Cloudera Manager
      1. Navigate to Cloudera Manager > Zookeeper Service
      2. In Configuration, add '-Dzookeeper.skipACL=yes' to Java Configuration Options for Zookeeper Server
      3. Restart ZooKeeper with the new configuration. Run the following:#export JAVA_HOME=/usr/java/jdk1.8.0
        #/opt/cloudera/parcels/CDH-X.X.X/lib/solr/server/scripts/cloud-scripts/zkcli.sh -cmd clear -z "localhost:2181" /solr-infra
         Repeat Step a
  3. Stop Solr service
  4. Execute Initialize Solr action from Solr service.
  5. Start Solr service
  6. Stop the Atlas service
  7. Execute Initialize Atlas action from Atlas service
  8. On Solr host, check if the following command returns the atlas_configs instancedir:
    #solrctl instancedir --list
  9. #sample output
  10. _default
  11. atlas_configs
  12. managedTemplate
    If it returns atlas_configs, skip this create command. If it does not return atlas_configs, execute the following create command:
    #solrctl instancedir --create atlas_configs /opt/cloudera/parcels/CDH/etc/atlas/conf.dist/solr/
  13. Check if the following command returns the edge_indexfulltext_index, and vertex_index collections:
    #solrctl collection --list.
  14. #sample output
  15. vertex_index (5)
  16. edge_index (5)
  17. fulltext_index (5)
    If it does return the 3 collections above, skip the create commands below. If it does not return the 3 collections above, execute the following commands:#solrctl collection --create edge_index -c atlas_configs -s 1 -r 1 -m 1
  18. #solrctl collection --create fulltext_index -c atlas_configs -s 1 -r 1 -m 1
  19. #solrctl collection --create vertex_index -c atlas_configs -s 1 -r 1 -m 1
  20. Start the Atlas service and bring up the UI.

For Reference:

https://my.cloudera.com/knowledge/quotError-from-server-at-httpsolr-hostapacheorg8993solr-Can?id=300...

https://community.cloudera.com/t5/Customer/ERROR-quot-Can-not-find-the-specified-config-set-vertex/t...