question Re: No spark2 service in Ambari2.6.0.0 with HDP2.6.3.0 in Archives of Support Questions (Read Only)

No spark2 service in Ambari2.6.0.0 with HDP2.6.3.0

wanhaoran — Sun, 18 Aug 2019 04:39:09 GMT

After upgrading Ambari from 2.2.2 to 2.6.0.0 and HDP from 2.4.3 to 2.6.3.0, I tried adding service spark2. I followed this guide , tried to add new service but could not find spark2. I checked the services in Admin -> Stack and Version and No spark2 there but I found Spark2 in Admin -> Manage Ambari -> Versions -> HDP2.6.3.0. And hdp-select also shows spark2 is in hdp repo

By the way, I also tried install spark2 through yum install spark2-master spark2-python( I use python as main develop lang). But pyspark shows:

File "/usr/hdp/current/spark2-client/python/pyspark/shell.py", line 33, in <module>       
    from pyspark.sql import SparkSession, SQLContext                                          
ImportError: cannot import name SparkSession

If I can not install spark2 in Ambari, I want to use spark2-client at lest.

The screenshots following:

Re: No spark2 service in Ambari2.6.0.0 with HDP2.6.3.0

wanhaoran — Wed, 22 Nov 2017 15:11:54 GMT

Additional progress:

I use ambari rest api to add spark2 service. The http request return 200 and I can figure it out spark2 by get method. But after I restart ambari-server, it failed to startup.The log:

22 Nov 2017 14:57:25,693 ERROR [main] ClusterImpl:431 - Can not get service info: stackName=HDP, stackVersion=2.4, serviceName=SPARK2
...
org.apache.ambari.server.ServiceNotFoundException: Service not found, clusterName=solar, serviceName=SPARK2
        at org.apache.ambari.server.state.cluster.ClusterImpl.getService(ClusterImpl.java:864)       
        at org.apache.ambari.server.api.services.AmbariMetaInfo.reconcileAlertDefinitions(AmbariMetaInfo.java:1240)
        at org.apache.ambari.server.controller.AmbariServer.run(AmbariServer.java:532)              
        at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:1067)

The log show the HDP stackVersion=2.4, But I am sure that I install HDP2.6 in all nodes and hdp-select prove it. Maybe I can modify this HDP version check mistake?

Re: No spark2 service in Ambari2.6.0.0 with HDP2.6.3.0

wanhaoran — Thu, 23 Nov 2017 10:30:45 GMT

At last, I solved this problem:

I suspected the HDP version stored in postgres is wrong. So I modified these items:

delete from servicedesiredstate where service_name='SPARK2';
delete from clusterservices where service_name='SPARK2';
delete from alert_grouping where definition_id = 201;
delete from alert_grouping where definition_id = 202;
delete from alert_grouping where definition_id = 203;
delete from alert_definition where service_name = 'SPARK2';
select * from stack;
 stack_id | stack_name  |  stack_version  
----------+-------------+-----------------
        1 | HDP         | 2.0.6.GlusterFS
        2 | HDP         | 2.5
        3 | HDP         | 2.4
        4 | HDP         | 2.3.ECS
        5 | HDP         | 2.0.6
        6 | HDP         | 2.1.GlusterFS
        7 | HDP         | 2.3
        8 | HDP         | 2.3.GlusterFS
        9 | HDP         | 2.2
       10 | HDP         | 2.1
       11 | HDP         | 2.0
       51 | HDP         | 2.6
      101 | BigInsights | 4.2.5
      102 | BigInsights | 4.1
      103 | BigInsights | 4.0
      104 | BigInsights | 4.2
update clusters set desired_stack_id = 51 where cluster_id = 2;

Note that the digits above are referred to table alert_grouping and stack. So in my case, the desired_stack_id in table clusters was 3 (means HDP2.4). I updated it to 51(means HDP2.6) and corrected the undefined alert definition. At last the ambari server startup and recognize service Spark2 in HDP2.6.

If someone can offer more details in ambari-server metadata in database, it will be easier to locate a problem like this.