Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Superset druid doesn't start

Highlighted

Superset druid doesn't start

New Contributor

Druid Superset doesn't start with Ambari 2.5.1 and HDP 2.6.1

I use standalone postgresql 9.6 database. The connection works fine.

The server is in redhat 6.8.

The command lanched by the script works fine without the "source" prefix of the command.

source /etc/superset/conf/superset-env.sh ; /usr/hdp/current/druid-superset/bin/superset init

Here is the error log :

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/DRUID/0.9.2/package/scripts/superset.py", line 169, in <module>
    Superset().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/DRUID/0.9.2/package/scripts/superset.py", line 108, in start
    self.configure(env, upgrade_type=upgrade_type)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 119, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/DRUID/0.9.2/package/scripts/superset.py", line 88, in configure
    user=params.druid_user)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'source /etc/superset/conf/superset-env.sh ; /usr/hdp/current/druid-superset/bin/superset init' returned 1. /usr/hdp/2.6.1.0-129/superset/lib/python3.4/importlib/_bootstrap.py:1161: ExtDeprecationWarning: Importing flask.ext.sqlalchemy is deprecated, use flask_sqlalchemy instead.
  spec.loader.load_module(spec.name)
/usr/hdp/2.6.1.0-129/superset/lib/python3.4/importlib/_bootstrap.py:1161: ExtDeprecationWarning: Importing flask.ext.script is deprecated, use flask_script instead.
  spec.loader.load_module(spec.name)
/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/flask_cache/__init__.py:152: UserWarning: Flask-Cache: CACHE_TYPE is set to null, caching is effectively disabled.
  warnings.warn("Flask-Cache: CACHE_TYPE is set to null, "
/usr/hdp/2.6.1.0-129/superset/lib/python3.4/importlib/_bootstrap.py:1161: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  spec.loader.load_module(spec.name)
2017-09-13 17:04:31,108:INFO:flask_appbuilder.base:Registering class MyIndexView on menu 
2017-09-13 17:04:31,122:INFO:flask_appbuilder.base:Registering class UtilView on menu 
2017-09-13 17:04:31,129:INFO:flask_appbuilder.base:Registering class LocaleView on menu 
2017-09-13 17:04:31,136:INFO:flask_appbuilder.base:Registering class ResetPasswordView on menu 
2017-09-13 17:04:31,176:INFO:flask_appbuilder.base:Registering class ResetMyPasswordView on menu 
2017-09-13 17:04:31,208:INFO:flask_appbuilder.base:Registering class UserInfoEditView on menu 
2017-09-13 17:04:31,241:INFO:flask_appbuilder.base:Registering class AuthDBView on menu 
2017-09-13 17:04:31,258:INFO:flask_appbuilder.base:Registering class UserDBModelView on menu List Users
2017-09-13 17:04:31,350:INFO:flask_appbuilder.base:Registering class RoleModelView on menu List Roles
2017-09-13 17:04:31,444:INFO:flask_appbuilder.base:Registering class UserStatsChartView on menu User's Statistics
2017-09-13 17:04:31,503:INFO:flask_appbuilder.base:Registering class PermissionModelView on menu Base Permissions
2017-09-13 17:04:31,570:INFO:flask_appbuilder.base:Registering class ViewMenuModelView on menu Views/Menus
2017-09-13 17:04:31,639:INFO:flask_appbuilder.base:Registering class PermissionViewModelView on menu Permission on Views/Menus
2017-09-13 17:04:32,664:INFO:flask_appbuilder.base:Registering class TableColumnInlineView on menu 
2017-09-13 17:04:32,730:INFO:flask_appbuilder.base:Registering class DruidColumnInlineView on menu 
2017-09-13 17:04:32,800:INFO:flask_appbuilder.base:Registering class SqlMetricInlineView on menu 
2017-09-13 17:04:32,868:INFO:flask_appbuilder.base:Registering class DruidMetricInlineView on menu 
2017-09-13 17:04:32,961:WARNING:flask_appbuilder.models.filters:Filter type not supported for column: password
2017-09-13 17:04:32,968:INFO:flask_appbuilder.base:Registering class DatabaseView on menu Databases
2017-09-13 17:04:33,134:WARNING:flask_appbuilder.models.filters:Filter type not supported for column: password
2017-09-13 17:04:33,139:INFO:flask_appbuilder.base:Registering class DatabaseAsync on menu 
2017-09-13 17:04:33,175:WARNING:flask_appbuilder.models.filters:Filter type not supported for column: password
2017-09-13 17:04:33,179:INFO:flask_appbuilder.base:Registering class DatabaseTablesAsync on menu 
2017-09-13 17:04:33,219:INFO:flask_appbuilder.base:Registering class TableModelView on menu Tables
2017-09-13 17:04:33,276:INFO:flask_appbuilder.base:Registering class AccessRequestsModelView on menu Access requests
2017-09-13 17:04:33,334:INFO:flask_appbuilder.base:Registering class DruidClusterModelView on menu Druid Clusters
2017-09-13 17:04:33,396:INFO:flask_appbuilder.base:Registering class SliceModelView on menu Slices
2017-09-13 17:04:33,447:INFO:flask_appbuilder.base:Registering class SliceAsync on menu 
2017-09-13 17:04:33,492:INFO:flask_appbuilder.base:Registering class SliceAddView on menu 
2017-09-13 17:04:33,541:INFO:flask_appbuilder.base:Registering class DashboardModelView on menu Dashboards
2017-09-13 17:04:33,601:INFO:flask_appbuilder.base:Registering class DashboardModelViewAsync on menu 
2017-09-13 17:04:33,654:INFO:flask_appbuilder.base:Registering class LogModelView on menu Action Log
2017-09-13 17:04:33,724:INFO:flask_appbuilder.base:Registering class QueryView on menu Queries
2017-09-13 17:04:33,797:INFO:flask_appbuilder.base:Registering class DruidDatasourceModelView on menu Druid Datasources
2017-09-13 17:04:33,869:INFO:flask_appbuilder.base:Registering class R on menu 
2017-09-13 17:04:33,879:INFO:flask_appbuilder.base:Registering class Superset on menu 
2017-09-13 17:04:34,055:INFO:flask_appbuilder.base:Registering class CssTemplateModelView on menu CSS Templates
2017-09-13 17:04:34,136:INFO:flask_appbuilder.base:Registering class CssTemplateAsyncModelView on menu 
2017-09-13 17:04:34,335:INFO:root:Syncing role definition
2017-09-13 17:04:34,352:INFO:root:Creating database reference
Loaded your LOCAL configuration
Traceback (most recent call last):
  File "/usr/hdp/current/druid-superset/bin/superset", line 85, in <module>
    manager.run()
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/flask_script/__init__.py", line 412, in run
    result = self.handle(sys.argv[0], sys.argv[1:])
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/flask_script/__init__.py", line 383, in handle
    res = handle(*args, **config)






  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/flask_script/commands.py", line 216, in __call__
    return self.run(*args, **kwargs)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/superset/cli.py", line 27, in init
    security.sync_role_definitions()
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/superset/security.py", line 122, in sync_role_definitions
    get_or_create_main_db()
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/superset/security.py", line 96, in get_or_create_main_db
    .filter_by(database_name='main')
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/query.py", line 2690, in first
    ret = list(self[0:1])
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/query.py", line 2482, in __getitem__
    return list(res)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/loading.py", line 90, in instances
    util.raise_from_cause(err)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/util/compat.py", line 187, in reraise
    raise value
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/loading.py", line 75, in instances
    rows = [proc(row) for row in fetch]
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/loading.py", line 75, in <listcomp>
    rows = [proc(row) for row in fetch]
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/loading.py", line 437, in _instance
    loaded_instance, populate_existing, populators)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/orm/loading.py", line 498, in _populate_full
    dict_[key] = getter(row)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy/sql/type_api.py", line 1122, in process
    return process_value(impl_processor(value), dialect)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy_utils/types/encrypted.py", line 261, in process_result_value
    decrypted_value = self.engine.decrypt(value)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/sqlalchemy_utils/types/encrypted.py", line 85, in decrypt
    decrypted = base64.b64decode(value)
  File "/usr/hdp/2.6.1.0-129/superset/lib/python3.4/base64.py", line 90, in b64decode
    return binascii.a2b_base64(s)
binascii.Error: Incorrect padding

this command works fine :

/etc/superset/conf/superset-env.sh ; /usr/hdp/current/druid-superset/bin/superset init

/usr/hdp/2.6.1.0-129/superset/lib/python3.4/importlib/_bootstrap.py:1161: ExtDeprecationWarning: Importing flask.ext.sqlalchemy is deprecated, use flask_sqlalchemy instead.
  spec.loader.load_module(spec.name)
/usr/hdp/2.6.1.0-129/superset/lib/python3.4/importlib/_bootstrap.py:1161: ExtDeprecationWarning: Importing flask.ext.script is deprecated, use flask_script instead.
  spec.loader.load_module(spec.name)
/usr/hdp/2.6.1.0-129/superset/lib/python3.4/site-packages/flask_cache/__init__.py:152: UserWarning: Flask-Cache: CACHE_TYPE is set to null, caching is effectively disabled.
  warnings.warn("Flask-Cache: CACHE_TYPE is set to null, "
/usr/hdp/2.6.1.0-129/superset/lib/python3.4/importlib/_bootstrap.py:1161: ExtDeprecationWarning: Importing flask.ext.cache is deprecated, use flask_cache instead.
  spec.loader.load_module(spec.name)
2017-09-13 17:37:37,086:WARNING:flask_appbuilder.security.manager:No user yet created, use fabmanager command to do it.
2017-09-13 17:37:37,087:INFO:flask_appbuilder.base:Registering class MyIndexView on menu
2017-09-13 17:37:37,092:INFO:flask_appbuilder.base:Registering class UtilView on menu
2017-09-13 17:37:37,096:INFO:flask_appbuilder.base:Registering class LocaleView on menu
2017-09-13 17:37:37,100:INFO:flask_appbuilder.base:Registering class ResetPasswordView on menu
2017-09-13 17:37:37,116:INFO:flask_appbuilder.base:Registering class ResetMyPasswordView on menu
2017-09-13 17:37:37,130:INFO:flask_appbuilder.base:Registering class UserInfoEditView on menu
2017-09-13 17:37:37,144:INFO:flask_appbuilder.base:Registering class AuthDBView on menu
2017-09-13 17:37:37,153:INFO:flask_appbuilder.base:Registering class UserDBModelView on menu List Users
2017-09-13 17:37:37,198:INFO:flask_appbuilder.base:Registering class RoleModelView on menu List Roles
2017-09-13 17:37:37,238:INFO:flask_appbuilder.base:Registering class UserStatsChartView on menu User's Statistics
2017-09-13 17:37:37,266:INFO:flask_appbuilder.base:Registering class PermissionModelView on menu Base Permissions
2017-09-13 17:37:37,300:INFO:flask_appbuilder.base:Registering class ViewMenuModelView on menu Views/Menus
2017-09-13 17:37:37,332:INFO:flask_appbuilder.base:Registering class PermissionViewModelView on menu Permission on Views/Menus
2017-09-13 17:37:38,205:INFO:flask_appbuilder.base:Registering class TableColumnInlineView on menu
2017-09-13 17:37:38,239:INFO:flask_appbuilder.base:Registering class DruidColumnInlineView on menu
2017-09-13 17:37:38,271:INFO:flask_appbuilder.base:Registering class SqlMetricInlineView on menu
2017-09-13 17:37:38,300:INFO:flask_appbuilder.base:Registering class DruidMetricInlineView on menu
2017-09-13 17:37:38,344:WARNING:flask_appbuilder.models.filters:Filter type not supported for column: password
2017-09-13 17:37:38,348:INFO:flask_appbuilder.base:Registering class DatabaseView on menu Databases
2017-09-13 17:37:38,447:WARNING:flask_appbuilder.models.filters:Filter type not supported for column: password
2017-09-13 17:37:38,450:INFO:flask_appbuilder.base:Registering class DatabaseAsync on menu
2017-09-13 17:37:38,477:WARNING:flask_appbuilder.models.filters:Filter type not supported for column: password
2017-09-13 17:37:38,480:INFO:flask_appbuilder.base:Registering class DatabaseTablesAsync on menu
2017-09-13 17:37:38,512:INFO:flask_appbuilder.base:Registering class TableModelView on menu Tables
2017-09-13 17:37:38,554:INFO:flask_appbuilder.base:Registering class AccessRequestsModelView on menu Access requests
2017-09-13 17:37:38,598:INFO:flask_appbuilder.base:Registering class DruidClusterModelView on menu Druid Clusters
2017-09-13 17:37:38,643:INFO:flask_appbuilder.base:Registering class SliceModelView on menu Slices
2017-09-13 17:37:38,679:INFO:flask_appbuilder.base:Registering class SliceAsync on menu
2017-09-13 17:37:38,708:INFO:flask_appbuilder.base:Registering class SliceAddView on menu
2017-09-13 17:37:38,737:INFO:flask_appbuilder.base:Registering class DashboardModelView on menu Dashboards
2017-09-13 17:37:38,776:INFO:flask_appbuilder.base:Registering class DashboardModelViewAsync on menu
2017-09-13 17:37:38,807:INFO:flask_appbuilder.base:Registering class LogModelView on menu Action Log
2017-09-13 17:37:38,850:INFO:flask_appbuilder.base:Registering class QueryView on menu Queries
2017-09-13 17:37:38,892:INFO:flask_appbuilder.base:Registering class DruidDatasourceModelView on menu Druid Datasources
2017-09-13 17:37:38,932:INFO:flask_appbuilder.base:Registering class R on menu
2017-09-13 17:37:38,938:INFO:flask_appbuilder.base:Registering class Superset on menu
2017-09-13 17:37:39,030:INFO:flask_appbuilder.base:Registering class CssTemplateModelView on menu CSS Templates
2017-09-13 17:37:39,072:INFO:flask_appbuilder.base:Registering class CssTemplateAsyncModelView on menu
2017-09-13 17:37:39,178:INFO:root:Syncing role definition
2017-09-13 17:37:39,187:INFO:root:Creating database reference
2017-09-13 17:37:39,193:INFO:root:sqlite:////home/druid/.superset/superset.db
2017-09-13 17:37:39,359:INFO:root:Syncing admin perms
2017-09-13 17:37:39,368:INFO:root:Syncing alpha perms
2017-09-13 17:37:39,376:INFO:root:Syncing gamma perms and public if specified
2017-09-13 17:37:39,387:INFO:root:Syncing sql_lab perms
2017-09-13 17:37:39,391:INFO:root:Syncing granter perms
2017-09-13 17:37:39,395:INFO:root:Making sure all data source perms have been created
2017-09-13 17:37:39,403:INFO:root:Making sure all database perms have been created
2017-09-13 17:37:39,415:INFO:root:Making sure all metrics perms exist

Any help be appreciated.

Thanks

PS : Sorry for my poor english

Don't have an account?
Coming from Hortonworks? Activate your account here