Member since
09-28-2018
8
Posts
0
Kudos Received
0
Solutions
11-01-2018
08:59 PM
I'm also having same issue. all time outs are set right in hbase_site.xml on the ambari server however zeppelin job always times out at 60sec
... View more
10-25-2018
03:05 AM
I upgraded my smartsense from 1.3 to 1.4.5 and since then the server starts but dies immediately. all I see in the hst-server.log are below DEBUG 2018-10-24 16:49:06,227 shell.py:56 - export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; DEBUG 2018-10-24 16:49:06,227 shell.py:74 - ['/bin/bash', '-c', 'export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; /usr/local/java/bin/java -version'] INFO 2018-10-24 16:49:06,343 hst-server.py:367 - Generating anonymization keys DEBUG 2018-10-24 16:49:06,344 shell.py:56 - export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; DEBUG 2018-10-24 16:49:06,344 shell.py:74 - ['/bin/bash', '-c', 'export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; /usr/local/java/bin/java -version'] DEBUG 2018-10-24 16:49:06,404 hst-server.py:383 - java command: /usr/local/java/bin/java -cp :/etc/hst/conf/:/usr/hdp/share/hst/hst-common/lib/* com.hortonworks.support.tools.server.keygen.MaskKeyGenerator DEBUG 2018-10-24 16:49:06,404 shell.py:56 - export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; DEBUG 2018-10-24 16:49:06,404 shell.py:74 - ['/bin/bash', '-c', 'export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; /usr/local/java/bin/java -cp :/etc/hst/conf/:/usr/hdp/share/hst/hst-common/lib/* com.hortonworks.support.tools.server.keygen.MaskKeyGenerator'] INFO 2018-10-24 16:49:06,790 hst-server.py:374 - Generated anonymization keys. DEBUG 2018-10-24 16:49:06,891 shell.py:56 - export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; DEBUG 2018-10-24 16:49:06,891 shell.py:74 - ['/bin/bash', '-c', 'export PATH=$PATH:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin: ;export LANG="${LANG:-en_US.UTF-8}"; /usr/local/java/bin/java -version'] 2018-10-24 16:49:10,960WARN [Thread-3] ConfigChangeListener:155 - Creating a patch 2018-10-24 16:49:11,058INFO [Thread-3] ConfigChangeListener:236 - Patch created : /var/lib/smartsense/hst-server/updates/upload/config-update.tgz
... View more
Labels:
- Labels:
-
Hortonworks SmartSense
10-04-2018
11:32 PM
while starting hst server i'm getting following error. p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff}
p.p2 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff; min-height: 13.0px}
span.s1 {font-variant-ligatures: no-common-ligatures} root@xxxx:~# hst start Upgrading database... SmartSense Server is not running Failed to upgrade server.Please try again or for more details refer tofile /var/log/hst/hst-server.out root@xxx:~# vim /var/log/hst/hst-server.out Thu Oct 04 15:43:07 PDT 2018 Thread[main,5,main] java.io.FileNotFoundException: derby.log (Permission denied) Thu Oct 04 15:43:07 PDT 2018 Thread[main,5,main] Cleanup action starting java.sql.SQLException: Failed to start database '/var/lib/smartsense/hst-server/hstDB' with class loader sun.misc.Launcher$AppClassLoader@7291c18f, see the next exception for details. at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection30.<init>(Unknown Source) at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:270) at com.hortonworks.support.tools.server.upgrade.orm.DBAccessorImpl.newConnection(DBAccessorImpl.java:73) at com.hortonworks.support.tools.server.upgrade.orm.DBAccessorImpl.connect(DBAccessorImpl.java:92) at com.hortonworks.support.tools.server.upgrade.UpgradeManager.initDatabase(UpgradeManager.java:83) at com.hortonworks.support.tools.server.upgrade.UpgradeManager.run(UpgradeManager.java:47) at com.hortonworks.support.tools.server.upgrade.UpgradeManager.main(UpgradeManager.java:219) Caused by: java.sql.SQLException: Failed to start database '/var/lib/smartsense/hst-server/hstDB' with class loader sun.misc.Launcher$AppClassLoader@7291c18f, see the next exception for details. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) ... 17 more Caused by: java.sql.SQLException: Another instance of Derby may have already booted the database /var/lib/smartsense/hst-server/hstDB. at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source) at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source) at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source) at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source) ... 14 more Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /var/lib/smartsense/hst-server/hstDB. at org.apache.derby.iapi.error.StandardException.newException(Unknown Source) at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown Source) at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown Source) at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown Source) at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown Source) at org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown Source) at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown Source) at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown Source) at org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown Source) at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown Source) at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown Source) at org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown Source) at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown Source) at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown Source) at org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown Source) at org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown Source)
... View more
- Tags:
- hst-server
Labels:
- Labels:
-
Hortonworks SmartSense
10-03-2018
08:04 PM
that explains why the HDP stack version was set to 3.0 in file. I moved forward by commenting the logfeeder module import as i don't have logsearch service added in Ambari UI. And my hst_server is up now. Are you saying this is a wrong way and I must use Ambari 2.7? hope my HDP 2.5 still stands valid
... View more
10-03-2018
07:09 PM
I upgraded smart sense from 1.4 to 1.5 on Ambari 2.4, hdp 2.5 but when i try to start the hst server from ambari ui, it thriws error below. Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.5/services/SMARTSENSE/package/scripts/hst_server.py", line 10, in <module>
from hst_script import HSTScript
File "/var/lib/ambari-agent/cache/stacks/HDP/2.5/services/SMARTSENSE/package/scripts/hst_script.py", line 14, in <module>
from resource_management.libraries.functions.generate_logfeeder_input_config import generate_logfeeder_input_config ImportError: No module named generate_logfeeder_input_config
... View more
Labels:
- Labels:
-
Hortonworks SmartSense
09-28-2018
09:32 PM
No I didn't. I fixed the error by adding the correct supported version into hst-server.py file however now stuck in another place. so decided to uninstall and reinstall smartsense and while doing that, adding services from Ambari UI gets stuck in Loading state in the Customized service step and the app.js is showing following STATEMANAGER: Sending event 'next' to state root.main.serviceAdd.step2. vendor.js:17347:18
STATEMANAGER: Entering root.main.serviceAdd.step3 vendor.js:17584:18
Status code 200: Success. app.js:53833:3
Ajax loading time: config.validations [/stacks/HDP/versions/2.5/validations]: 1577.000ms app.js:178470:11
STATEMANAGER: Sending event 'next' to state root.main.serviceAdd.step3. vendor.js:17347:18
mergeBlueprints: 3ms app.js:168444:5
mergeBlueprints: 1ms app.js:168444:5
mergeBlueprints: 2ms app.js:168444:5
Status code 202: Success for creation. app.js:53836:5
Status code 200: Success.
app.js:53833:3
Status code 200: Success.
app.js:53833:3
Ajax loading time: config.validations [/stacks/HDP/versions/2.5/validations]: 1021.000ms app.js:178470:11
STATEMANAGER: Entering root.main.serviceAdd.step4 vendor.js:17584:18
Status code 202: Success for creation. app.js:53836:5
Status code 202: Success for creation. app.js:53836:5
Status code 200: Success. app.js:53833:3
App.stackConfigPropertiesMapper execution time: 12ms app.js:55567:5
Status code 200: Success.
app.js:53833:3
Status code 200: Success. app.js:53833:3
Metrics with name "jvm.JvmMetrics.GcCount._rate" not found to compute expression app.js:200205:11
Metrics with name "jvm.JvmMetrics.GcCountConcurrentMarkSweep._rate" not found to compute expression app.js:200205:11
Metrics with name "jvm.JvmMetrics.GcTimeMillisConcurrentMarkSweep._rate" not found to compute expression app.js:200205:11
Metrics with name "rpc.rpc.client.NumOpenConnections" not found to compute expression app.js:200205:11
Metrics with name "rpc.rpc.datanode.NumOpenConnections" not found to compute expression app.js:200205:11
Metrics with name "jvm.JvmMetrics.MemHeapCommittedM" not found to compute expression app.js:200205:11
Metrics with name "jvm.JvmMetrics.MemHeapUsedM" not found to compute expression app.js:200205:11
Metrics with name "rpc.rpc.client.RpcQueueTimeAvgTime" not found to compute expression app.js:200205:11
Metrics with name "rpc.rpc.client.RpcProcessingTimeAvgTime" not found to compute expression app.js:200205:11
Metrics with name "rpc.rpc.datanode.RpcQueueTimeAvgTime" not found to compute expression app.js:200205:11
Metrics with name "rpc.rpc.datanode.RpcProcessingTimeAvgTime" not found to compute expression app.js:200205:11
Status code 200: Success. app.js:53833:3
_refreshGraph: 25ms app.js:183939:5
Status code 200: Success. app.js:53833:3
Status code 200: Success. app.js:53833:3
App.stackConfigPropertiesMapper execution time: 137ms app.js:55567:5
Status code 200: Success. app.js:53833:3
Ajax loading time: configs.stack_configs.load.services [/stacks/HDP/versions/2.5/services?StackServices/service_name.in(HDFS,YARN,MAPREDUCE2,TEZ,HIVE,PIG,OO]: 1701.000ms app.js:178470:11
uncaught exception: Error: <DS.StateManager:ember18145> could not respond to event setProperty in state rootState.loading.
Status code 202: Success for creation. app.js:53836:5
Status code 200: Success. app.js:53833:3
Status code 200: Success. app.js:53833:3
Status code 200: Success. app.js:53833:3
Status code 200: Success.
... View more
09-28-2018
03:15 AM
I managed to move forward by changing the supported_stacks_versions in file hst-server.py to 2.4 as mine had 3.0 for HDP (don't know how) however now ambari-server start fails with DB consistency check and the error i get is 018-09-27 17:42:43,502 ERROR - Required config(s): product-info is(are) not available for service SMARTSENSE with service config version 13 in cluster Any thoughts?
... View more
09-28-2018
03:15 AM
I'm trying to upgrade smartsense to the latest 1.5 version on Ambari 2.4.2.0 and it fails with following. hst upgrade-ambari-service Starting SmartSense Ambari service upgrade ERROR: Failed to install SmartSense service definition into ambari Error code:1 Error stdout:ERROR: Failed to find any supported stack versions. Error stderr:
... View more
Labels:
- Labels:
-
Hortonworks SmartSense