Member since
10-08-2015
108
Posts
62
Kudos Received
7
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4206 | 06-03-2017 12:11 AM | |
5479 | 01-24-2017 01:02 PM | |
6000 | 12-27-2016 11:38 AM | |
3254 | 12-20-2016 09:52 AM | |
2360 | 12-07-2016 02:15 AM |
11-29-2016
09:21 AM
do you use yarn-cluster mode ?
... View more
11-26-2016
03:12 AM
It is in the interpreter setting page, make sure you are using zeppelin of HDP, community version of zeppelin doesn't have this feature.
... View more
11-26-2016
03:07 AM
livy will use hive-site.xml under /etc/spark/conf. Make sure you have correct configuration in that file.
... View more
11-24-2016
06:23 AM
I use the following command to install kerborse in HDP sandbox 2.5, but fails with the following error. yum install krb5-server krb5-libs krb5-workstation -y Determining fastest mirrors
epel/metalink | 5.2 kB 00:00
* base: mirrors.btte.net
* epel: mirror01.idc.hinet.net
* extras: ftp.tc.edu.tw
* updates: ftp.tc.edu.tw
AMBARI.2.4.0.0-2.x | 2.9 kB 00:00
HDP-2.5 | 2.9 kB 00:00
HDP-SOLR-2.5-100 | 2.5 kB 00:00
HDP-SOLR-2.5-100/primary_db | 2.0 kB 00:00
HDP-UTILS-1.1.0.21 | 2.9 kB 00:00
base | 3.7 kB 00:00
epel | 4.3 kB 00:00
Traceback (most recent call last):
File "/usr/bin/yum", line 29, in <module>
yummain.user_main(sys.argv[1:], exit_code=True)
File "/usr/share/yum-cli/yummain.py", line 298, in user_main
errcode = main(args)
File "/usr/share/yum-cli/yummain.py", line 146, in main
result, resultmsgs = base.doCommands()
File "/usr/share/yum-cli/cli.py", line 440, in doCommands
return self.yum_cli_commands[self.basecmd].doCommand(self, self.basecmd, self.extcmds)
File "/usr/share/yum-cli/yumcommands.py", line 211, in doCommand
return base.installPkgs(extcmds)
File "/usr/share/yum-cli/cli.py", line 702, in installPkgs
self.install(pattern=arg)
File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 3551, in install
mypkgs = self.pkgSack.returnPackages(patterns=pats,
File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 907, in <lambda>
pkgSack = property(fget=lambda self: self._getSacks(),
File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 687, in _getSacks
self.repos.populateSack(which=repos)
File "/usr/lib/python2.6/site-packages/yum/repos.py", line 324, in populateSack
sack.populate(repo, mdtype, callback, cacheonly)
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 165, in populate
if self._check_db_version(repo, mydbtype):
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 223, in _check_db_version
return repo._check_db_version(mdtype)
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1261, in _check_db_version
repoXML = self.repoXML
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1460, in <lambda>
repoXML = property(fget=lambda self: self._getRepoXML(),
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1452, in _getRepoXML
self._loadRepoXML(text=self)
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1442, in _loadRepoXML
return self._groupLoadRepoXML(text, self._mdpolicy2mdtypes())
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1418, in _groupLoadRepoXML
self._commonRetrieveDataMD(mdtypes)
File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1349, in _commonRetrieveDataMD
os.rename(local, local + '.old.tmp')
OSError: [Errno 22] Invalid argument
... View more
Labels:
09-06-2016
03:27 AM
Yes, you can install both spark 1.6 and 2.0 in HDP 2.5
... View more
06-02-2016
03:13 AM
@Smart Solutions
If you use http mode, please specify hive.server2.thrift.http.port to a different port.
... View more
05-25-2016
12:31 AM
Could you check whether hive.server2.thrift.port is 10015 on the ambari UI ?
... View more
05-24-2016
02:26 AM
@Smart Solutions STS is listening on 10015 even in secure cluster. Have you tried to start STS through ambari ? 16/05/24 02:03:32 INFO UserGroupInformation: Login successful for user hive/jzhang-test4-1.openstacklocal@EXAMPLE.COM using keytab file /etc/security/keytabs/hive.service.keytab
16/05/24 02:03:32 INFO CompositeService: Operation log root directory is created: /tmp/hive/operation_logs
16/05/24 02:03:32 INFO AbstractService: HiveServer2: Async execution pool size 100
16/05/24 02:03:32 INFO AbstractService: Service:OperationManager is inited.
16/05/24 02:03:32 INFO AbstractService: Service: SessionManager is inited.
16/05/24 02:03:32 INFO AbstractService: Service: CLIService is inited.
16/05/24 02:03:32 INFO AbstractService: Service:ThriftBinaryCLIService is inited.
16/05/24 02:03:32 INFO AbstractService: Service: HiveServer2 is inited.
16/05/24 02:03:32 INFO AbstractService: Service:OperationManager is started.
16/05/24 02:03:32 INFO AbstractService: Service:SessionManager is started.
16/05/24 02:03:32 INFO AbstractService: Service:CLIService is started.
16/05/24 02:03:32 INFO ObjectStore: ObjectStore, initialize called
16/05/24 02:03:32 INFO Query: Reading in results for query "org.datanucleus.store.rdbms.query.SQLQuery@0" since the connection used is closing
16/05/24 02:03:32 INFO MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY
16/05/24 02:03:32 INFO ObjectStore: Initialized ObjectStore
16/05/24 02:03:32 INFO HiveMetaStore: 0: get_databases: default
16/05/24 02:03:32 INFO audit: ugi=hive/jzhang-test4-1.openstacklocal@EXAMPLE.COM ip=unknown-ip-addr cmd=get_databases: default
16/05/24 02:03:32 INFO HiveMetaStore: 0: Shutting down the object store...
16/05/24 02:03:32 INFO audit: ugi=hive/jzhang-test4-1.openstacklocal@EXAMPLE.COM ip=unknown-ip-addr cmd=Shutting down the object store...
16/05/24 02:03:32 INFO HiveMetaStore: 0: Metastore shutdown complete.
16/05/24 02:03:32 INFO audit: ugi=hive/jzhang-test4-1.openstacklocal@EXAMPLE.COM ip=unknown-ip-addr cmd=Metastore shutdown complete.
16/05/24 02:03:32 INFO AbstractService: Service:ThriftBinaryCLIService is started.
16/05/24 02:03:32 INFO AbstractService: Service:HiveServer2 is started.
16/05/24 02:03:32 INFO HiveThriftServer2: HiveThriftServer2 started
16/05/24 02:03:32 INFO UserGroupInformation: Login successful for user hive/jzhang-test4-1.openstacklocal@EXAMPLE.COM using keytab file /etc/security/keytabs/hive.service.keytab
16/05/24 02:03:32 INFO AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
16/05/24 02:03:33 INFO TokenStoreDelegationTokenSecretManager: New master key with key id=0
16/05/24 02:03:33 INFO TokenStoreDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
16/05/24 02:03:33 INFO AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
16/05/24 02:03:33 INFO TokenStoreDelegationTokenSecretManager: New master key with key id=1
16/05/24 02:03:33 INFO ThriftCLIService: Starting ThriftBinaryCLIService on port 10015 with 5...500 worker threads
... View more
03-17-2016
09:25 AM
1 Kudo
It is fixed in https://issues.apache.org/jira/browse/SPARK-13478
... View more