Member since
05-03-2017
51
Posts
2
Kudos Received
0
Solutions
04-03-2020
10:07 AM
1 Kudo
@stevenmatison Sure .Let me reinstall and see how it goes .Will reach out to you if i need any further help . Appreciate all your support . Regards Bharad
... View more
04-02-2020
02:56 PM
@stevenmatison Thank you Sir .
... View more
04-02-2020
02:43 PM
@stevenmatison i have changed the password - it did not work I have updated lines 92-94 in common.py - it did not work i made changes to params.py - it gave the below error . Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 76, in <module>
HueServer().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 26, in start
import params
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/params.py", line 194, in <module>
webhdfs_url = format('http://' + dfs_namenode_http_address + '/webhdfs/v1')
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/config_dictionary.py", line 73, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter 'dfs.namenode.http-address' was not found in configurations dictionary! and i see these (dfs.namenode.http-address are configured under HDFS configuration . Do i have to do anything separately for HUE . Regards Bharad Regards Bharad
... View more
04-02-2020
01:27 PM
@stevenmatison Finally i was able to install using mpack (all thanks to you ) . But hue server wont start . below is the error i am getting Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 76, in <module>
HueServer().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 28, in start
self.configure(env)
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 120, in locking_configure
original_configure(obj, *args, **kw)
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 23, in configure
setup_hue()
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/setup_hue.py", line 52, in setup_hue
add_hdfs_configuration(params.has_ranger_admin, params.security_enabled)
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py", line 99, in add_hdfs_configuration
add_configurations(services_configurations)
File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py", line 161, in add_configurations
Execute(cmd)
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 262, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/files/configs.sh set catl0dlbd00028.corp.cox.com HDP_ANALYTICS_DEV httpfs-site 'httpfs.proxyuser.hue.groups' '*'' returned 1. [ERROR] "httpfs-site" not found in server response.
[ERROR] Output of `curl -k -s -u admin:admin "http://catl0dlbd00028.corp.cox.com:8080/api/v1/clusters/HDP_ANALYTICS_DEV?fields=Clusters/desired_configs"` is:
[ERROR]
... View more
04-02-2020
11:29 AM
@stevenmatisonI was able to resolve the dependency issue . when i run the install through Ambari its failing with the below error Statement":947,"ShowDatabasesStatement":948,"ShowFunctionsStatement":949,"ShowGrantStatement":950,"ShowIndexStatement":951,"ShowLocksStatement":952,"ShowPartitionsStatement":953,"ShowRolesStatement":954,"ShowRoleStatement":955,"ShowTablesStatement":956,"ShowTableStatement":957,"ShowTblPropertiesStatement":958,"ShowTransactionsStatement":959,"ShowViewsStatement":960,"ShowColumnsStatement_EDIT":961,"ShowCreateTableStatement_EDIT":962,"ShowCurrentRolesStatement_EDIT":963,"ShowDatabasesStatement_EDIT":964,"ShowGrantStatement_EDIT":965,"ShowIndexStatement_EDIT":966,"ShowLocksStatement_EDIT":967,"ShowPartitionsStatement_EDIT":968,"ShowRoleStatement_EDIT":969,"ShowTablesStatement_EDIT":970,"ShowTableStatement_EDIT":971,"ShowTblPropertiesStatement_EDIT":972,"ShowViewsStatement_EDIT":973,"TableOrView":974,"OptionalPrincipalName":975,"OptionalPrincipalName_EDIT":976,"OptionalInOrFromDatabase":977,"OptionalLike":978,"InOrFromDatabase_EDIT":979,"Like_EDIT":980,"TargetTable":981,"OptionalFromJoinedTable":982,"TargetTable_EDIT":983,"FromJoinedTable_EDIT":984,"TableName":985,"TableName_EDIT":986,"SetClause":987,"SetClause_EDIT":988,"SetTarget":989,"UpdateSource":990,"UpdateSource_EDIT":991,"CaseWhenThenList":992,"CaseWhenThenList_EDIT":993,"CaseWhenThenListPartTwo":994,"CaseWhenThenListPartTwo_EDIT":995,"$accept":0,"$end":1},
at Parser._raise (/usr/local/hue/node_modules/@babel/parser/lib/index.js:742:17)
at Parser.raiseWithData (/usr/local/hue/node_modules/@babel/parser/lib/index.js:735:17)
at Parser.raise (/usr/local/hue/node_modules/@babel/parser/lib/index.js:729:17)
at Parser.unexpected (/usr/local/hue/node_modules/@babel/parser/lib/index.js:8757:16)
at Parser.parseExprAtom (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10052:20)
at Parser.parseExprSubscripts (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9602:23)
at Parser.parseMaybeUnary (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9582:21)
at Parser.parseExprOps (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9452:23)
at Parser.parseMaybeConditional (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9425:23)
at Parser.parseMaybeAssign (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9380:21)
at Parser.parseExpression (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9332:23)
at Parser.parseStatementContent (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11210:23)
at Parser.parseStatement (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11081:17)
at node.body.withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11699:60)
at Parser.withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10956:14)
at Parser.parseFor (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11699:22)
at Parser.parseForStatement (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11422:17)
at Parser.parseStatementContent (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11106:21)
at Parser.parseStatement (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11081:17)
at Parser.parseBlockOrModuleBlockBody (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11656:25)
at Parser.parseBlockBody (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11642:10)
at Parser.parseBlock (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11626:10)
at Parser.parseFunctionBody (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10634:24)
at Parser.parseFunctionBodyAndFinish (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10617:10)
at withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11796:12)
at Parser.withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10956:14)
at Parser.parseFunction (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11795:10)
at Parser.parseFunctionExpression (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10093:17)
at Parser.parseExprAtom (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10001:21)
at Parser.parseExprSubscripts (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9602:23)
@ ./desktop/core/src/desktop/js/parse/sql/sqlParserRepository.js 117:11-119:34
@ ./desktop/core/src/desktop/js/sql/sqlLocationWebWorker.js
@ multi ./desktop/core/src/desktop/js/sql/sqlLocationWebWorker.js
npm ERR! Linux 3.10.0-514.16.1.el7.x86_64
npm ERR! argv "/usr/bin/node" "/bin/npm" "run" "webpack-workers"
npm ERR! node v6.14.0
npm ERR! npm v3.10.10
npm ERR! code ELIFECYCLE
npm ERR! hue@4.6.0 webpack-workers: `webpack --config webpack.config.workers.js`
npm ERR! Exit status 2
npm ERR!
npm ERR! Failed at the hue@4.6.0 webpack-workers script 'webpack --config webpack.config.workers.js'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the hue package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! webpack --config webpack.config.workers.js
npm ERR! You can get information on how to open an issue for this project with:
npm ERR! npm bugs hue
npm ERR! Or if that isn't available, you can get their info via:
npm ERR! npm owner ls hue
npm ERR! There is likely additional logging output above.
npm ERR! Please include the following file with any support request:
npm ERR! /usr/local/hue/npm-debug.log
make[1]: *** [npm-install] Error 1
make[1]: Leaving directory `/usr/local/hue'
make: *** [install-env] Error 2 When i run manual install it suceeds .please find last few lines on manual install where it suceeded . Post-processed 'jobsub/css/jobsub.css' as 'jobsub/css/jobsub.4dd97953214b.css' Post-processed 'desktop/css/roboto.css' as 'desktop/css/roboto.895233d7bf84.css' Post-processed 'metastore/css/metastore.css' as 'metastore/css/metastore.0bd1490fe916.css' Post-processed 'desktop/css/bootstrap-medium-editor.css' as 'desktop/css/bootstrap-medium-editor.307d202ce21d.css' Post-processed 'admin/css/login.css' as 'admin/css/login.a846c0e2ef65.css' Post-processed 'admin/css/rtl.css' as 'admin/css/rtl.4c867197b256.css' Post-processed 'oozie/css/workflow.css' as 'oozie/css/workflow.5bf771c653dc.css' Post-processed 'debug_toolbar/css/toolbar.css' as 'debug_toolbar/css/toolbar.b35523ea26ab.css' Post-processed 'impala/css/impala-dashboard.css' as 'impala/css/impala-dashboard.60e7988b5afe.css' Post-processed 'desktop/css/bootstrap-daterangepicker.css' as 'desktop/css/bootstrap-daterangepicker.3b118749763b.css' Post-processed 'desktop/css/jqCron.css' as 'desktop/css/jqCron.ad6fb9a1edc5.css' Post-processed 'pig/css/pig.css' as 'pig/css/pig.971ef685eb43.css' Post-processed 'oozie/css/workflow-editor.css' as 'oozie/css/workflow-editor.fb64c90799c5.css' Post-processed 'desktop/css/bootstrap-spinedit.css' as 'desktop/css/bootstrap-spinedit.983726642cbb.css' 66 static files copied to '/usr/local/hue/build/static', 1518 unmodified, 318 post-processed. make[1]: Leaving directory `/usr/local/hue'
... View more
04-01-2020
03:57 PM
@stevenmatison Appreciate your support sir . For the above ( Hue 4.6.0 install in HDP 2.x ) i tried multiple times but i was not able to get past the above steps . even though i have all the dependent packages avilable on the server i am getting below error . copying MySQLdb/constants/ER.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/FLAG.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/REFRESH.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/CLIENT.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
running build_ext
building '_mysql' extension
creating build/temp.linux-x86_64-2.7
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Dversion_info=(1,2,5,'final',1) -D__version__=1.2.5 -I/usr/include/mysql -I/usr/include/python2.7 -c _mysql.c -o build/temp.linux-x86_64-2.7/_mysql.o -m64
_mysql.c:44:23: fatal error: my_config.h: No such file or directory
#include "my_config.h"
^
compilation terminated.
error: command 'gcc' failed with exit status 1
make[2]: *** [/usr/local/hue-4.6.0/desktop/core/build/MySQL-python-1.2.5/egg.stamp] Error 1
make[2]: Leaving directory `/usr/local/hue-4.6.0/desktop/core'
make[1]: *** [.recursive-install-bdist/core] Error 2
make[1]: Leaving directory `/usr/local/hue-4.6.0/desktop'
make: *** [install-desktop] Error 2 I have all the dependencies available on the server sudo yum install ant asciidoc cyrus-sasl-devel cyrus-sasl-gssapi cyrus-sasl-plain gcc gcc-c++ krb5-devel libffi-devel libxml2-devel libxslt-devel make mysql mysql-devel openldap-devel python-devel sqlite-devel gmp-devel Loaded plugins: enabled_repos_upload, package_upload, product-id, search-disabled-repos, subscription-manager IDS_EPEL_EPEL_7_Server | 2.4 kB 00:00:00 IDS_NewRelic_RHEL7 | 2.1 kB 00:00:00 IDS_UIMS_RHEL7 | 2.1 kB 00:00:00 rhel-7-server-optional-rpms | 2.0 kB 00:00:00 rhel-7-server-rpms | 2.0 kB 00:00:00 rhel-7-server-satellite-tools-6.6-rpms | 2.1 kB 00:00:00 rhel-7-server-supplementary-rpms | 2.0 kB 00:00:00 Package ant-1.9.4-2.el7.noarch already installed and latest version Package asciidoc-8.6.8-5.el7.noarch already installed and latest version Package cyrus-sasl-devel-2.1.26-23.el7.x86_64 already installed and latest version Package cyrus-sasl-gssapi-2.1.26-23.el7.x86_64 already installed and latest version Package cyrus-sasl-plain-2.1.26-23.el7.x86_64 already installed and latest version Package gcc-4.8.5-39.el7.x86_64 already installed and latest version Package gcc-c++-4.8.5-39.el7.x86_64 already installed and latest version Package krb5-devel-1.15.1-37.el7_7.2.x86_64 already installed and latest version Package libffi-devel-3.0.13-18.el7.x86_64 already installed and latest version Package libxml2-devel-2.9.1-6.el7_2.3.x86_64 already installed and latest version Package libxslt-devel-1.1.28-5.el7.x86_64 already installed and latest version Package 1:make-3.82-24.el7.x86_64 already installed and latest version Package mysql-community-client-8.0.17-1.el7.x86_64 already installed and latest version Package mysql-community-devel-8.0.17-1.el7.x86_64 already installed and latest version Package openldap-devel-2.4.44-21.el7_6.x86_64 already installed and latest version Package python-devel-2.7.5-86.el7.x86_64 already installed and latest version Package sqlite-devel-3.7.17-8.el7_7.1.x86_64 already installed and latest version Package 1:gmp-devel-6.0.0-15.el7.x86_64 already installed and latest version Nothing to do Uploading Enabled Repositories Report Loaded plugins: product-id, subscription-manager its weird behavior from ambari server and agent .. I am out of ideas and energy for now 🙂 .I will wait for Mpack and try that . Thanks for all your efforts . Regards Bharad
... View more
04-01-2020
02:29 PM
@stevenmatison I have installed all the dependencies . and now getting into different error . File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'cd /usr/local/hue-4.6.0 && PREFIX=/usr/local make install' returned 2. "PYTHON_VER is python2.7"
ERROR: /usr/local/hue not empty. Cowardly refusing to continue.
make: *** [install-check] Error 1 Trying to get in touch with my system admin to check on this . if you have any thoughts please let me know . Regards Bharad
... View more
04-01-2020
01:20 PM
Hi , I am working with Red Hat Enterprise Linux Server release 7.6 (Maipo) . Let me check the dependencies once again .
... View more
04-01-2020
12:15 PM
@stevenmatisonI have tried the above 4.6 approach and i am getting belwo error . creating build/lib.linux-x86_64-2.7
copying _mysql_exceptions.py -> build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/__init__.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/converters.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/connections.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/cursors.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/release.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/times.py -> build/lib.linux-x86_64-2.7/MySQLdb
creating build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/__init__.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/CR.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/FIELD_TYPE.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/ER.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/FLAG.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/REFRESH.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/CLIENT.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
running build_ext
building '_mysql' extension
creating build/temp.linux-x86_64-2.7
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Dversion_info=(1,2,5,'final',1) -D__version__=1.2.5 -I/usr/include/mysql -I/usr/include/python2.7 -c _mysql.c -o build/temp.linux-x86_64-2.7/_mysql.o -m64
_mysql.c:44:23: fatal error: my_config.h: No such file or directory
#include "my_config.h"
^
compilation terminated.
error: command 'gcc' failed with exit status 1
make[2]: *** [/usr/local/hue-4.6.0/desktop/core/build/MySQL-python-1.2.5/egg.stamp] Error 1
make[2]: Leaving directory `/usr/local/hue-4.6.0/desktop/core'
make[1]: *** [.recursive-install-bdist/core] Error 2
make[1]: Leaving directory `/usr/local/hue-4.6.0/desktop'
make: *** [install-desktop] Error 2
... View more
04-01-2020
08:38 AM
Thank you Sir . Just wondering what does the time like look like for both of them to be out . Regards Bharad
... View more
04-01-2020
07:08 AM
@stevenmatison Thank you Sir . We are in HDP 2.6.x and if we can get Hue 4.x management pack it would be really helpful . Thanks Bharad
... View more
04-01-2020
06:55 AM
@stevenmatison Thanks for the details . Currently my requirement is installing HUE 4.x in HDP 2.6.X version through ambari . As its not available i was trying 3.1 using below steps https://github.com/EsharEditor/ambari-hue-service if i look at the error it says Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/package/scripts/hue_server.py", line 4, in <module>
from setup_hue import setup_hue
File "/var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/package/scripts/setup_hue.py", line 5, in <module>
from common import *
File "/var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/package/scripts/common.py", line 63, in <module>
Execute('{0} | xargs wget -O hue.tgz'.format(params.download_url))
NameError: name 'params' is not defined but in the server i dont see /var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/package/scripts/hue_server.py script itself . Am i doing some thing wrong here . we are using local repo not the public repo . Thanks for your support . Regards Bharad
... View more
03-31-2020
03:13 PM
@yograjshindewere you able to resolve this issue . i am getting exactly same issue . Regards Bharad
... View more
03-31-2020
02:48 PM
Team ,
I am following below link to install managed by Ambari .
Hdp version :- 2.6.5
Ambari version :-
https://github.com/EsharEditor/ambari-hue-service .
After following few steps and when i try to install the HUE services from ambari i am getting below error .
2020-03-31 16:43:07,626 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6
2020-03-31 16:43:07,630 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-03-31 16:43:07,631 - Group['kms'] {}
2020-03-31 16:43:07,634 - Group['livy'] {}
2020-03-31 16:43:07,634 - Group['spark'] {}
2020-03-31 16:43:07,634 - Group['ranger'] {}
2020-03-31 16:43:07,635 - Group['hue'] {}
2020-03-31 16:43:07,642 - Adding group Group['hue']
2020-03-31 16:43:07,670 - Group['hdfs'] {}
2020-03-31 16:43:07,671 - Group['zeppelin'] {}
2020-03-31 16:43:07,672 - Group['hadoop'] {}
2020-03-31 16:43:07,673 - Group['users'] {}
2020-03-31 16:43:07,673 - Group['knox'] {}
2020-03-31 16:43:07,675 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,679 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,682 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,685 - User['superset'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,687 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2020-03-31 16:43:07,688 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,690 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'ranger'], 'uid': None}
2020-03-31 16:43:07,691 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2020-03-31 16:43:07,693 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': None}
2020-03-31 16:43:07,694 - User['kms'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,696 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,697 - User['druid'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,699 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,700 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2020-03-31 16:43:07,701 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,703 - User['hue'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,721 - Adding user User['hue']
2020-03-31 16:43:08,285 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None}
2020-03-31 16:43:08,288 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,292 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,295 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,297 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,298 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,301 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,303 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-03-31 16:43:08,307 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2020-03-31 16:43:08,317 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2020-03-31 16:43:08,317 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2020-03-31 16:43:08,318 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-03-31 16:43:08,319 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-03-31 16:43:08,320 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2020-03-31 16:43:08,333 - call returned (0, '57467')
2020-03-31 16:43:08,333 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 57467'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2020-03-31 16:43:08,340 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 57467'] due to not_if
2020-03-31 16:43:08,340 - Group['hdfs'] {}
2020-03-31 16:43:08,342 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', u'hdfs']}
2020-03-31 16:43:08,343 - User['admin'] {'fetch_nonlocal_groups': True}
2020-03-31 16:43:08,345 - FS Type:
2020-03-31 16:43:08,346 - Directory['/etc/hadoop'] {'mode': 0755}
2020-03-31 16:43:08,362 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'}
2020-03-31 16:43:08,363 - Writing File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] because contents don't match
2020-03-31 16:43:08,363 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2020-03-31 16:43:08,377 - Repository['HDP-2.6-repo-301'] {'append_to_file': False, 'base_url': 'http://private-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.128-2', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-301', 'mirror_list': None}
2020-03-31 16:43:08,384 - File['/etc/yum.repos.d/ambari-hdp-301.repo'] {'content': '[HDP-2.6-repo-301]\nname=HDP-2.6-repo-301\nbaseurl=http://private-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.128-2\n\npath=/\nenabled=1\ngpgcheck=0'}
2020-03-31 16:43:08,385 - Writing File['/etc/yum.repos.d/ambari-hdp-301.repo'] because contents don't match
2020-03-31 16:43:08,385 - Repository with url http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.5.1050 is not created due to its tags: set([u'GPL'])
2020-03-31 16:43:08,385 - Repository['HDP-UTILS-1.1.0.22-repo-301'] {'append_to_file': True, 'base_url': 'http://private-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-301', 'mirror_list': None}
2020-03-31 16:43:08,388 - File['/etc/yum.repos.d/ambari-hdp-301.repo'] {'content': '[HDP-2.6-repo-301]\nname=HDP-2.6-repo-301\nbaseurl=http://private-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.128-2\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-301]\nname=HDP-UTILS-1.1.0.22-repo-301\nbaseurl=http://private-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2020-03-31 16:43:08,388 - Writing File['/etc/yum.repos.d/ambari-hdp-301.repo'] because contents don't match
2020-03-31 16:43:08,388 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:08,836 - Skipping installation of existing package unzip
2020-03-31 16:43:08,836 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:08,919 - Skipping installation of existing package curl
2020-03-31 16:43:08,919 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,003 - Skipping installation of existing package hdp-select
2020-03-31 16:43:09,007 - The repository with version 2.6.5.128-2 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-03-31 16:43:09,011 - Skipping stack-select on HUE because it does not exist in the stack-select package structure.
2020-03-31 16:43:09,257 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-03-31 16:43:09,260 - Package['wget'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,428 - Skipping installation of existing package wget
2020-03-31 16:43:09,429 - Package['tar'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,561 - Skipping installation of existing package tar
2020-03-31 16:43:09,562 - Package['asciidoc'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,646 - Installing package asciidoc ('/usr/bin/yum -d 0 -e 0 -y install asciidoc')
2020-03-31 16:43:10,410 - Execution of '/usr/bin/yum -d 0 -e 0 -y install asciidoc' returned 1. Error: Nothing to do
Loaded plugins: product-id
Cannot upload enabled repos report, is this client registered?
2020-03-31 16:43:10,410 - Failed to install package asciidoc. Executing '/usr/bin/yum clean metadata'
2020-03-31 16:43:10,623 - Retrying to install package asciidoc after 30 seconds
2020-03-31 16:43:41,768 - The repository with version 2.6.5.128-2 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-03-31 16:43:41,773 - Skipping stack-select on HUE because it does not exist in the stack-select package structure.
Any advice or solution is highly appreciated .
Regards
Bharad
... View more
Labels:
01-18-2019
07:46 PM
We are planing to upgrade HDP from 2.6.1 to 3.1 along with new servers . Does any one have documentation or scripts which will allow us to create the same structure of folders at the destination version for hive,hdfs,hbase.
... View more
Labels:
09-04-2018
03:25 PM
When i try to upgrade ambari from 2.6.1 to 2.7 its failing when i do server upgrade . please find the error below 2018-09-02 18:19:51,423 ERROR [main] SchemaUpgradeHelper:473 - Exception occurred during upgrade, failed org.apache.ambari.server.AmbariException: Trying to create a ServiceComponent not recognized in stack info, clusterName=HDF_LAB, serviceName=AMBARI_INFRA, componentName=INFRA_SOLR, stackInfo=HDF-3.1 at org.apache.ambari.server.upgrade.SchemaUpgradeHelper.executePreDMLUpdates(SchemaUpgradeHelper.java:223) at org.apache.ambari.server.upgrade.SchemaUpgradeHelper.main(SchemaUpgradeHelper.java:454) Caused by: java.lang.RuntimeException: Trying to create a ServiceComponent not recognized in stack info, clusterName=HDF_LAB, serviceName=AMBARI_INFRA, componentName=INFRA_SOLR, stackInfo=HDF-3.1 at org.apache.ambari.server.state.ServiceComponentImpl.updateComponentInfo(ServiceComponentImpl.java:154) at org.apache.ambari.server.state.ServiceComponentImpl.<init>(ServiceComponentImpl.java:178) at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$1d58f0d8.<init>(<generated>) at org.apache.ambari.server.state.ServiceComponentImpl$$EnhancerByGuice$$1d58f0d8$$FastClassByGuice$$280022dc.newInstance(<generated>) at com.google.inject.internal.ProxyFactory$ProxyConstructor.newInstance(ProxyFactory.java:265) at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:111) at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:776) at com.sun.proxy.$Proxy21.createExisting(Unknown Source) at org.apache.ambari.server.state.ServiceImpl.<init>(ServiceImpl.java:181) at org.apache.ambari.server.state.ServiceImpl$$EnhancerByGuice$$861a4bc.<init>(<generated>) at org.apache.ambari.server.state.ServiceImpl$$EnhancerByGuice$$861a4bc$$FastClassByGuice$$6de922a8.newInstance(<generated>) at com.google.inject.internal.ProxyFactory$ProxyConstructor.newInstance(ProxyFactory.java:265) at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:111) at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:776) at com.sun.proxy.$Proxy15.createExisting(Unknown Source) at org.apache.ambari.server.state.cluster.ClusterImpl.loadServices(ClusterImpl.java:451) at org.apache.ambari.server.state.cluster.ClusterImpl.<init>(ClusterImpl.java:344) at org.apache.ambari.server.state.cluster.ClusterImpl$$EnhancerByGuice$$13ee505a.<init>(<generated>) at org.apache.ambari.server.state.cluster.ClusterImpl$$EnhancerByGuice$$13ee505a$$FastClassByGuice$$73468d7.newInstance(<generated>) at com.google.inject.internal.ProxyFactory$ProxyConstructor.newInstance(ProxyFactory.java:265) at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:111) at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:90) at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:268) at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1019) at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1085) at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1015) at com.google.inject.assistedinject.FactoryProvider2.invoke(FactoryProvider2.java:776) at com.sun.proxy.$Proxy11.create(Unknown Source) at org.apache.ambari.server.state.cluster.ClustersImpl.loadClustersAndHosts(ClustersImpl.java:300) at org.apache.ambari.server.state.cluster.ClustersImpl.safelyLoadClustersAndHosts(ClustersImpl.java:266) at org.apache.ambari.server.state.cluster.ClustersImpl.getClustersByName(ClustersImpl.java:182) at org.apache.ambari.server.state.cluster.ClustersImpl.getClusters(ClustersImpl.java:677) at org.apache.ambari.server.upgrade.AbstractUpgradeCatalog.getCheckedClusterMap(AbstractUpgradeCatalog.java:494) at org.apache.ambari.server.upgrade.UpgradeCatalog262.fixDesiredStack(UpgradeCatalog262.java:81) at org.apache.ambari.server.upgrade.UpgradeCatalog262.executePreDMLUpdates(UpgradeCatalog262.java:69) at org.apache.ambari.server.upgrade.AbstractUpgradeCatalog.preUpgradeData(AbstractUpgradeCatalog.java:975) at org.apache.ambari.server.upgrade.SchemaUpgradeHelper.executePreDMLUpdates(SchemaUpgradeHelper.java:220) ... 1 more
... View more
Labels:
02-28-2018
08:32 PM
@Matt Clarke Could you please help me on this .
... View more
02-28-2018
08:31 PM
Team, I am running into below error when i try to start ambari agent post upgrade to HJDF3.1 from HDF 2.1. # ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources... Ambari database consistency check started... DB configs consistency check failed. Run "ambari-server start --skip-database-check" to skip. If you use this "--skip-database-check" option, do not make any changes to your cluster topology or perform a cluster upgrade until you correct the database consistency issues. See "/var/log/ambari-server/ambari-server-check-database.log" for more details on the consistency issues. Ambari database consistency check finished In log i see the below error 2018-02-28 14:38:31,085 INFO - ******************************* Check database started ******************************* 2018-02-28 14:38:35,189 INFO - Checking for configs not mapped to any cluster 2018-02-28 14:38:35,261 INFO - Checking for configs selected more than once 2018-02-28 14:38:35,272 INFO - Checking for hosts without state 2018-02-28 14:38:35,273 INFO - Checking host component states count equals host component desired states count 2018-02-28 14:38:35,291 INFO - Checking services and their configs 2018-02-28 14:38:36,789 INFO - Processing HDF-2.1 / RANGER 2018-02-28 14:38:36,790 INFO - Processing HDF-2.1 / AMBARI_INFRA 2018-02-28 14:38:36,790 INFO - Processing HDF-2.1 / AMBARI_METRICS 2018-02-28 14:38:36,790 INFO - Processing HDF-2.1 / KAFKA 2018-02-28 14:38:36,790 INFO - Processing HDF-2.1 / NIFI 2018-02-28 14:38:36,790 INFO - Processing HDF-2.1 / ZOOKEEPER 2018-02-28 14:38:36,791 ERROR - Required config(s): nifi-logsearch-conf is(are) not available for service NIFI with service config version 20 in cluster HDF_LAB
... View more
Labels:
02-01-2018
06:36 PM
Hi @Bryan Bende i have replaced the phoenix client jar with phoenix-4.4.0.2.x.x.x-227-client.jar version . but it did not work out . i am getting the below error 2018-02-01 13:35:48,331 ERROR [StandardProcessScheduler Thread-8] o.a.n.c.s.StandardControllerServiceNode HBase_1_1_2_ClientService[id=48f85482-7105-1595-ffff-ffffcdbc0049] Failed to invoke @OnEnabled method due to java.io.IOException: java.lang.reflect.InvocationTargetException 2018-02-01 13:35:48,335 ERROR [StandardProcessScheduler Thread-8] o.a.n.c.s.StandardControllerServiceNode java.io.IOException: java.lang.reflect.InvocationTargetException at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService$1.run(HBase_1_1_2_ClientService.java:235) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService$1.run(HBase_1_1_2_ClientService.java:232) ~[na:na] at java.security.AccessController.doPrivileged(Native Method) ~[na:1.8.0_121] at javax.security.auth.Subject.doAs(Subject.java:422) ~[na:1.8.0_121] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService.createConnection(HBase_1_1_2_ClientService.java:232) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService.onEnabled(HBase_1_1_2_ClientService.java:181) ~[na:na] at sun.reflect.GeneratedMethodAccessor1737.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_121] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_121] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47) ~[na:na] at org.apache.nifi.controller.service.StandardControllerServiceNode$2.run(StandardControllerServiceNode.java:345) ~[na:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_121] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_121] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_121] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_121] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121] Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.GeneratedConstructorAccessor617.newInstance(Unknown Source) ~[na:na] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_121] at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_121] at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238) ~[na:na] ... 24 common frames omitted Caused by: java.lang.UnsupportedOperationException: Unable to find suitable constructor for class org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory at org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:39) ~[na:na] at org.apache.hadoop.hbase.ipc.RpcControllerFactory.instantiate(RpcControllerFactory.java:58) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.createAsyncProcess(ConnectionManager.java:2242) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:690) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:630) ~[na:na] ... 28 common frames omitted Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory.<init>(org.apache.hadoop.conf.Configuration) at java.lang.Class.getConstructor0(Class.java:3082) ~[na:1.8.0_121] at java.lang.Class.getDeclaredConstructor(Class.java:2178) ~[na:1.8.0_121] at org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:33) ~[na:na] ... 32 common frames omitted 2018-02-01 13:35:48,335 ERROR [StandardProcessScheduler Thread-8] o.a.n.c.s.StandardControllerServiceNode Failed to invoke @OnEnabled method of HBase_1_1_2_ClientService[id=48f85482-7105-1595-ffff-ffffcdbc0049] due to java.io.IOException: java.lang.reflect.InvocationTargetException
... View more
02-01-2018
06:07 PM
Thank you @Bryan Bende . will try using it.
... View more
02-01-2018
02:38 PM
@Bryan Bende
so do we have a version compatibility chart where i can check which
version of phoenix client will be supported by HBase client in nifi
... View more
02-01-2018
02:37 PM
@Bryan Bende so do we have a version compatibility chart where i can check which version of phoenix client will be supported by HBase client in nifi
... View more
01-31-2018
10:24 PM
Hi @Bryan Bende i am seeing below error in nifi logs .. 2018-01-31 15:00:15,053 ERROR [StandardProcessScheduler Thread-7] o.a.n.c.s.StandardControllerServiceNode HBase_1_1_2_ClientService[id=48f85482-7105-1595-ffff-ffffcdbc0049] Failed to invoke @OnEnabled method due to java.io.IOException: ja va.lang.reflect.InvocationTargetException 2018-01-31 15:00:15,060 ERROR [StandardProcessScheduler Thread-7] o.a.n.c.s.StandardControllerServiceNode java.io.IOException: java.lang.reflect.InvocationTargetException at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService$1.run(HBase_1_1_2_ClientService.java:235) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService$1.run(HBase_1_1_2_ClientService.java:232) ~[na:na] at java.security.AccessController.doPrivileged(Native Method) ~[na:1.8.0_121] at javax.security.auth.Subject.doAs(Subject.java:422) ~[na:1.8.0_121] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService.createConnection(HBase_1_1_2_ClientService.java:232) ~[na:na] at org.apache.nifi.hbase.HBase_1_1_2_ClientService.onEnabled(HBase_1_1_2_ClientService.java:181) ~[na:na] at sun.reflect.GeneratedMethodAccessor1737.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_121] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_121] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47) ~[na:na] at org.apache.nifi.controller.service.StandardControllerServiceNode$2.run(StandardControllerServiceNode.java:345) ~[na:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_121] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_121] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_121] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_121] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121] Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.GeneratedConstructorAccessor617.newInstance(Unknown Source) ~[na:na] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_121] at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_121] at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238) ~[na:na] ... 24 common frames omitted Caused by: java.lang.UnsupportedOperationException: Unable to find suitable constructor for class org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory at org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:39) ~[na:na] at org.apache.hadoop.hbase.ipc.RpcControllerFactory.instantiate(RpcControllerFactory.java:58) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.createAsyncProcess(ConnectionManager.java:2242) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:690) ~[na:na] at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:630) ~[na:na] ... 28 common frames omitted Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.hbase.ipc.controller.ServerRpcControllerFactory.<init>(org.apache.hadoop.conf.Configuration) at java.lang.Class.getConstructor0(Class.java:3082) ~[na:1.8.0_121] at java.lang.Class.getDeclaredConstructor(Class.java:2178) ~[na:1.8.0_121] at org.apache.hadoop.hbase.util.ReflectionUtils.instantiateWithCustomCtor(ReflectionUtils.java:33) ~[na:na] ... 32 common frames omitted 2018-01-31 15:00:15,060 ERROR [StandardProcessScheduler Thread-7] o.a.n.c.s.StandardControllerServiceNode Failed to invoke @OnEnabled method of HBase_1_1_2_ClientService[id=48f85482-7105-1595-ffff-ffffcdbc0049] due to java.io.IOException: java.lang.reflect.InvocationTargetException 2018-01-31 15:00:15,564 INFO [Heartbeat Monitor Thread-1] o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 1 heartbeats in 3177 nanos 2018-01-31 15:00:15,967 INFO [NiFi Web Server-1445100] o.a.n.c.c.n.LeaderE Regards Bharadwaj
... View more
01-31-2018
03:53 PM
I am getting below error when trying to connect to kerberos hbase. i have given all the details that are required . Any help would be greatful.
... View more
Labels:
01-22-2018
09:12 PM
I am not able to run the below query using nifi . insert overwrite local directory '/hadoop_shared/xxx/xxx/xxx/' row format delimited fields terminated by '|' null defined as '' select xxx; Error :- Error message:PutHiveQL[id=8e81378c-822c-1a67-8f1d-461f14368aea] Failed to update Hive for StandardFlowFileRecord[uuid=6874a32d-5c58-4454-8963-eaa20e67094b,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1516598821063-18354, container=default, section=946], offset=119486, length=493],offset=0,name=23963691567831492.avro.avro.avro.avro.avro.avro,size=493] due to org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [bdcontour2] does not have [WRITE] privilege on [/hadoop_shared/*]; it is possible that retrying the operation will succeed, so routing to retry: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [bdcontour2] does not have [WRITE] privilege on [/hadoop_shared/*]
... View more
Labels:
11-28-2017
02:39 AM
@Matt Clarke Please let me know your thoughts ...
... View more
11-28-2017
02:38 AM
We have 2 node cluster HDF .Recently we have couple of projects migrated to Production which has to use few process groups which needs to run on primary node only .So off recently i saw the primary node is being changed constantly ,because of which we are facing lot of issue of the projects which run on primary node only .I see server is busy on GC.i want to understand how would the processors which are configured to "run on primary node only" work when the primary node keeps on changing ,is there a workaround to manually selet the primary node.
... View more
Labels:
11-16-2017
06:28 PM
Team i have an requirement where NIFI should able to trigger an oozie coordinator which would schedule the workflow for every 15 mins upon receiving http call . i could see the API to trigger the workflow but not the coordinator .
... View more
Labels:
08-01-2017
04:26 PM
@Matt Clarke any suggestions or any used cases you came across.
... View more
