Member since
08-11-2014
36
Posts
2
Kudos Received
0
Solutions
01-08-2021
06:12 AM
great - thanks! https://docs.cloudera.com/cdp-private-cloud-base/7.1.4/installation/topics/cdpdc-using-local-parcel-repository.html this is what I was looking for.
... View more
01-08-2021
03:41 AM
hi can I have the parcels located on an FS so the installation will include a copy instead of downloading from a remote URL? I believe it will be faster solution this is for testing cluster environments better still - can I copy the parcels to the /opt/cloudera/parcels myself - while I'm preparing the VM - will cdp know that the file is already there or do I need to update also the psql metadata db? thanks doron
... View more
Labels:
10-22-2019
12:00 PM
Thanks @ssulav !! it was indeed selinux! on premise we've set the selinux to be disabled as default, so I've forgot all about it... I've disabled it and Cloudera server db and server are running well. Thanks again DV
... View more
10-22-2019
09:38 AM
hi thanks for replying. the direcory ownership is cloudera-scm for sure - I am able to run the same commands from CLI. I will check selinux. Thanks
... View more
10-22-2019
08:01 AM
hi I created a CentOS 7.7 Linux machine (but also happens with RHEL 7.4) on Azure. I installed the cloudera-manager RPM packages via yum When i try to start the cloudera-scm-server-db service I get "permission denied" on /var/lib/cloudera-scm-server-db/data I added -x flag to the /usr/share/cmf/bin/initialize_embedded_db.sh, and added the "strace" command before the initdb command. I see that the command is running as cloudera-scm user (in the /var/log/messages file) and Is see in the strace output, that it fails on "chmod("/var/lib/cloudera-scm-server-db/data", 0700) = -1 EACCES (Permission denied)" When I run the command from Linux CLI as user cloudera-scm it runs OK. Does the Linux behave differently on Azure (i.e. more security features) I don't think it relates to firewall I see in the /var/log/messages the following messages: Oct 22 12:53:14 cdh-doxi-1 systemd: Created slice User Slice of cloudera-scm. Oct 22 12:53:14 cdh-doxi-1 systemd: Started Session c1 of user cloudera-scm. Oct 22 12:53:16 cdh-doxi-1 systemd: Removed slice User Slice of cloudera-scm. could this slices are doing the damage? I see it relates to cgroups (but I'm not sure what it actually means) - can I turn this off somewhere? do i need to reinstall the Linux with different flags? TIA Doron
... View more
Labels:
- Labels:
-
Cloudera Manager
10-16-2019
06:08 AM
Hi
In our development site we have a concept of prod-like environment.
These are large clusters (10-15 nodes) where we run various benchmark tests for our products.
Until now we used physical servers - 2 U rack-mount servers with multiple internal disks configured as JBOD.
now we have increased the requirements of the number of environments - we need to have 5-6 such environment for the latest product and we need to have available environments for existing customer with older version of our products.
so, I was thinking of moving from physical servers to use ESX hypervisor and use VMs.
this will enable me to use less resource and be more flexibile in the configuration.
We got recommendation to use HPE Synergy, which can mix blades and Disks in the same chassis.
Can anyone share if they handle similar issues and how they resolved them?
Thanks Doron
PS we're using both CDH and HDP (existing customers have different versions), main components are Kafka, HBase, Hive and SPARK, and additional SW like Cassandra. Elasticsearch and more.
... View more
06-27-2019
04:38 AM
thanks for the response. the error occured from java - but not from hive cli (and I did not check beelonw) recently we moved from Oracle JDK to OpenJDK - could this be an issue? for now I've added hive.exec.drop.ignorenonexistent and it seems to help
... View more
06-26-2019
05:57 AM
hi In our application (java code) we're running: DROP FUNCTION IF EXISTS udf_for_STORE_AGENT_VISIT and we still get: 2019-06-26 13:49:25,683 ERROR org.apache.hadoop.hive.ql.exec.Task: [HiveServer2-Background-Pool: Thread-6397]: FAILED: error during drop function: org.apache.hadoop.hive.ql.metadata.HiveException: NoSuchObjectException(message:Function udf_for_STORE_AGENT_VISIT does not exist) shouldn't the error be skipped if we have the "IF EXISTS" in the command? cluster is CDH 5.16.1 Thanks Doron
... View more
Labels:
- Labels:
-
Hive
11-25-2018
01:44 AM
hi in the upgrade documentation the following is stated: "Upgrades from Cloudera Enterprise 5.15 to 6.0.0 Not supported" does it mean specifically to cdh 6.0.0 version or to any 6.x version? thanks Doron
... View more
Labels:
- Labels:
-
Cloudera Manager
07-04-2018
05:18 AM
@Geoffrey Shelton Okot thanks again - but we're still looking for other solution before we'll have to upgrade our code.
... View more
07-03-2018
02:38 PM
hi @Sindhu thanks again for the quick response. OK - so my question is - can I install a new HDP 2.6.4 cluster with older version of HIVE? regardless of the existing cluster. no upgrade... If i'll need the data from the old one, I'll copy all relevant data between them. Thanks Doron
... View more
07-03-2018
02:11 PM
hi Thanks for the answer. We do have smaller cluster for tests. However, we prefer to try to install older version of HIVE than upgrading our code. Is it possible at all? Thanks Doron
... View more
07-03-2018
01:29 PM
we need to upgrade to HDP 2.6.4, but our code still use older HIVE version. can we upgrade HDP and keep old HIVE? currently we're using HDP with HIVE version 0.14.0.2.2 while the new HDP brings HIVE 1.2.1000
... View more
Labels:
- Labels:
-
Apache Hive
05-10-2018
12:21 AM
I've upgraded CM to latest (5.14.3) and it works. although - i'd still like to know if it is supported on lower CM version or not.
... View more
05-09-2018
05:27 AM
hi I've followed instruction from here - https://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html Downloaded parcel, replaced csd jar, distributed, activated, restarted but when restarting cloudera-scm-server I get in its log file /var/log/cloudera-scm-server/cloudera-scm-server.log: 2018-05-09 14:59:31,361 WARN main:com.cloudera.csd.components.CsdLocalRepository: Skipping [/opt/cloudera/csd/SPARK2_ON_YARN-2.3.0.cloudera2.jar]: { Could not read service descriptor for csd [SPARK2_ON_YARN-2.3.0.cloudera2]: Could not resolve type id 'provided' into a subtype of [simple type, class com.cloudera.csd.descriptors.parameters.Parameter<java.lang.Object>] at [Source: [B@44b2dfa7; line: 124, column: 45] (through reference chain: ServiceDescriptor["parameters"]) } and i cannot use the spark2 service in the cluster. In file SPARK23/scripts/common.sh I see: local MIN_CM_VERSION=$(parse_version_string "5.14.0") Should i really upgrade to latest CM version?? I prefer staying on current cm version until we decide to upgrade the whole lot. Or is there another issue here? Thanks in advance Doron
... View more
Labels:
- Labels:
-
Cloudera Manager
-
Spark
02-21-2018
04:53 AM
1 Kudo
@Poojan Khanpara Here is what I got from HDP experts: Work-around: 1. Edit /var/lib/ambari-server/resources/common-services/HDFS/x.x.x.x.x/configuration/hdfs-site.xml 2. Modify the XML for commenting the <property-type>GROUP</property-type> tag. Like this: <property> <name>dfs.permissions.superusergroup</name> <value>hdfs</value> <!-- <property-type>GROUP</property-type> --> <description>The name of the group of super-users.</description> <on-ambari-upgrade add="true"/> </property> 3. Restart Ambari ambari-server restart
... View more
12-27-2017
02:10 PM
hi I cannot find dfs.permissions.superusergroup via ambari (HDFS-->config) in HDP 2.6.3 When I search "dfs.permissions" I see only the parameter "dfs.permissions.enabled" If i try to add it to the custom hdfs-site I get "Line 1: Property "dfs.permissions.superusergroup" is already defined in this configuration file" Checking on the local file system I do see that the parameter exists but I cannot modify it via ambari. I have cluster with HDP 2.6.1 and it is modifiable there. OS is RHEL 7.3 Any help will be appriciated. Thanks
... View more
Labels:
- Labels:
-
Apache Ambari
05-22-2016
10:42 AM
1 Kudo
hi
We've got the following error: org.apache.openjpa.persistence.PersistenceException: ERROR: value too long for type character varying(255)
{prepstmnt 190305649 INSERT INTO WF_JOBS (id, app_name, app_path, conf,
created_time, end_time, external_id, group_name, last_modified_time,
log_token, parent_id, proto_action_conf, run, sla_xml, start_time,
status, user_name, wf_instance) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?)} [code=0, state=22001] and to solve it we've altered the WF_JOBS table, resizing the app_path and app_name to be varchar(1024). Is it acceptable to modify the oozie database? Will it cause us problems in other parts of oozie? We did while using postgreSQL for oozie db. Thanks Doron
... View more
Labels:
- Labels:
-
Apache Oozie
06-29-2015
06:54 AM
Hi Thanks for the quick replay. I knew that the fault was mine, but it took me a while to find it. What I would like to be able to do is to have the parcels located on a shared storage, so I cam have a single copy of the parcel file (1.5GB per parcel) for my various clusters. In any case i have my testing clusters installed on VMs, so it does make sense to do this for them. For real Production environment i can't argue with your solution. Cheers Doron
... View more
06-29-2015
02:02 AM
In our testing environments we're aleays short on space... So we thought that we can remove the /opt/cloudera/parcel-cache and /opt/cloudera/parcel-repo - after all the parcel is already installed and distributed. Big mistake... i failed to start the cloudera manager services and got error like: ========= [29/Jun/2015 10:57:41 +0000] 2917 MainThread util INFO Using generic parser for process cloudera-mgmt-HOSTMONITOR [29/Jun/2015 10:57:41 +0000] 2917 MainThread agent INFO Activating Process 1019-cloudera-mgmt-HOSTMONITOR [29/Jun/2015 10:57:41 +0000] 2917 MainThread agent INFO Created /var/run/cloudera-scm-agent/process/1019-cloudera-mgmt-HOSTMONITOR [29/Jun/2015 10:57:41 +0000] 2917 MainThread agent INFO Chowning /var/run/cloudera-scm-agent/process/1019-cloudera-mgmt-HOSTMONITOR to cloudera-scm (781) cloudera-scm (501) [29/Jun/2015 10:57:41 +0000] 2917 MainThread agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1019-cloudera-mgmt-HOSTMONITOR to 0751 [29/Jun/2015 10:57:41 +0000] 2917 MainThread agent ERROR Failed to activate {u'refresh_files': [u'cloudera-stack-monitor.properties'], u'config_generation': 0, u'auto_restart': True, u'running': True, u'required_tags': [], u'user': u'cloudera-scm', u'special_file_info': [], u'group': u'cloudera-scm', u'id': 1019, u'status_links': {u'status': u'http://ilmtxbda146.corp.amdocs.com:8091/'}, u'name': u'cloudera-mgmt-HOSTMONITOR', u'run_generation': 1, u'environment': {u'MGMT_LOG_FILE': u'mgmt-cmf-mgmt-HOSTMONITOR-ilmtxbda146.corp.amdocs.com.log.out', u'CDH_VERSION': u'-1', u'FIREHOSE_JAVA_OPTS': u'-Xms1073741824 -Xmx1073741824 -XX:OnOutOfMemoryError={{AGENT_COMMON_DIR}}/killparent.sh'}, u'optional_tags': [], u'program': u'mgmt/mgmt.sh', u'arguments': [u'firehose', u'--pipeline-type', u'HOST_MONITORING'], u'parcels': {u'CDH': u'5.3.0-1.cdh5.3.0.p0.30'}, u'resources': [{u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': False, u'rlimits': {u'limit_memlock': None, u'limit_fds': None}, u'file': None, u'memory': None, u'directory': None, u'cpu': None}, {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': False, u'rlimits': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/log/cloudera-scm-firehose', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'cloudera-scm', u'user': u'cloudera-scm', u'mode': 509}, u'cpu': None}, {u'io': None, u'named_cpu': None, u'tcp_listen': {u'bind_address': u'10.233.164.119', u'port': 8091}, u'dynamic': False, u'rlimits': None, u'file': None, u'memory': None, u'directory': None, u'cpu': None}, {u'io': None, u'named_cpu': None, u'tcp_listen': {u'bind_address': u'10.233.164.119', u'port': 9995}, u'dynamic': False, u'rlimits': None, u'file': None, u'memory': None, u'directory': None, u'cpu': None}, {u'io': None, u'named_cpu': None, u'tcp_listen': {u'bind_address': u'10.233.164.119', u'port': 9994}, u'dynamic': False, u'rlimits': None, u'file': None, u'memory': None, u'directory': None, u'cpu': None}, {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': False, u'rlimits': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/lib/cloudera-host-monitor', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'cloudera-scm', u'user': u'cloudera-scm', u'mode': 509}, u'cpu': None}, {u'io': None, u'named_cpu': None, u'tcp_listen': None, u'dynamic': True, u'rlimits': None, u'file': None, u'memory': None, u'directory': {u'path': u'/var/log/cloudera-scm-firehose/stacks', u'bytes_free_warning_threshhold_bytes': 0, u'group': u'cloudera-scm', u'user': u'cloudera-scm', u'mode': 493}, u'cpu': None}], u'one_off': False} Traceback (most recent call last): File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1234, in handle_heartbeat_response new_process.activate() File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 2438, in activate self.update_process_environment_and_parcels() File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 2601, in update_process_environment_and_parcels parcels_in_use = self.agent.repo.prepare_environment(self.raw['parcels'], AttributeError: 'NoneType' object has no attribute 'prepare_environment' [29/Jun/2015 10:57:57 +0000] 2917 CP Server Thread-12 _cplogging INFO 10.233.164.119 - - [29/Jun/2015:10:57:57] "GET /download_log?path=%2Fvar%2Flog%2Fcloudera-scm-firehose%2Fmgmt-cmf-mgmt-HOSTMONITOR-ilmtxbda146.corp.amdocs.com.log.out&onlyTail=true&compress=false HTTP/1.1" 200 2011 "" "Java/1.7.0_10" [29/Jun/2015 11:07:28 +0000] 2917 MonitorDaemon-Reporter throttling_logger ERROR (9 skipped) Error sending messages to firehose: mgmt-HOSTMONITOR-14f3c3b6446d19e4dcc4dab16355bb71 Traceback (most recent call last): File "/usr/lib64/cmf/agent/src/cmf/monitor/firehose.py", line 70, in _send self._port) File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 464, in __init__ self.conn.connect() File "/usr/lib64/python2.6/httplib.py", line 720, in connect self.timeout) File "/usr/lib64/python2.6/socket.py", line 567, in create_connection raise error, msg error: [Errno 111] Connection refused ========= Luckily for me, I had the same parcel on a different environment so I could copy it and environment was happy again. My questions for cloudera people: * Why do I need the parcels after it was successfully installed? (all the jars and exe are available from /opt/cloudera/parcels/CDH) * Do you have any suggestions for saving space? - again this is for small testing environments and not for production. Thanks Doron
... View more
- Tags:
- cm services
- Parcels
05-26-2015
04:59 AM
I manage to create python script to change the configuration. here is an example: https://linuxlabrat.wordpress.com/2015/05/26/updating-cdh-configuration-using-python-and-rest-apis/
... View more
05-17-2015
11:38 PM
Hi Darren, just now got to check it and It worked! Thanks!! Doron
... View more
05-13-2015
06:16 AM
Can I update oozie-site.xml using REST api? We added our own external function to oozie. After each installation we need to go manually and change things in oozie via the CM web interface: Oozie Server Configuration Safety Valve for oozie-site.xml - add two properties oozie.service.ActionService.executor.ext.classes - add additional value oozie SchemaService Workflow Extension Schemas - add additional value i'd like to be able to do this via scripting of any kind. So far i could not find such an option - neither in CM REST API (http://cloudera.github.io/cm_api/apidocs/v10/index.html) nor OOZIE REST API (http://archive.cloudera.com/cdh4/cdh/4/oozie/WebServicesAPI.html) Thanks Doron
... View more
05-13-2015
05:49 AM
Thanks we'll do that. i.e. - currently we'll add the flag under init.d for the long run we'll create an alternative robust DB. Doron
... View more
05-11-2015
01:56 AM
We have the postgres db crashes occasional. There is no core dump. Can we add the -c flag to the pg_ctl command in the /etc/init.d/cloudera-scm-server-db file? $SU -c "pg_ctl start -c -w -D $DATA_DIR -l $SERVER_LOGFILE" can we keep this change permanent? Thanks Doron
... View more
03-16-2015
04:01 AM
I've wrote a little script to resolve the issue. although the script is a workaround and I still need to find the proper solution. details - here - https://linuxlabrat.wordpress.com/2015/03/16/removing-alternatives-of-old-cdh-parcels/
... View more