Solved

Good morning guys, thanks in advance for your help!I have a project that fails. I'm trying to restart all the services manually but havent been able to. I have a few questions and I'd really appreciate if you can give me some guidance because at this moment I'm kinda stuck.1. How do I check what services need to be "up and running" before restarting the next one? Is there any place where I can see the dependency?2. Do I need 2 ZooKeeper servers up and running? The first one is running in localhost but the 2nd one runs in a different machine. If I actually need them both, how can I check what was wrong in the second one?

Hi community, looking at security, I am in process of disabling any interfaces without proper authentication / authorization (or even encryption). I came across the debug web UIs of Cloudera Management services.   According to https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_ports_cm.html, the debug WebUIs can be disabled by setting the port property to -1. This works for Reports Manager (8083), Event Server (8084), Navigator Audit Server (8089), Telemetry Publisher (10111).   This does not work, however, for  Service Monitor (8086 / 9086 TLS), Activity Monitor (8087 / 9087 TLS), Host Monitor (8091 / 9091 TLS). Setting port to -1 leads to non-starting services without a proper ERROR in the log file.   Cloudera Manager agent even tries to check, if the server successfully bound to port -1 and runs into errors: [15/Aug/2019 12:06:03 +0000] 65646 Thread-14 process ERROR [918-cloudera-mgmt-HOSTMONITOR] Failed port check: Command '['ss', '-

Hello Team, I am using RHEL 7 and followed documentation to install CFM https://docs.hortonworks.com/HDPDocuments/CFM/CFM-1.0.0/installation/content/add-nifi-service.html   CFM package has been installed as seen in screen short.  I checked both folders "/opt/cloudera/csd", "/opt/cloudera/parcel-repo" both contain the following files-rw-r-----. 1 cloudera-scm cloudera-scm 41 Aug 16 11:12 CFM-1.0.0.0-el7.parcel.sha-rw-r-----. 1 cloudera-scm cloudera-scm 1735385749 Aug 16 11:12 CFM-1.0.0.0-el7.parcel-rw-r-----. 1 cloudera-scm cloudera-scm 66350 Aug 16 11:12 CFM-1.0.0.0-el7.parcel.torrent I am stuck at Add and Configure CFM Services because I cannot see Nifi in the services list.  How should install Nifi service now? Hemanth  

We have a need to enable public IPs on the master nodes due to an requirement in Azure when adding instances to a load balancer pool.  Our cluster is accessed via private IPs only,  outside of this requirement.     Within the cluster bootstrap file, we enable public IPs for the master instance groups.  During deployment, director will throw an error similar to the following for some but not all master nodes:   ', errorInfo=ErrorInfo{code=INSTANCE_SSH_PORT_UNAVAILABLE, properties={sshServiceEndpoints=[BaseServiceEndpoint{hostEndpoint=HostEndpoint{hostAddressString='10.0.14.15', hostAddress=Optional.of(/10.0.14.15)}, port=Optional.absent(), url=Optional.absent()}, BaseServiceEndpoint{hostEndpoint=HostEndpoint{hostAddressString='52.232.245.168', hostAddress=Optional.of(/52.232.245.168)}, port=Optional.absent(), url=Optional.absent()}]}, causes=[]}}   [2019-07-10 02:49:45.507 +0000] INFO [p-d4ed238466ce-WaitForSshToSucceed] 5f79b1c9-b7d6-41d0-a933-0c

Altus Director 6.3 Bootstrap of CDH6.3 clusters are failing due to failed activation of parcels. We've successfully deployed earlier versions of CDH 6.x.  On all nodes the agent logs show the following error for the same parcel:  [14/Aug/2019 22:45:18 +0000] 31970 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'spark', '-K', 'UMASK=022', '--home', '/var/lib/spark', '--comment', 'Spark', '--shell', '/sbin/nologin', 'spark'][14/Aug/2019 22:45:18 +0000] 31970 MainThread parcel INFO Ensuring correct file permissions for new parcel CDH-6.3.0-1.cdh6.3.0.p0.1279813.[14/Aug/2019 22:45:18 +0000] 31970 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hue/desktop/desktop.db hue hue[14/Aug/2019 22:45:18 +0000] 31970 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813/lib/hue/desktop/desktop.db'][1

I have Ambari 2.7.3 set up on an Ubuntu 16.04 node and it has deployed a three-node cluster node.Ambari Metrics was not working correctly, so I removed it and then re-installed it through the interface. This appeared to clear up several problems I was seeing in error logs but I'm still not able to see any metrics from any cluster nodes.This seems to be connected to a problem showing up in the Ambari server log which keeps repeating the same error message:2019-08-08 11:56:05,936 ERROR [ambari-client-thread-1655] MetricsRequestHelper:112 - Error getting timeline metrics : Server returned HTTP response code: 503 for URL: http://<metrics_collector_node_fqdn>:6188/ws/v1/timeline/metrics?metricNames=swap_free._avg&appId=HOST&startTime=1565286966&endTime=1565290566.So for some reason the node where the metric collector is running is reporting a 503 error. Yet if I look at the logs for the collector and also for each metrics monitor agent, they aren't reporting any errors. I

Are HBase Quotas supported in CDH 6.x?   The hbase.quota.enabled property defaults to false but this property is not listed under the HBase service configuration in Cloudera Manager 6.

Having a problem with HDFS NFS, addressed on another site where it is recommended to set hdfs-site.xml like...<property> <name>dfs.namenode.accesstime.precision</name> <value>3600000</value> <description> The access time for HDFS file is precise upto this value. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. </description> </property>Am confused about what exactly "access times for HDFS" means / is. Looking at the hadoop docs, was still not able to determine. Could someone give better understanding as to what this is doing? Also where is the nfs3 daemon log file ?

Hi All,   I am using Hue--> Hive editor to submit a query on an external table and View created on top an Hbase table. I have 3 instances of Hue running in my cluster(1 among them as Load balancer).   1.When a submit a query from Beeline on this external table and View. It works perfectly fine. 2. When i submit the same query from Hue it doesn't work.(simple query like: select * from hbase_view limit 10) 3. hbase-site.xml, hive-site.xml all have zookeeper.quorum defined correctly(I have 5 zookeeper server instances, so it has 5 nodes in zookeeper.quorum properties). Clientport:2181. That also looks fine.   But I am getting below error in hive-server2.log file when a query is submitted from Hue.   Instead of trying to connect to one of the zookeeper host, it is trying to connect to localhost4/127.0.0.1:2181. This is not the case when query runs successfully, it takes any of the zookeeper node for client connection.   2019-08-13 22:10:23,353 INFO  org.apa

Let's assume that I have a table   test_tbl which was created through impala-shell.I have a few questions :REFRESH the table only when I add new data through HIVE or HDFS commands ? That is when I am doing insert into ...through impala-shell no need for refreshing ?INVALIDATE METADATA  of the table only when I change the structure of the table (add columns, drop partitions) through HIVE? DROPping partitions of a table through impala-shell (i.e alter table  .. drop partition .. purge).  Do I have to do REFRESH or INVALIDATE METADATA?DROPping partitions of a table through impala-shell . How can I compute the new stats of the partitioned table?  Compute incremental stats OR Drop Incremental stats before dropping partition ? Thanks in advance. 

I could see the below configurations coming from desired config output from configuration dump through ambari.usersync-propertiesslider-clientranger-sitehst-common-confcapture-levelsBut when i used to get the properties output usings config.py its throwing the below error.File "/usr/lib64/python2.7/site.py", line 556, in main()File "/usr/lib64/python2.7/site.py", line 538, in mainknown_paths = addusersitepackages(known_paths)File "/usr/lib64/python2.7/site.py", line 266, in addusersitepackagesuser_site = getusersitepackages()File "/usr/lib64/python2.7/site.py", line 255, in getusersitepackagesUSER_SITE = get_path('purelib', '%s_user' % os.name)File "/usr/lib64/python2.7/sysconfig.py", line 437, in get_pathreturn get_paths(scheme, vars, expand)[name]File "/usr/lib64/python2.7/sysconfig.py", line 428, in get_pathsreturn _expand_vars(scheme, vars)File "/usr/lib64/python2.7/sysconfig.py", line 156, in _expand_vars_extend_dict(vars, get_config_vars())File "/usr/lib64/python2.7/sysconfig.py"

Hi,I am trying to run spark application which will need access to Hive databases. But Hive databases like FOODMART are not visible in spark session.I did spark.sql("show databases").show(); it is not showing Foodmart database, though spark session is having enableHiveSupport.Below i've tried:1)cp /etc/hive/conf/hive-site.xml /etc/spark2/conf2)Changed spark.sql.warehouse.dir in spark UI from /apps/spark/warehouse to /warehouse/tablespace/managed/hiveEven though it is not working.Please let me know what configuration changes would be required to have this.Please note - Above is working in HDP2.6.5.

Hi Community,   I am we have configured auto TLS on our dev enviroment and trying to switch to custom and not using self signed cert anymore. When i try and upload the.   I have ran    psql (9.2.24)Type "help" for help. postgres=# \c scmYou are now connected to database "scm" as user "postgres".scm=# update CONFIGS set VALUE='false' where ATTR='agent_tls';UPDATE 1scm=# delete from CONFIGS where ATTR='web_tls';DELETE 1scm=# \q   but still cant add cert add custom certs

Hi, I have this situation: my team are using Cloudera Manager, and we want to develop Hue ,one of CDH components, for our need, to replace the original one. I log on the server, replace /mnt/disk1/cloudera/parcels/CDH/lib/hue/ with unzipped tarball documents. What should I do before "make apps"?

The hdfs installation fails with the following error while installing cdh 6.2. Can't open /var/run/cloudera-scm-agent/process/63-hdfs-NAMENODE-format/supervisor_status:Permission denied what would cause this error?      

Community,   Any best practices for the maintenance for production clusters. When we should restart the services generally? - weekly once or monthly once.   Cleaning up log files.  And, also found that yarr logs in HDFS not get deleted according to the retention period. Ref: YARN logs under /tmp/logs/{user.name}/logs not cleared properly   Note: Mainly looking for a cluster in Bank, with regular ingestion using Sqoop and analytics using spark and impala.

Hi All,Today I  have given my CCA175 certification so can anyone please tell me when can I expect the result for the same. RegardsVishal Chhabra

I have a process-group which has to be started via rest-api.Principial it works to start the process-group but processors inside which are marked as "restricted" won't get started, f.e. ExecuteScript, PutFile. These processors remain stopped. No error message. In nifi-app.log are only the started processors listed. No word of the others.In the UI of course I can start these processors.How to solve this via rest-api? Thanks for any help.Using NiFi 1.9.2SUPPLEMENTIt is not a REST-API thing.Tried with NiFi Toolkit (/bin/cli.sh nifi pg-start -pgid 708358fc-016c-1000-0000-00000bf....). All processors get started excepted the restricted ones.So where is the cause and how to fix this?

Hi Team, We are in process on enabling TLS on HS2, I wanted to know/clarify if that happens will Impala be affected?Impala is dependent on HMS and TLS is only limited to hive server 2, given that having TLS enabled on Hive and running Impala without it should be ok or do you see a scenario where this combination may not work? Regards

ERROR transport.SentryTransportPool: Failed to obtain transport for xxx.us.xxx.com:8038: null19/08/08 07:12:27 WARN security.UserGroupInformation: PriviledgedActionException as:xxxx@xxx.xxx.COM (auth:KERBEROS) cause:org.apache.thrift.transport.TTransportException: Peer indicated failure: Problem with callback handler19/08/08 07:12:27 ERROR transport.SentryTransportPool: Failed to obtain transport for xxxx.us.xxx.com:8038: null19/08/08 07:12:30 ERROR tools.SentryShellKafka: Peer indicated failure: Problem with callback handlerorg.apache.sentry.SentryUserException: Peer indicated failure: Problem with callback handlerat org.apache.sentry.core.common.transport.RetryClientInvocationHandler.connect(RetryClientInvocationHandler.java:166)at org.apache.sentry.core.common.transport.RetryClientInvocationHandler.invokeImpl(RetryClientInvocationHandler.java:90)at org.apache.sentry.core.common.transport.SentryClientInvocationHandler.invoke(SentryClientInvocationHandler.java:41)at com.sun.proxy.$Pro

I am trying to export data from Postgres to Hive through Sqoop in Oozie Coordinator Jobs. I set the frequency to 5 MINS.The job is started after the start time and the data is loaded into hive for the first time and after 5 mins frequency the job is started and it is killed.What is the problem here ?Below are my properties and xml file:   Coordinator.xml file: <coordinator-app name="coordinator1" frequency="${frequency}" start="${startTime}" end="${endTime}"timezone="${timezone}" xmlns="uri:oozie:coordinator:0.4"><action><workflow><app-path>${workflowPath}</app-path></workflow></action></coordinator-app>   Job.properties: frequency=5startTime=2019-08-07T10:22ZendTime=2019-08-07T10:32Ztimezone=UTCnameNode=hdfs://HadoopNode3:8020jobTracker=HadoopNode3:8032queueName=defaultoozie.action.sharelib.for.sqoop=sqoop,hiveoozie.use.system.libpath=trueworkflowPath=/user/oozieschedules/sqoop/coordinatoroozie.coord.application.path=/user/oozi

Hi all, I added some new nodes to our impala cluster.On the new nodes, Impala continues to crash with the following error: F0521 12:34:46.838728 5699 llvm-codegen.cc:112] LLVM hit fatal error: Cannot select: 0x7f62888c84c0: ch = store<ST1[%loc.i]> 0x7f622ebc5850, 0x1068b980, 0x1068b850, undef:i64 0x1068b980: i1,ch = load<LD1[%val_ptr.i.i27]> 0x7f626d3d1830, 0x7f622ebc54c0, undef:i64 0x7f622ebc54c0: i64 = add 0x1068bd10, Constant:i64<8> 0x1068bd10: i64,ch = CopyFromReg 0x7f626d3d1830, Register:i64 %vreg21 0x7f622ebc5ab0: i64 = Register %vreg21 0x7f62888c8d10: i64 = Constant<8> 0x7f61b3668260: i64 = undef 0x1068b850: i64,ch = CopyFromReg 0x7f626d3d1830, Register:i64 %vreg20 0x7f62888c8850: i64 = Register %vreg20 0x7f61b3668260: i64 = undefIn function: _ZN6impala26PartitionedAggregationNode12ProcessBatchILb0EEENS_6StatusEPNS_8RowBatchENS_13TPrefetchMode4typeEPNS_12HashTableCtxE.1The issue seems to be related to an hardware in

Scenario:I recently integrated Altus Director with Active Directory for role based authentication & authorisation. After implementation I noticed that the default admin credential (admin/admin) was not working anymore, which was expected. My question is:Is it possible/recommended to create another 'admin' user in Altus director (or in Active Directory) as a master credential just for back-up?Do Altus Director have a Authentication Backend Order (eg. Database then External) like we have in Cloudera Manager?Suppose, if a user is present in admin group as well as readonly group, then what role does Altus Director assumes for that user?Thank you.

I have reading NiFi documentation but I do not found the specifics metrics. There is nothing that explain me what metrics are available here: https://nifi.apache.org/docs.html.

Hello,My ambari agent has lost its heartbeat. I tried restarting the agent/server starting stopping etc but nothing worked.Im really desperate and dont know what to do. Any help would be greatly appreciated. I included the ambari-agent logs below.ERROR 2019-08-02 10:51:04,424 script_alert.py:123 - [Alert][hive_webhcat_server_status] Failed with result CRITICAL: ['Connection failed to http:///templeton/v1/status?user.name=ambari-qa + \nTraceback (most recent call last):\n File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/alerts/alert_webhcat_server.py", line 190, in execute\n url_response = urllib2.urlopen(query_url, timeout=connection_timeout)\n File "/usr/lib64/python2.7/urllib2.py", line 154, in urlopen\n return opener.open(url, data, timeout)\n File "/usr/lib64/python2.7/urllib2.py", line 431, in open\n response = self._open(req, data)\n File "/usr/lib64/python2.7/urllib2.py", line 449, in _open\n \'_open\', req)\n File "/usr/lib64/python2.7/urllib2.py", line