Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

No Parcels found

No Parcels found

New Contributor

 - Installed CM with version Cloudera Express 5.8.1

 

 - Into the /opt/cloudera/parcels folder copied the below files :

 

 -- manifest.json

 -- CDH-5.8.3-1.cdh5.8.3.p0.2-el7.parcel

 -- CDH-5.8.3-1.cdh5.8.3.p0.2-el7.parcel.sha1

 

Restarted SCM server and agent services on the Centos 7 box.

 

Still, unable to find any packages. Getting the below error :

 

Select the version of CDH

Versions of CDH that are too new for this version of Cloudera Manager (5.8.1) will not be shown.

 
Note: No parcels found from the configured repositories. Try adding a Custom Repository under More Options. Otherwise, you may only proceed with Use Packages.
 
Kindly help !!

 

 

10 REPLIES 10

Re: No Parcels found

Expert Contributor

I assume you are using the wizard in CM to install CDH and you want to install CDH5.8.3 with the LOCAL parcel you copied to /opt/cloudera/parcels.

 

You need to point the wizard to that location.

 

or

 

Point the wizard to the CDH 5.8.3 parcels Cloudera stores.

 

At the Cluster Installation Page of the wizard click on the "More Options" button after the Use Parcels choice.

This will bring you to a Parcels Settings Page

In the "Remote Parcel Repository URLs" section, click on one of the + (plus) signs

In the new blank box  add the location of your parcels directory.

       If you can use the internet pacels location add     http://archive.cloudera.com/cdh5/parcels/5.8.3/     to the box.   Or point to your local parcels.

Save your changes

 

Now you should see the CDH 5.8.3 as a choice in the wizard.  It night take a few minutes to show up.

 

Hope this helps.

 

Tina

Re: No Parcels found

New Contributor

Thank you for your response.

 

As I stated earlier, the three files for 5.8.3 (.parcel, .sha1 and manifest.json) are copied to the local parcels folder.

 

But the files are not picked up.

One thing I thought was : The Cloudera Express edition is 5.8.1, however the parcel files belongs to 5.8.3.  Is this the root cause for the parcels to remain unrecognized?

 

Another question : Do we need to copy above three files to both parcels and parcel-repo folder? [I could not find this info easily on the document.]

 

Thanks in advance.

Highlighted

Re: No Parcels found

Expert Contributor

Yes, you are correct, CM5.8.1 will not see or install CDH5.8.3.   CM version has to be equal or higher than the CDH version.

 

I think the parcels should be in the parcel-repo folder, let me test it out.

Re: No Parcels found

Expert Contributor

/opt/cloudera/parcel-repo    is where you would add your .parcel files.    I added my cdh parcels there, but the install wizard does not pick them up.  I am not sure why.  If I find out I will enter a reply.

 

Sorry about that,

 

Tina

Re: No Parcels found

Super Guru

The sha files in /opt/cloudera/parcel-repo should be named with ".sha" not ".sha1".

 

Try renaming the .sha1 files to .sha

 

Here is an example:

 

-rw-r----- 1 cloudera-scm cloudera-scm 1481953322 Nov 18 05:15 CDH-5.8.4-1.cdh5.8.4.p0.117-el6.parcel
-rw-r----- 1 cloudera-scm cloudera-scm 41 Nov 18 05:15 CDH-5.8.4-1.cdh5.8.4.p0.117-el6.parcel.sha

 

Regards,

 

Ben

Re: No Parcels found

New Contributor

Thank you.

 

I did not know that the sha1 file to be renamed as sha file.

 

Let me try and get back to you.

Re: No Parcels found

New Contributor

Restarted the Single cluster installation with the above changes.

 

However, the installation is stuck in the below screens and no progress. 

 

CDH_Stuck.jpg

 

Re: No Parcels found

New Contributor

The cloudera-scm-server.log has the following content. Kindly note that the log for "JmxPeriodicLogging" is trimmed in the middle to meet the post max  length constraints.

2016-11-22 11:17:22,771 INFO 315174920@scm-web-7:com.cloudera.server.cmf.components.OperationsManagerImpl: Creating cluster cluster3 with version CDH 5 and rounded off version CDH 5.0.0
2016-11-22 11:17:22,881 INFO 315174920@scm-web-7:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command ProcessStalenessCheckCommand BasicCmdArgs{args=[First reason why: com.cloudera.cmf.model.DbHost.cluster (#3) has changed]}.
2016-11-22 11:17:22,981 INFO ProcessStalenessDetector-0:com.cloudera.cmf.service.config.components.ProcessStalenessDetector: Staleness check done. Duration: PT0.006S
2016-11-22 11:17:23,788 INFO ParcelUpdateService:com.cloudera.parcel.components.ParcelManagerImpl: Distributing parcel CDH:5.8.0-1.cdh5.8.0.p0.42 on cluster cluster3
2016-11-22 11:29:25,443 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-11-22 11:29:25,446 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-11-23T05:59:25.443Z to reap.
2016-11-22 11:29:25,458 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2016-11-22 11:29:39,678 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully.
2016-11-22 11:30:00,077 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing command GlobalPoolsRefresh BasicCmdArgs{scheduleId=1, scheduledTime=2016-11-22T06:00:00.000Z}.
2016-11-22 11:30:00,107 INFO com.cloudera.cmf.scheduler-1_Worker-1:com.cloudera.cmf.scheduler.CommandDispatcherJob: Skipping scheduled command 'GlobalPoolsRefresh' since it is a noop.
2016-11-22 11:39:25,474 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-11-22 11:39:25,477 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-11-23T06:09:25.475Z to reap.
2016-11-22 11:39:25,478 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2016-11-22 11:49:25,488 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-11-22 11:49:25,491 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-11-23T06:19:25.489Z to reap.
2016-11-22 11:49:25,493 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2016-11-22 11:57:59,329 INFO JmxPeriodicLogging-0:com.cloudera.enterprise.PeriodicJmx: JMX: {"beans":[{"name":"java.lang:type=Threading","modelerType":"sun.management.ThreadImpl","ThreadAllocatedMemorySupported":true,"ThreadAllocatedMemoryEnabled":true,"ThreadContentionMonitoringSupported":true,"CurrentThreadCpuTimeSupported":true,"ObjectMonitorUsageSupported":true,"SynchronizerUsageSupported":true,"ThreadContentionMonitoringEnabled":false,"ThreadCpuTimeEnabled":true,"PeakThreadCount":49,"DaemonThreadCount":43,"ThreadCount":44,"TotalStartedThreadCount":97,"AllThreadIds":[106,62,61,54,52,51,50,49,48,45,44,43,42,41,40,39,37,36,35,33,31,30,29,28,27,26,25,23,22,21,20,19,18,16,15,14,13,12,11,10,5,3,2,1], [Manually removed the content here to meet post length constraints] "98thPercentile":0.0,"99thPercentile":0.0}]}
2016-11-22 11:59:23,288 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files CDH-5.8.0-1.cdh5.8.0.p0.42-el7.parcel under /opt/cloudera/parcel-repo
2016-11-22 11:59:25,506 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-11-22 11:59:25,509 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-11-23T06:29:25.507Z to reap.
2016-11-22 11:59:25,510 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Wizard is active, not reaping scanners or configurators
2016-11-22 11:59:33,316 ERROR ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: (5 skipped) Unable to retrieve remote parcel repository manifest
java.util.concurrent.ExecutionException: java.net.ConnectException: https://archive.cloudera.com/accumulo/parcels/1.4/manifest.json
at com.ning.http.client.providers.netty.NettyResponseFuture.abort(NettyResponseFuture.java:297)
at com.ning.http.client.providers.netty.NettyConnectListener.operationComplete(NettyConnectListener.java:104)
at org.jboss.netty.channel.DefaultChannelFuture.notifyListener(DefaultChannelFuture.java:399)
at org.jboss.netty.channel.DefaultChannelFuture.addListener(DefaultChannelFuture.java:145)
at com.ning.http.client.providers.netty.NettyAsyncHttpProvider.doConnect(NettyAsyncHttpProvider.java:1041)
at com.ning.http.client.providers.netty.NettyAsyncHttpProvider.execute(NettyAsyncHttpProvider.java:858)
at com.ning.http.client.AsyncHttpClient.executeRequest(AsyncHttpClient.java:512)
at com.ning.http.client.AsyncHttpClient$BoundRequestBuilder.execute(AsyncHttpClient.java:234)
at com.cloudera.parcel.components.ParcelDownloaderImpl.getRepositoryInfoFuture(ParcelDownloaderImpl.java:534)
at com.cloudera.parcel.components.ParcelDownloaderImpl.getRepositoryInfo(ParcelDownloaderImpl.java:492)
at com.cloudera.parcel.components.ParcelDownloaderImpl.syncRemoteRepos(ParcelDownloaderImpl.java:344)
at com.cloudera.parcel.components.ParcelDownloaderImpl$1.run(ParcelDownloaderImpl.java:416)
at com.cloudera.parcel.components.ParcelDownloaderImpl$1.run(ParcelDownloaderImpl.java:411)
at com.cloudera.cmf.persist.ReadWriteDatabaseTaskCallable.call(ReadWriteDatabaseTaskCallable.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.ConnectException: https://archive.cloudera.com/accumulo/parcels/1.4/manifest.json
at com.ning.http.client.providers.netty.NettyConnectListener.operationComplete(NettyConnectListener.java:100)
... 16 more
Caused by: java.nio.channels.UnresolvedAddressException
at sun.nio.ch.Net.checkAddress(Net.java:101)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:622)
at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipelineSink.java:139)
at org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:102)
at org.jboss.netty.handler.ssl.SslHandler.handleDownstream(SslHandler.java:467)
at org.jboss.netty.handler.codec.oneone.OneToOneEncoder.handleDownstream(OneToOneEncoder.java:55)
at org.jboss.netty.handler.codec.http.HttpClientCodec.handleDownstream(HttpClientCodec.java:97)
at org.jboss.netty.handler.stream.ChunkedWriteHandler.handleDownstream(ChunkedWriteHandler.java:108)
at org.jboss.netty.channel.Channels.connect(Channels.java:642)
at org.jboss.netty.channel.AbstractChannel.connect(AbstractChannel.java:204)
at org.jboss.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:230)
at org.jboss.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:183)
at com.ning.http.client.providers.netty.NettyAsyncHttpProvider.doConnect(NettyAsyncHttpProvider.java:999)
... 13 more
2016-11-22 11:59:40,888 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully.

Re: No Parcels found

New Contributor

And the cloudera-scm-agent.log has the following :

 

[22/Nov/2016 12:13:12 +0000] 2256 MainThread agent ERROR Failed to handle Heartbeat Response: {u'firehoses': [], u'rm_enabled': False, u'client_configs': [], u'create_parcel_symlinks': True, u'server_managed_parcels': [u'http://inchnsircoeh1v7.tcs.com:7180/cmf/parcel/download/CDH-5.8.0-1.cdh5.8.0.p0.42-el7.parcel'], u'extra_configs': None, u'host_collection_config_data': [{u'config_name': u'host_network_interface_collection_filter', u'config_value': u'^lo$'}, {u'config_name': u'host_disk_collection_filter', u'config_value': u'^$'}, {u'config_name': u'host_fs_collection_filter', u'config_value': u'^$'}, {u'config_name': u'host_log_tailing_config', u'config_value': u'{}\n'}, {u'config_name': u'host_dns_resolution_duration_thresholds', u'config_value': u'{"critical":"never","warning":"1000.0"}'}, {u'config_name': u'host_dns_resolution_enabled', u'config_value': u'true'}, {u'config_name': u'host_clock_offset_thresholds', u'config_value': u'{"critical":"10000.0","warning":"3000.0"}'}], u'apply_parcel_users_groups_permissions': True, u'flood_torrent_port': 7191, u'log_tailing_config': u'{}\n', u'active_parcels': {}, u'flood_rack_peers': [u'10.144.25.53:7191'], u'retain_parcels_in_cache': True, u'processes': [], u'server_manages_parcels': True, u'heartbeat_interval': 15, u'parcels_directory': u'/opt/cloudera/parcels', u'host_id': u'cf78d065-1e07-4388-8bd0-949f038d96dc', u'eventserver_host': None, u'enabled_metric_reporters': [u'ACCUMULO16', u'ACCUMULO16', u'KEYTRUSTEE-KMS_KEYTRUSTEE', u'KMS_KEYTRUSTEE', u'SPARK_ON_YARN-SPARK_YARN_HISTORY_SERVER', u'SPARK_YARN_HISTORY_SERVER', u'SOLR-SOLR_SERVER', u'SOLR_SERVER', u'HBASE-HBASERESTSERVER', u'HBASERESTSERVER', u'HOST', u'KEYTRUSTEE_SERVER-KEYTRUSTEE_PASSIVE_SERVER', u'KEYTRUSTEE_PASSIVE_SERVER', u'IMPALA-STATESTORE', u'STATESTORE', u'SPARK', u'SPARK', u'HBASE', u'HBASE', u'ACCUMULO-ACCUMULO_TRACER', u'ACCUMULO_TRACER', u'HDFS-DATANODE', u'DATANODE', u'ACCUMULO-ACCUMULO_MASTER', u'ACCUMULO_MASTER', u'YARN-RESOURCEMANAGER', u'RESOURCEMANAGER', u'HUE-HUE_SERVER', u'HUE_SERVER', u'ACCUMULO-ACCUMULO_MONITOR', u'ACCUMULO_MONITOR', u'MGMT-EVENTSERVER', u'EVENTSERVER', u'MGMT-NAVIGATORMETASERVER', u'NAVIGATORMETASERVER', u'HBASE-MASTER', u'MASTER', u'KAFKA-KAFKA_BROKER', u'KAFKA_BROKER', u'KEYTRUSTEE_SERVER-DB_PASSIVE', u'DB_PASSIVE', u'HBASE-REGIONSERVER', u'REGIONSERVER', u'SPARK_ON_YARN', u'SPARK_ON_YARN', u'MGMT-REPORTSMANAGER', u'REPORTSMANAGER', u'MGMT-SERVICEMONITOR', u'SERVICEMONITOR', u'IMPALA-IMPALAD', u'IMPALAD', u'MGMT-ALERTPUBLISHER', u'ALERTPUBLISHER', u'HIVE-HIVESERVER2', u'HIVESERVER2', u'MGMT-ACTIVITYMONITOR', u'ACTIVITYMONITOR', u'ISILON', u'ISILON', u'YARN-NODEMANAGER', u'NODEMANAGER', u'MAPREDUCE-FAILOVERCONTROLLER', u'FAILOVERCONTROLLER', u'ACCUMULO', u'ACCUMULO', u'MAPREDUCE', u'MAPREDUCE', u'ZOOKEEPER', u'ZOOKEEPER', u'KMS', u'KMS', u'ACCUMULO16-ACCUMULO16_TRACER', u'ACCUMULO16_TRACER', u'ACCUMULO16-ACCUMULO16_MONITOR', u'ACCUMULO16_MONITOR', u'MGMT-HOSTMONITOR', u'HOSTMONITOR', u'YARN-JOBHISTORY', u'JOBHISTORY', u'KEYTRUSTEE', u'KEYTRUSTEE', u'HDFS-JOURNALNODE', u'JOURNALNODE', u'KAFKA', u'KAFKA', u'IMPALA', u'IMPALA', u'SPARK-SPARK_HISTORY_SERVER', u'SPARK_HISTORY_SERVER', u'KEYTRUSTEE_SERVER-KEYTRUSTEE_ACTIVE_SERVER', u'KEYTRUSTEE_ACTIVE_SERVER', u'HDFS-NAMENODE', u'NAMENODE', u'HUE-BEESWAX_SERVER', u'BEESWAX_SERVER', u'SOLR', u'SOLR', u'ACCUMULO16-ACCUMULO16_TSERVER', u'ACCUMULO16_TSERVER', u'MAPREDUCE-TASKTRACKER', u'TASKTRACKER', u'IMPALA-CATALOGSERVER', u'CATALOGSERVER', u'HDFS-DSSDDATANODE', u'DSSDDATANODE', u'SENTRY', u'SENTRY', u'ACCUMULO16-ACCUMULO16_GC', u'ACCUMULO16_GC', u'MGMT-NAVIGATOR', u'NAVIGATOR', u'HIVE', u'HIVE', u'HBASE-HBASETHRIFTSERVER', u'HBASETHRIFTSERVER', u'SQOOP-SQOOP_SERVER', u'SQOOP_SERVER', u'KAFKA-KAFKA_MIRROR_MAKER', u'KAFKA_MIRROR_MAKER', u'FLUME', u'FLUME', u'HUE', u'HUE', u'HDFS-SECONDARYNAMENODE', u'SECONDARYNAMENODE', u'SENTRY-SENTRY_SERVER', u'SENTRY_SERVER', u'ACCUMULO-ACCUMULO_TSERVER', u'ACCUMULO_TSERVER', u'ACCUMULO-ACCUMULO_GC', u'ACCUMULO_GC', u'HIVE-HIVEMETASTORE', u'HIVEMETASTORE', u'IMPALA-LLAMA', u'LLAMA', u'ACCUMULO16-ACCUMULO16_MASTER', u'ACCUMULO16_MASTER', u'SPARK-SPARK_WORKER', u'SPARK_WORKER', u'MGMT', u'MGMT', u'HIVE-WEBHCAT', u'WEBHCAT', u'SQOOP', u'SQOOP', u'HUE-HUE_LOAD_BALANCER', u'HUE_LOAD_BALANCER', u'ACCUMULO-ACCUMULO_LOGGER', u'ACCUMULO_LOGGER', u'HDFS', u'HDFS', u'FLUME-AGENT', u'AGENT', u'OOZIE', u'OOZIE', u'SQOOP_CLIENT', u'SQOOP_CLIENT', u'OOZIE-OOZIE_SERVER', u'OOZIE_SERVER', u'KMS-KMS', u'KMS', u'HDFS-FAILOVERCONTROLLER', u'FAILOVERCONTROLLER', u'KS_INDEXER', u'KS_INDEXER', u'SPARK-SPARK_MASTER', u'SPARK_MASTER', u'YARN', u'YARN', u'ZOOKEEPER-SERVER', u'SERVER', u'HDFS-NFSGATEWAY', u'NFSGATEWAY', u'HDFS-HTTPFS', u'HTTPFS', u'HUE-KT_RENEWER', u'KT_RENEWER', u'KEYTRUSTEE_SERVER', u'KEYTRUSTEE_SERVER', u'KEYTRUSTEE_SERVER-DB_ACTIVE', u'DB_ACTIVE', u'MAPREDUCE-JOBTRACKER', u'JOBTRACKER', u'KS_INDEXER-HBASE_INDEXER', u'HBASE_INDEXER'], u'flood_seed_timeout': 0, u'eventserver_port': None}
Traceback (most recent call last):
File "/opt/cloudera-manager/cm-5.8.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.1-py2.7.egg/cmf/agent.py", line 1337, in handle_heartbeat_response
self._handle_heartbeat_response(response)
File "/opt/cloudera-manager/cm-5.8.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.1-py2.7.egg/cmf/agent.py", line 1359, in _handle_heartbeat_response
response["flood_torrent_port"])
File "/opt/cloudera-manager/cm-5.8.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.1-py2.7.egg/cmf/agent.py", line 1864, in handle_heartbeat_flood
self.downloader.update_opener(opener)
AttributeError: 'NoneType' object has no attribute 'update_opener'