Member since
09-29-2016
42
Posts
1
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
11734 | 07-11-2018 09:39 AM | |
11655 | 12-13-2016 02:59 PM |
12-13-2016
09:27 AM
1 Kudo
hi All i am trying to run debug spark program in eclipse on Cloudera cluster on AWS EC2. i tried val conf = new SparkConf().setAppName("WordCount").setMaster("yarn-client") val conf = new SparkConf().setAppName("WordCount").setMaster("local[3]") i find out i am facing an issue . the namenode in the AWS EC2 cluster return me the private IP in AWS.like 172.31.26.79,172.31.26.80 etc.. which my local windows mechine not able to resolve . Any idea how to handle all this ?
... View more
Labels:
- Labels:
-
Apache Spark
12-03-2016
09:51 AM
if i select ip-172-31-26-41.us-west-1.compute.internal. host to run test on ip-172-31-26-40.us-west-1.compute.internal . it is working fine . but if select ip-172-31-26-40.us-west-1.compute.internal to run test on its own db the connection not able to get through. Anyone have any idea?
... View more
12-01-2016
02:13 PM
i am trying to run the test connection from Cloudera Manger it stuck for ever. but i can connect the same host and database from command line . i think the issue mostly is the cloudera embed db. but still not sure why and hot to fix
... View more
12-01-2016
11:40 AM
i checked clouder-scm-server-db it is working fine and i can manually connect to database by using info in db.mgmt.properties file .not sure whats wrong ~
... View more
11-30-2016
10:48 AM
i that because of iptable? but i already disable the iptable and firewall please check the picture
... View more
11-29-2016
11:15 PM
Hi
my cluster was running fine ,but after i enable the graphic model in AWS RedHat i am not able to start management service. i got below error .
i checked Selinux and iptables all disabled and the firewall also disabled . Any idea what can cause this issue ?
i think mostly is step 2 but not sure which step.
AWS suggest step to enable graphic model:
1. install graphic model
2. setup XRDP
1. Add the xrdp repository: sudo rpm -Uvh http://li.nux.ro/download/nux/dextop/el7/x86_64/nux-dextop-release-0-1.el7.nux.noarch.rpm
2. Install xrdp and tiger VNC server: sudo yum install -y xrdp tigervnc-server
3. 3. Setup SELINUX security: chcon --type=bin_t /usr/sbin/xrdp && chcon --type=bin_t /usr/sbin/xrdp-sesman
4. Start and enable the xrdp service: sudo systemctl start xrdp && sudo systemctl enable xrdp
5. Enable RDP port on the instance: sudo firewall-cmd --permanent --add-port=3389/tcp && sudo firewall-cmd --reload (I already disable the firewall so i am able to login CM 7180)
6. Set a password for ec2-user . This password will be used to connect to the RDP session: sudo passwd ec2-user
7. Set password for root as you will be prompted for cloud user password for network proxy and color. Login as root and set the password: sudo su && passwd
2016-11-30 01:48:38,781 WARN 1137398285@scm-web-11:com.cloudera.server.web.cmf.EventsController: Exception querying events
org.apache.avro.AvroRemoteException: java.net.ConnectException: Connection refused
at org.apache.avro.ipc.specific.SpecificRequestor.invoke(SpecificRequestor.java:88)
at com.sun.proxy.$Proxy108.queryEvents(Unknown Source)
at com.cloudera.cmf.event.query.AvroEventStoreQueryProxy.doQuery(AvroEventStoreQueryProxy.java:160)
at com.cloudera.server.web.cmf.events.EventDao.findEvents(EventDao.java:361)
at com.cloudera.server.web.cmf.EventsController.query(EventsController.java:166)
2016-11-30 01:37:20,582 WARN 1289534149@scm-web-4:com.cloudera.server.web.cmf.StatusProvider: Failed to submit task for getting status from SERVICE_MONITORING
com.cloudera.cmon.MgmtServiceNotRunningException: SERVICE_MONITORING is not running
at com.cloudera.cmon.MgmtServiceLocator.getNozzleIPC(MgmtServiceLocator.java:145)
at com.cloudera.server.web.cmf.StatusProvider$SubjectStatusCustomFuture.<init>(StatusProvider.java:618)
at com.cloudera.server.web.cmf.StatusProvider.getStatus(StatusProvider.java:1043)
Caught unexpected exception in main loop.
Traceback (most recent call last):
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.2-py2.7.egg/cmf/agent.py", line 710, in start
self._init_after_first_heartbeat_response(resp_data)
File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.2-py2.7.egg/cmf/agent.py", line 840, in _init_after_first_heartbeat_response
self.client_configs.load()
... View more
Labels:
- Labels:
-
Cloudera Manager
10-09-2016
08:11 PM
i terminate the instance and start over again the issue gone , thank you for all your help
... View more
10-08-2016
10:48 PM
1 last error Hive metastore still have error . check server log find out below error (1 skipped) Error fetching metrics at 'http://ip-172-31-15-163.us-west-1.compute.internal:25000/jsonmetrics?json' Traceback (most recent call last): File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.2-py2.7.egg/cmf/monitor/generic/metric_collectors.py", line 200, in _collect_and_parse_and_return self._adapter.safety_valve)) File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.8.2-py2.7.egg/cmf/url_util.py", line 204, in urlopen_with_retry_on_authentication_errors
... View more
10-08-2016
02:46 PM
thank you for your reply . after apply your suggestion i facing below error again.i find out someone said it is a bug but not impact running .Please help to give some input ERROR org.apache.hadoop.hdfs.KeyProviderCache [pool-4-thread-1]: Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !!
... View more
10-06-2016
10:40 PM
i run below query and i am able to connect to PostgreSQL psql -h ip-172-31-15-162.us-west-1.compute.internal -p 7432 -d hive -U hive i checked the log file now the error is WARN DataNucleus.Query: [main]: Query for candidates of org.apache.hadoop.hive.metastore.model.MVersionTable and subclasses resulted in no possible candidates Required table missing : ""VERSION"" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrect, or you need to enable "datanucleus.autoCreateTables" org.datanucleus.store.rdbms.exceptions.MissingTableException: Required table missing : ""VERSION"" in Catalog "" Schema "". DataNucleus requires this table to perform its persistence operations. Either your MetaData is incorrect, or you need to enable "datanucleus.autoCreateTables" at org.datanucleus.store.rdbms.table.AbstractTable.exists(AbstractTable.java:485)
... View more
- « Previous
-
- 1
- 2
- Next »