Used to be able to do a metadata query through the Navigator web page but now I just get the spinner.   /var/log/cloudera-scm-navigator mgmt-cmf-mgmt-NAVIGATOR-quickstart.cloudera.log.out   Looking through the log I find this error:   2015-09-23 14:58:04,267 ERROR com.cloudera.navigator.NavigatorEntityManager: Error running command for table NAVMS_AUDIT_EVENTS com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate key name 'IDX_DISALLOWED_NAVMS_AUDITS' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at com.mysql.jdbc.Util.handleNewInstance(Util.java:377) at com.mysql.jdbc.Util.getInstance(Util.java:360) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:978) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3887) at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3823)   and other similar errors: 2015-09-23 14:47:14,448 ERROR com.cloudera.navigator.NavigatorEntityManager: Error running command for table SOLR_AUDIT_EVENTS com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate key name 'IDX_DISALLOWED_SOLR_AUDITS' 2015-09-23 14:58:04,294 ERROR com.cloudera.navigator.NavigatorEntityManager: Error running command for table SENTRY_AUDIT_EVENTS com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate key name 'IDX_DISALLOWED_SENTRY_AUDITS'         ... View more

If I'm in Navigator, this gives me all entities that have been tagged with "tag2": http://localhost:7187/?view=resultsView&facets=%7B%22tags%22%3A%5B%22tag2%22%5D%7D   If I use the RESTful API, this query gets me all the tags that were used - but 0 count (see below) because no entities were returned: http://localhost:7187/api/v1/interactive/entities?facetFields=tags   How do I query the RESTful API to get back all entities with tags?  Also I would like to restrict the query by last modified but that filter doesn't seem to be working.   I see the API doc page here, but examples are limited: http://cloudera.github.io/navigator/apidocs/v1/   { "offset": 0, "totalMatched": 0, "limit": 100, "results": [], "highlighting": null, "facets": { "tags": { "sample": 0, "sometag": 0, "tag1": 0, "tag2": 0, "tag3": 0 } }, "facetQueries": null, "facetRanges": [], "qtime": 1 }     ... View more

Using the 5.3.0 Virtualbox VM; trying to start the cluster; used to work but no longer, now getting this error message:   Command 'Start' failed for cluster 'Cloudera QuickStart' Command 'ZkStartPreservingDatastore' failed for service 'zookeeper'   Zookeeper appears to be running: [cloudera@quickstart ~]$ sudo service zookeeper-server start JMX enabled by default Using config: /etc/zookeeper/conf/zoo.cfg Starting zookeeper ... already running as process 23023.   Not seeing any obvious exceptions in the zookeeper logs.   Then tried starting up hbase and that failed with this error: Service did not start successfully; not all of the required roles started: Service has only 0 Master roles running instead of minimum required 1.   ... View more

So I built the distributed shell example and am using it to run a jar file that does some processing and writes several .json files out to a results folder. I'm passing the path to the script (run.sh) in the shell_script parameter.   The script starts out with:   /usr/java/latest/bin/java -Xmx2G -classpath /<path>/MyMain.jar:<more jars>   The script had been using relative references to the main jar and all the dependencies but it wasn't finding them so I made the paths absolute. If I run the script from the command line in the folder where it resides it will create the results folder there. If I use a container to execute, then I see through logs (from MyMain.jar) that the results folder is being created in appCache but the folder is gone when processing completes; something like this: /yarn/nm/usercache/cloudera/appcache/<applicationId>/<containerId>/results   I want to be able to run multiple containers in parallel, with all sharing the same main jar and dependencies, but each processing through a different set of input files and writing to a separate results folder.   Is there a way to run the container in the context of the folder  where the script is so I can keep relative paths instead of using  absolute paths? Do I hook the container complete event and pull the results folder out of  cache there or is there a better way that is already built into the  infrastructure? Distributed Shell Example source on GitHub    (Crosspost to StackOverflow) ... View more

Running the CDH 5.3.0 Quickstart VM; submitted a MR job and it was just sitting in YARN with no indication of progress.   http://quickstart.cloudera:8088/cluster/   Cloudera Manager shows lots of systems with log out of space errors so I looked through the filesystem for where I could free up space; found what appears to be excessive usage in the YARN usercache folder (6 GB in use).   File location is: /yarn/nm/usercache/[user]/filecache   Can I just delete the cache manually or is there a better way?  Is there a way to configure YARN to use less space?         ... View more

Looking for a REST API to get jobs history.   I don't see any jobs listed in the web UI even though I've had lots of activity: http://quickstart.cloudera:19888/jobhistory   Logged in as: dr.who   Do I need to do authentication?   I navigated around and found a rest for cluster info, found the default node under it but no applications running.         ... View more

CM had been working but is now failing to start; appears to start but when I check status it shows as dead. The CM Web Admin Page shows the Loading message spinning with no resolution.   Starting via command line appears to work:   sudo service cloudera-scm-server start Starting cloudera-scm-server: [ OK ]   But when I check status, server is dead:   [cloudera@localhost ~]$ sudo service --status-all | grep cloudera cloudera-scm-agent (pid 9451) is running... cloudera-scm-server dead but pid file exists   Stack trace in log (/var/log/cloudera-scm-server/cloudera-scm-server.log) shows:   2014-06-19 10:13:41,129 WARN [EventStorePublisherWithRetry-0:publish.EventStorePublisherWithRetry@195] Failed to publish event: SimpleEvent{attributes={CLUSTER_ID=[1], SEVERITY=[INFORMATIONAL], SERVICE=[ClouderaManager], COMMAND_ID=[789], COMMAND_RESULT=[Command 'Stop' failed for cluster 'Cloudera QuickStart - C5'], ALERT=[false], USER=[clouderaManager], MESSAGE_CODES=[COMMAND_FAILED_WITH_TARGET], CATEGORY=[AUDIT_EVENT], CLUSTER=[Cloudera QuickStart - C5], COMMAND_STATUS=[FAILED], COMMAND_ARGS=[RestartClusterCmdArgs{restartOnlyStaleServices=false, redeployClientConfig=false}], SERVICE_TYPE=[ManagerServer], COMMAND=[Restart], EVENTCODE=[EV_CLUSTER_RESTARTED]}, content=Command Restart on subject Cloudera QuickStart - C5 failed., timestamp=1403196216196} - 1 of 338 failure(s) in last 1804s java.io.IOException: Error connecting to unknown0800270ffe88:7184 at org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:249) at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:198)   So looks like it is attempting to connect to port 7184; this page shows that to be the  Cloudera Manager Event Server: hthttp://www.cloudera.com/content/cloudera-content/cloudera-docs/CM5/latest/Cloudera-Manager-Installation-Guide/cm5ig_ports_cm.html   Checking the port I see nothing is running on it: sudo netstat -tulpn | grep 7184   Not sure if it is related but I installed Mongo on the box, 2.4 previously (and CM was working) and recently upgraded to 2.6.2 and then CM stopped working.     ... View more