Member since
07-31-2013
1924
Posts
462
Kudos Received
311
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1975 | 07-09-2019 12:53 AM | |
| 11895 | 06-23-2019 08:37 PM | |
| 9159 | 06-18-2019 11:28 PM | |
| 10151 | 05-23-2019 08:46 PM | |
| 4587 | 05-20-2019 01:14 AM |
03-28-2017
10:28 PM
Do you use Sentry with HDFS ACL Sync enabled in your cluster, i.e. is HDFS -> Configuration -> "Enable Sentry Synchronization" checked? If yes, is /app or /app/drops configured as a path prefix under HDFS -> Configuration -> "Sentry Synchronization Path Prefixes"? If yes, then Sentry is currently managing all permissions for that path, and will ignore any type of change you try to make. You can use GRANT statements in Hive or Impala to add explicit access to tables or databases using this path as their location field, but direct manipulation of permissions will be entirely ignored. This feature, if you're using it, is further explained at https://www.cloudera.com/documentation/enterprise/latest/topics/sg_hdfs_sentry_sync.html
... View more
03-23-2017
10:21 AM
1 Kudo
That's the right one, but you'll need to perform a cluster-wide client configuration redeploy to have it go to your local gateway configuration: https://www.youtube.com/watch?v=4S9H3wftM_0
... View more
03-23-2017
09:48 AM
1 Kudo
"Service Environment" applies to services, i.e. roles you run via CM. For clients, use the equivalent "Client Environment" valve. FWIW, the Cloudera Manager introduction page goes over the terminology it uses to classify different layers of configuration: https://www.cloudera.com/documentation/enterprise/latest/topics/cm_intro_primer.html#concept_wfj_tny_jk. In your case, clients would mean gateways. P.s. Typically a bad idea to override system jar versions, as the software's been compiled with the version that was included along. Any incompatible changes to methods or availability of classes within the changed version you're forcing the classloader to pick would cause runtime failures (NoSuchMethodError, NoClassDefFound, ClassNotFoundException, etc.). P.p.s. If overriding some pre-included library is the prime purpose, try to use Maven shading with namespace relocation: https://maven.apache.org/plugins/maven-shade-plugin/examples/class-relocation.html
... View more
03-22-2017
09:04 PM
1 Kudo
Passing --mapreduce-job-name just causes the jar name not to be used as the MR job name, which is Sqoop's default behaviour. The inverse doesn't hold true (i.e. the generated jar name does not change).
... View more
03-18-2017
04:32 AM
1 Kudo
Hue's access permission model does not yet allow you to control action types - just the Oozie app on the whole. This would be a feature request if you're looking to control this at a specific user/group level. You can log a JIRA with your desired use-case in detail at https://issues.cloudera.org/browse/HUE. If you're instead looking to ban the whole action, you can reconfigure Oozie Server's oozie-site.xml to override the default list of 'extra' action executors: https://github.com/cloudera/oozie/blob/cdh5.10.0-release/core/src/main/resources/oozie-default.xml#L1608-L1630. The action type icons may still appear on the Hue UI but running them would fail.
... View more
02-26-2017
03:49 AM
You can pass custom into your WF actions that affect most action types that load them automatically. If you use actions within the workflow however, then Oozie prepares a file that you need to manually load into the code, this is described at http://archive.cloudera.com/cdh5/cdh/5/oozie/WorkflowFunctionalSpec.html#a3.2.7_Java_Action Replication for MR submit files (jars/etc.) is a client-side action, it cannot be controlled by a central server.
... View more
02-26-2017
02:47 AM
That property is job-applied, not server controlled. Wherever you are submitting your job from, the local or in-code configuration isn't loading your custom value, so the default value would get used instead. An application can usually discover your configs if the directory carrying the config XML files is on the application's classpath. Read more at https://hadoop.apache.org/docs/current/api/org/apache/hadoop/conf/Configuration.html BTW you shouldn't be using MRv1 anymore, its deprecated. Use YARN with its MRv2 (although, the above fact still remains the same).
... View more
02-24-2017
01:32 AM
What Ben said. To be more specific, duplicate your config of "hfile.format.version" also into the field called "HBase Client Advanced Configuration Snippet (Safety Valve) for hbase-site.xml". The HBase shell's labels related functions look for this value in the client configuration as a pre-check guard before they can be used.
... View more
02-23-2017
08:40 PM
There is no immutability attribute feature in HDFS as there is on certain Linux filesystems. Your best bet is proper access and authentication control.
... View more
01-04-2017
07:57 AM
Have you already ensured your launched app's specific configuration page on the JobHistory reflects the changed configs? Did you ensure to also deploy the client config change via a cluster-wide redeploy? https://www.youtube.com/watch?v=4S9H3wftM_0 I'm able to limit the ports just fine. The test case even passes. Given you appear to have pre-limited iptables rules causing a NoRouteToHost for the IPCs between client and MR2 AM, have you already ensured that among the open port range you are able to make a proper connection by running something outside of CDH such as a simple Python HTTP service (python -m SimpleHttpServer -p some_target_open_range_port) on all NodeManagers and connecting to them from the edge host?
... View more