Member since
10-27-2015
39
Posts
15
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2070 | 04-16-2018 07:46 AM |
12-06-2019
12:09 PM
The following always worked for me: kinit -kt hdfs.keytab hdfs hadoop fs -mkdir /benchmarks hadoop fs -chmod 0777 /benchmarks You can always lock down the directory permissions to only allow a certain group to write to this directory.
... View more
06-19-2018
09:30 AM
Has this situation improved over the past year? Is there any public information on how to secure the back-end database connections?
... View more
04-16-2018
08:25 PM
Assuming that you are referencing Cloudera Navigator Encrypt, as part of the process of encrypting a disk, you can move existing data onto that newly encrypted disk. See the navencrypt-move command. If you are referring to HDFS Transparent Encryption, then you must create a new encryption zone in HDFS (effectively a new directory) and then copy your HDFS data into it. A lot of people ask "How can I encrypt an existing directory". You would have to perform two extra steps and have plenty of available disk space: 1. Rename the existing directory in HDFS: "hdfs dfs -mv /data /data.bak" 2. Set up the encryption zone for /data. "hadoop key create <keyname>; hdfs dfs -mkdir /data; hdfs crypto -createZone -keyName <keyname> -path /data" 3. Copy the data in /data.bak to /data. "hdfs dfs -cp /data.bak/\* /data/" 4. Remove /data.bak. "hdfs dfs -rm -R /data.bak"
... View more
04-16-2018
07:46 AM
In Hadoop and Kafka, one normally would not use RAID or LVM for data disks. Instead each disk has a partition that consumes the entire disk and a filesystem is written to that partition. In the case of NavEnc, after partitioning, each disk is first encrypted and then has the filesystem written on top of the encrypted volume. Tying together multiple disks into one large filesystem is the opposite of what Kafka or Hadoop expect you to do and you lose out on the advantages of parallelism.
... View more
01-24-2018
02:46 PM
And to fully answer myself, here are the links to vendor documentation: Red Hat/CentOS https://access.redhat.com/solutions/8709 https://wiki.centos.org/FAQ/CentOS7#head-8984faf811faccca74c7bcdd74de7467f2fcd8ee https://wiki.centos.org/FAQ/CentOS6#head-d47139912868bcb9d754441ecb6a8a10d41781df Debian/Ubuntu https://wiki.debian.org/DebianIPv6#How_to_turn_off_IPv6 https://wiki.ubuntu.com/IPv6#Disabling_IPv6 Suse https://www.suse.com/support/kb/doc.php?id=7015035 https://www.suse.com/support/kb/doc/?id=7012111
... View more
01-23-2018
11:30 AM
Thanks. It sounds like the following should suffice: sysctl -w net.ipv6.conf.all.disable_ipv6=1 sysctl -w net.ipv6.conf.default.disable_ipv6=1
... View more
01-22-2018
09:41 AM
@Alex, I am curious as to what the Proactive Support tests look for when testing whether IPv6 is enabled. Is it the existence of IPv6 addresses on interfaces or the presence of the IPv6 kernel module? Red Hat's solutions indicate that you can either disable the kernel module via kernel boot options (results in other things breaking) or disable IPv6 on network interfaces via sysctl. Debian appears to be similar.
... View more
10-10-2017
05:15 AM
@sridharm Hue is not written in Java, thus the Oracle connector jar will not work. You want the Oracle Instant Client for Hue Parcel.
... View more