Member since
02-01-2019
650
Posts
143
Kudos Received
117
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3508 | 04-01-2019 09:53 AM | |
| 1814 | 04-01-2019 09:34 AM | |
| 8925 | 01-28-2019 03:50 PM | |
| 1972 | 11-08-2018 09:26 AM | |
| 4483 | 11-08-2018 08:55 AM |
05-27-2018
05:50 PM
curl -u admin:admin -H 'X-Requested-By:admin' -X PUT 'http://localhost:8080/api/v1/clusters/cc' -d '{
"Clusters": {
"desired_config": {
"type": "core-site",
"tag": "version1527441356254688",
"properties": {
"security.admin.operations.protocol.acl" : "hadoop",
"security.client.datanode.protocol.acl" : "*",
"security.client.protocol.acl" : "*",
"security.datanode.protocol.acl" : "*",
"security.inter.datanode.protocol.acl" : "*",
"security.inter.tracker.protocol.acl" : "*",
"security.job.client.protocol.acl" : "*",
"security.job.task.protocol.acl" : "*",
"security.namenode.protocol.acl" : "*",
"security.refresh.policy.protocol.acl" : "hadoop",
"security.refresh.usertogroups.mappings.protocol.acl" : "hadoop"
}
}
}
}'
... View more
05-27-2018
05:19 PM
@Michael Bronson
You can use the current epoch timestamp as tag. configs.py internally uses the same. In python: "version"+str(int(time.time() * 1000000)) tag will be something like : "version1527441356254688"
... View more
05-24-2018
08:53 AM
@RAUI Hive Bucketed tables is not yet supported by Spark. https://spark.apache.org/docs/2.3.0/sql-programming-guide.html#unsupported-hive-functionality
... View more
05-23-2018
05:18 PM
@jad As long as you are configuring it right there shouldn't be any issues with non-ambari installation.
... View more
05-22-2018
06:15 AM
@Sungwoo Park: This is not normal and there is a security breach in your environment. Please refer this thread: https://community.hortonworks.com/questions/191898/hdp-261-virus-crytalminer-drwho.html
... View more
05-18-2018
09:05 AM
@Rajesh Reddy AFAIK we don't have any option to rename the topic in Kafka.
... View more
05-17-2018
02:12 PM
1 Kudo
@Gerd Koenig Is your broker using the jaas (username/password) you created? The SASL/PLAIN configuration is well documented here, Do ensure the username and password are in the jaas which broker loading in classpath.
... View more
05-17-2018
01:21 PM
1 Kudo
@Ruslan Fialkovsky Thanks for reporting. I've filed an internal jira to get Superset added in release notes. Our doc team will review and add it accordingly.
... View more
05-17-2018
10:56 AM
@John Doe Do you have enough permissions on this directory /home/jdoe/spark-warehouse ?
... View more
05-16-2018
01:29 PM
5 Kudos
@Huy Duong We've recently sent out a security notification regarding the same. 1. Stop further attacks: a. Use Firewall / IP table settings to allow access only to whitelisted IP addresses for Resource Manager port (default 8088). Do this on both Resource Managers in your HA setup. This only addresses the current attack. To permanently secure your clusters, all HDP end-points ( e.g WebHDFS) must be blocked from open access outside of firewalls. b. Make your cluster secure (kerberized). 2. Clean up existing attacks: a. If you already see the above problem in your clusters, please filter all applications named “MYYARN” and kill them after verifying that these applications are not legitimately submitted by your own users. b. You will also need to manually login into the cluster machines and check for any process with “z_2.sh” or “/tmp/java” or “/tmp/w.conf” and kill them. Hortonworks strongly recommends affected customers to involve their internal security team to find out the extent of damage and lateral movement inside network. The affected customers will need to do a clean secure installation after backup and ensure that data is not contaminated.
... View more