Member since
12-28-2015
9
Posts
3
Kudos Received
0
Solutions
08-13-2018
05:44 AM
Thanks for your comments, @Akhil S Naik. IIUC, HDP-3.0 is HDP-3.0.0.0-1634 which includes the fix. https://github.com/hortonworks/hadoop-release/commit/2021f4bdce3b27c46edaad198f0007a26a8a1391 We will consider the backport request. I'd like to accept your answer. Thanks again.
... View more
08-09-2018
02:38 AM
We have faced a HDFS performance issue with HDP-2.6.
When i/o intensive jobs are submitted, many BlockSender threads are waited and the number of ThreadsBlocked raises. Then, the performance is down. We investigated the cause and found that the bug is generated by HDFS-11160 and it fixed by HDFS-11187 which isn't included in the latest HDP-2.6. Is there any plan to release a new HDP-2.6? If there is the plan, I hope it includes HDFS-11187. (BTW, HDP-3.0 won't occur the issue since it includes HDFS-11187.)
... View more
Labels:
03-06-2018
05:58 AM
If you can build NiFi, it is not so hard to back-port the whitelist feature to 1.5.0. You only need to cherry-pick two commits. git clone -b rel/nifi-1.5.0 https://github.com/apache/nifi
cd nifi
# cherry-pick NIFI-4761
git cherry-pick 8cb09c301d6fef70cc8a02a4a7e80f3062ab58ae
git cherry-pick e3c661daac69cdb2de43c3d66d9ed1ccc9c8dbc6
# If you need the tar ball
mvn -T 2.0C clean install -DskipTests
# If you need the RPM package
mvn -T 2.0C clean install -DskipTests -Prpm This works fine for us. Thanks.
... View more
08-21-2017
02:00 AM
2 Kudos
I solved this problem after adding this property to core-site.xml. <configuration>
<property>
<name>hadoop.security.authentication</name>
<value>kerberos</value>
</property>
</configuration>
... View more