About helmi_khalifa

helmi_khalifa · ‎09-24-2019

HI @hadoopguy Yes there is an impact you will have longer processing time and the operations will be queued. You have to carefully handle the timeout in your jobs. Best, @helmi_khalifa

helmi_khalifa · ‎09-24-2019

Hi Suresh, There is no command but you can easily find the information on the HBase Web UI. http://host:16010/master-status#baseStats Best, Helmi KHALIFA

helmi_khalifa · ‎06-20-2019

Hi rename the file gateway.jks mv /var/lib/knox/data-2.6.4.0-91/security/keystores/gateway.jks /var/lib/knox/data-2.6.4.0-91/security/keystores/gateway.jks.bck when you start the know instance it will create a new certificate. Best, Helmi KHALIFA

helmi_khalifa · ‎06-20-2019

Hi rename the file gateway.jks mv /var/lib/knox/data-2.6.4.0-91/security/keystores/gateway.jks /var/lib/knox/data-2.6.4.0-91/security/keystores/gateway.jks.bck when you start the know instance it will create a new certificate. Best, Helmi KHALIFA

helmi_khalifa · ‎05-27-2019

Hi, Because of too frequent HBase major compaction I am trying to run major compaction manually on all tables using a script. Is there easier way of doing this? Best, Helmi KHALIFA

helmi_khalifa · ‎05-19-2019

Hi, I am encountring slow opertaions problems on HBase cluster. Some queries took more than One minute. When i checked the RegionServers logs i found too frequent major compactions every day on the same Column Family and same regions although we have hbase default parameters (Major compaction once a week)? Any idea how to solve this ? Thanks. Helmi KHALIFA

helmi_khalifa · ‎05-17-2019

Hi Sanket, Did you solve this problem? I am encountring the same problem.. many Major compaction the same day in the same Column Family and the same server? Thanke Helmi KHALIFA

helmi_khalifa · ‎03-07-2019

Hi, I installed : zeppelin 0.8.0 HDP-3.1.0.0 (3.1.0.0-78) then I configured the zeppelin.server.port=8080 The problem now is that it works randomly. When it shows green everything is ok and i see my notebooks but when i login and it still showing red with the message WebSocket Disconnected my notebook disappear and i can't work or create anything! Any help please ? Thanks Best, Helmi KHALIFA

helmi_khalifa · ‎02-25-2019

Hi Geoffrey, Thank you for your answer. I checked the pdf but there are manu differences between yours and mine as it is hdp 2.6.5 Vs hdp 3.1.0.0-78 Thanks, Helmi

helmi_khalifa · ‎02-25-2019

Hi, I installed a cluster HDP-3.1.0.0 (3.1.0.0-78) with HDFS 3.1.1 And I can't execute even an hdfs dfs -ls / Did any one encountred the same problems , please ? Here the errors : /usr/hdp/3.1.0.0-78//hadoop-hdfs/bin/hdfs.distro: line 239: hadoop_abs: command not found /usr/hdp/3.1.0.0-78//hadoop-hdfs/bin/hdfs.distro: line 248: hadoop_need_reexec: command not found /usr/hdp/3.1.0.0-78//hadoop-hdfs/bin/hdfs.distro: line 256: hadoop_verify_user_perm: command not found /usr/hdp/3.1.0.0-78//hadoop-hdfs/bin/hdfs.distro: line 267: hadoop_add_client_opts: command not found /usr/hdp/3.1.0.0-78//hadoop-hdfs/bin/hdfs.distro: line 274: hadoop_subcommand_opts: command not found /usr/hdp/3.1.0.0-78//hadoop-hdfs/bin/hdfs.distro: line 277: hadoop_generic_java_subcmd_handler: command not found Best, Helmi KHALIFA

helmi_khalifa · ‎12-20-2018

hi Muji, Great job 🙂 just missing a ',' after : B_df("_c1").cast(StringType).as("S_STORE_ID") // Assign column names to the Region dataframe val storeDF = B_df.select( B_df("_c0").cast(IntegerType).as("S_STORE_SK"), B_df("_c1").cast(StringType).as("S_STORE_ID"), B_df("_c5").cast(StringType).as("S_STORE_NAME") )

helmi_khalifa · ‎08-20-2018

Hi Neeraj, Allowing read and wright to all users to Poenix SYSTEM tables is not really secure. Is there any solution to avoid it? Thanks Helmi

helmi_khalifa · ‎07-16-2018

Hi, I execute an inner join on 2 tables of 10 Millions records each and i have an outofmemory issue. The columns are both indexed. phoenix.query.maxServerCacheBytes=2147483648 phoenix.query.maxGlobalMemoryPercentage=35 Error: Encountered exception in sub plan [0] execution. (state=,code=0) java.sql.SQLException: Encountered exception in sub plan [0] execution. at org.apache.phoenix.execute.HashJoinPlan.iterator(HashJoinPlan.java:201) at org.apache.phoenix.execute.HashJoinPlan.iterator(HashJoinPlan.java:145) at org.apache.phoenix.execute.HashJoinPlan.iterator(HashJoinPlan.java:140) at org.apache.phoenix.jdbc.PhoenixStatement$1.call(PhoenixStatement.java:281) at org.apache.phoenix.jdbc.PhoenixStatement$1.call(PhoenixStatement.java:266) at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53) at org.apache.phoenix.jdbc.PhoenixStatement.executeQuery(PhoenixStatement.java:265) at org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:1444) at sqlline.Commands.execute(Commands.java:822) at sqlline.Commands.sql(Commands.java:732) at sqlline.SqlLine.dispatch(SqlLine.java:808) at sqlline.SqlLine.begin(SqlLine.java:681) at sqlline.SqlLine.start(SqlLine.java:398) at sqlline.SqlLine.main(SqlLine.java:292) Caused by: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3236) at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:118) at java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93) at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:135) at java.io.DataOutputStream.writeInt(DataOutputStream.java:200) at org.apache.phoenix.util.TupleUtil.write(TupleUtil.java:152) at org.apache.phoenix.join.HashCacheClient.serialize(HashCacheClient.java:125) at org.apache.phoenix.join.HashCacheClient.addHashCache(HashCacheClient.java:85) at org.apache.phoenix.execute.HashJoinPlan$HashSubPlan.execute(HashJoinPlan.java:387) at org.apache.phoenix.execute.HashJoinPlan$1.call(HashJoinPlan.java:169) at org.apache.phoenix.execute.HashJoinPlan$1.call(HashJoinPlan.java:165) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask.run(JobManager.java:183) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748)

helmi_khalifa · ‎06-07-2018

Hi, We need to index some columns on hbase tables. Any recommandations or best practises using the secondary-index , please? Thanks Helmi KHALIFA

helmi_khalifa · ‎03-06-2018

Hi, i wanna use hbase rsgroups too but it seems that it is not enough mature..? I am using hbase 1.1.2 and i tested the rsgroup properties and it works. Did you still have the same problem, yet? BR, Helmi Khalifa

helmi_khalifa · ‎01-30-2018

thank you @Josh Elser 🙂

helmi_khalifa · ‎01-30-2018

Hi ! I need to store some HBase tables/namespace in a dedicated servers in a large cluster. So how can we configure it? How can we dedicate only 2 servers for some tables/namespace, on a cluster of 10 servers? Thanks

helmi_khalifa · ‎01-17-2018

is there any best practices for tunning the Spark Streaming optimal number of executors Vs the number of Kafka partitions? NB. We have 20 Kafka partitions (1 To of logs per day) and 21 Spark Streaming Executors. Unfortunately, this configuration blocks 400 GB of RAM even when there is no event. thanks.

helmi_khalifa · ‎11-23-2017

Hi, here is a repo for Helium packages: https://github.com/zeppelin-project/helium-packages

helmi_khalifa · ‎10-19-2017

Yes ii works ! Thank you @Aditya Sirna 🙂

helmi_khalifa · ‎10-19-2017

I need to check the permission of a user. Actually the only way i found is : user_permission 'table_name'. using this CLI i should execute it for each table... is there another way to get all the user permissions in all tables? Thanks Helmi

helmi_khalifa · ‎10-11-2017

Thank you @Matt Burgess 🙂

helmi_khalifa · ‎10-11-2017

Thank you @Benjamin Hopp I will try it 🙂

helmi_khalifa · ‎10-11-2017

I am using NiFi to ingest data into a mongoDB data base. I need to delete some documents. How can i proceed ? what processor can i use to remove a document from MongoDb? thanks. Helmi

helmi_khalifa · ‎07-22-2017

I am using the same syntax as yours but it does'nt work. there are some missing properties in the hive-site.xml file. I added these properties in my comment below and it works now mapred.input.dir.recursive hive.mapred.supports.subdirectories Thanks

helmi_khalifa · ‎07-21-2017

is that the only properties I need to add into the hive-site.xml? <property> <name>mapred.input.dir.recursive</name> <value>true</value> </property> <property> <name>hive.mapred.supports.subdirectories</name> <value>true</value> </property>

helmi_khalifa · ‎07-21-2017

it is a directory with many folders /log/20170721 /log/20170720 /log/20170719

helmi_khalifa · ‎07-21-2017

An error occur when i try to load data from hdfs directory with multy level directories? Should change some properties in the hive-site.xml? Thanks

helmi_khalifa · ‎06-26-2017

You should use the ambari credentials user:password

helmi_khalifa · ‎12-16-2016

Thank you! 🙂

Online	Offline
Last Visited	‎10-21-2019 01:11 PM

Date Registered	‎08-05-2016 07:49 AM
Last Visited	‎10-21-2019 01:11 PM
Total Messages Posted	34

Re: How to Load data from hdfs Multi level directo...

Re: How to move all the regions of a region server...

Re: How to find number of regions per region serve...

Re: Knox Gateway Start fail

Re: Knox Gateway Start fail

How can i manually run hbase major compaction on a...

Too frequent major compaction every day ?

Re: Too frequent major compaction

Zeppelin 0.8.0 shows disconnected and my notebooks...

Re: problem executing ls with hdfs 3.1

problem executing ls with hdfs 3.1

Re: Specify Schema for CSV files with no header an...

Re: Apache Ranger and HBase

Inner join Phoenix query out of memory ?

What are the best practices for HBase secondary in...

Re: multi-tenancy HBase - grouping of Region Serve...

Re: HBase how to configure the table location ?

HBase how to configure the table location ?

Kafka Vs Spark Streaming resource allocatoin?

Re: How to add %helium and %dev interpreter in a ...

Re: HBase: How to get all user's permissions ?

HBase: How to get all user's permissions ?

Re: what Nifi processor can i use to remove a docu...

Re: what Nifi processor can i use to remove a docu...

what Nifi processor can i use to remove a document...

Re: How to Load data from hdfs Multi level directo...

Re: How to Load data from hdfs Multi level directo...

Re: How to Load data from hdfs Multi level directo...

How to Load data from hdfs Multi level directory i...

Re: Ambari server on Hortonworks sandbox is gettin...

Re: process, parse and validate an xml file in hdf...