how to more hive performance!

hugo1 · ‎08-16-2018

I have a hadoop cluster in google cloud but in recent days I have suffered with slow queries, using beeline and hive .. beeline internally and hive externally, I have below some screens that show me errors. I would like to know how to edit the memory allocated for java. Today is -Xmx512m -Xms512 ... and wanted to switch to -Xmx1024m -Xms1024 to validate if this can bring me more performance!

hugo1 · ‎07-25-2018

Hi, @Geoffrey Shelton Okot sorry for the delay in return, the problem still continues .. if I have files with short names it works .. but files with big names generate this error below.

hugo1 · ‎07-19-2018

@Pedro Andrade Yes, Ambari is on the same disk .. I'm using an IBM managed service.

hugo1 · ‎07-19-2018

Hi @Geoffrey Shelton Okot, how are you? Thanks for the tip, this helped me. my problem now is with the file name, it is too big, how can I get around this?

hugo1 · ‎07-18-2018

Hi Paulo, could you give me an example of how I can execute this command? Another question is .. when accessing the panel of Ambari, I see that I have a large space available .. however when accessing the system if a df -h is executed the size is not even close to what is presented in the Ambari panel. Ambari: Terminal:

hugo1 · ‎07-18-2018

Hi Guys, how are you? I have a question and I believe you can help me solve it! I have a folder with txt files that are in a directory "/ home / files" now I need to make this folder available for a hadoop query with hive, I tried to execute the command "hdfs move -p / home / files | -f / home / new" but it has not worked. I found in this manual: https://hadoop.apache.org/docs/r2.6.5/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html

hugo1 · ‎07-02-2018

Hi, how are you? I even noticed that things do not work out like I imagined, lol! I found the documentation after your first tip, thanks for this. My problem now, is to map my IBM CloudStorage to my Hadoop, this is making me confused, but I'm evolving!

hugo1 · ‎07-02-2018

Hey, it worked out right .. thanks for the tip! Now another point, how do I access this directory? I tried the "hdfs dfs -cd / tmp /" command, but it did not work! I wanted to get into that directory and copy the data there with "wget" and then unzip them with a "tar -xzvf"

hugo1 · ‎07-02-2018

Hi Guys, how are you? Hope so. I have a question, see if you can help me. Everything I create through the web interface only appears in the web interface, if I create a folder in / tmp for example, via terminal, it is not available in the Ambari interface and vice-versa. Even setting groups and permissions ... I'm using IBM's Hadoop service.

Online	Offline
Last Visited	‎08-16-2018 09:18 PM

Date Registered	‎07-02-2018 02:19 PM
Last Visited	‎08-16-2018 09:18 PM
Total Messages Posted	9

how to more hive performance!

Re: Import data.

Re: Import data.

Re: Import data.

Re: Import data.

Import data.

Re: how to import data

Re: how to import data

how to import data