Member since
01-16-2018
40
Posts
0
Kudos Received
0
Solutions
06-12-2019
10:43 AM
@Aditya Sirna @subhash parise @Jay Kumar SenSharma can we kill this application? it is taking too much time to finish
... View more
08-03-2018
05:48 AM
i am using flume to load log files to hdfs using a ftp agent. after loading the log files are being appended and ftp flume agent is transferring the whole log file again, not the appended data. if to transfer only the appended data what should be the solution? any other framework that can load the log files and the appended data as well?
... View more
Labels:
06-11-2018
08:18 AM
h.pngi am trying to fetch some data from twitter, i am getting this exception that the remote host closed the connection during handshake, also java.net.sslhandshake exception, jaava,net.EOF exceptionL: ssl peer has shutdown incorrectly.. any help will be appreciated.
... View more
Labels:
04-27-2018
08:01 AM
tq for all the answers. i had allocated the resources according to the norms and was successful in launching the job.
... View more
04-27-2018
07:54 AM
tq for all the answers, i solved this by starting the infra solr instance
... View more
04-11-2018
07:03 AM
when i try to login to spark shell it is not running. even pyspark is giving the same error that the port 4040 is used already. so i tried to run the spark shell in a port number randomly even then the shell is not invoking. sparkshellfail.png
... View more
Labels:
04-11-2018
06:59 AM
when i try to log into hive shell the shell is not running. it stays at logging initializd for so much time until i kill it manually. i tried with mr even the same issue and tried to debug it is saying fine but after some time it says read timed out. how to solve this issue??hivefail.pnghivefail1mr.png
... View more
- Tags:
- Data Processing
- Hive
Labels:
04-09-2018
11:43 AM
@Tom McCuch my root is denied access to mysql. what should i do to transfer data from sqoop to hdfs sqoop.png
... View more
04-05-2018
01:56 PM
tez.png this is the screenshot of the job, it has taken 100+ seconds already for a query on a 3 line table.
... View more
04-05-2018
01:32 PM
as i run a small query on a small table in hive the job is running for infinite time using tez engine. how to solve this? all these days i had a problem of invoking the hive shell with tez, this has been reslved but now this new error has got appearing.
... View more
Labels:
04-03-2018
08:30 AM
i want to get data from a remote windows location into hdfs/spark streaming using apache kafka and i want this to be done automatically as the data gets into that folder. i am using winscp to load small files, but to do this automatically i need some other platform. can i know how to achieve this?
... View more
Labels:
03-26-2018
10:00 AM
i tried with the parameters that you have mentioned, still the problem persists
... View more
03-26-2018
09:10 AM
tez runtime.io.sort.mb=150mb tez.runtime.unordered.output.buffer.size-mb = 844mb hive.tez.container.size=2000mb hive.tez.java.opts-1600mb
... View more
03-26-2018
08:19 AM
atlas-server-restart-logs.txt this the log file that has been generated while restarting the atlas
... View more
03-26-2018
07:50 AM
select sum(salary) from emp; this is the query being run and on a table consisting of only 5 lines of data. java1.pngjava2.png
... View more
03-26-2018
07:34 AM
i had to change some configurations in the ambari that inturn caused me to restart some of the services of the ambari. atlas was also one of them but when i try to restart it, it is failing continuously, it is asking for a restart again and again.
... View more
Labels:
03-26-2018
07:29 AM
java.pngi am trying to execute a tez job on hive and it is starting the task but is continuously failing saying java lang runtime exception: java out of memory exception. also vertex of the dag failed due to the own task failure. i am trying a very simple task using tez and also tried to increase the container size still the problem persists.
... View more
03-26-2018
07:03 AM
@Sindhu i was succesful in launching the tez engine but now i am getting an error of java lang runtime exception : java outofmemory : java heap size. i tried giving some more memory for the java heap size but it still the task is failing. indhu
... View more
03-20-2018
10:57 AM
previously i got a container issue, now i resovled that issue by creating a folder but now i am getting a different error saying that the tez session is not running.hive2.png
... View more
Labels:
03-20-2018
08:35 AM
i am able to invoke hive usign mr but i want the exec engine as tez, even i tried to use the tez engine after invoking hive by setting set hive.execution.engine-tez, it is still not working.hive1.png
... View more
03-20-2018
08:07 AM
when i try to invoke the hive shell in the command line it is not showing up. error is popping up with an exit code = 1, tez session not running, and exception in the container launch. hive.png
... View more
Labels:
03-05-2018
06:02 AM
kafka1.pngerror as shown below is being aroused even after i chnage thye lisatener poort to 9092 in kafka, i am unadble to send messages from producer to consumer.
... View more
Labels:
01-31-2018
07:36 AM
how is the data from an application server like logs is placed into the flume spooling directory in the local file system so that the data can be loaded into hdfs?
... View more
Labels:
01-29-2018
09:27 AM
last week i tried to restart the server.. it didnot boot and so i have downloaded a new HDP removing the old one and installed it.. now the server is not rebooting again...how to get back the sandbox up and running?
... View more
01-24-2018
08:09 AM
hello andrew, have you installed the python 3.x version? if so how is it running? i am also trying to install python 3.x in my HDP. can you guide me in this?
... View more