Member since
08-02-2017
11
Posts
0
Kudos Received
0
Solutions
12-04-2017
10:40 AM
I have wrote a Producer application which writes data to kafka topic (converting from strings to bytes). Now i have written structured spark based consumer application which i am trying to read from that topic. I have setup the schema also. But my i get all fields as NULL values as shown below.. +-------------+--------------------+--------+---------+---------+--------------+----+---------+----------------+ | |SENT_TIME|LAST_OCCURANCE|NODE|NODE_TYPE|X733SPECIFICPROB| +-------------+--------------------+--------+---------+---------+--------------+----+---------+----------------+ | null | null | null | null |null | null | null | | null | null| null| null|null| null| null| |null| null| null| null|null| null| null| | null| null| null| null|null| null| null| | null| null| null| null|null| null| null| | null| null| null| null|null| null| null| |null| null| null| null|null| null| null| | null| null| null| null|null| null| null| +-------------+--------------------+-------- May i know where i might have done the mistake?
... View more
Labels:
- Labels:
-
Apache Spark
08-17-2017
02:51 PM
Steps to be performed before submiting the spark jobs from a remote machine. I have tried adding the core.xml and yarn.xml file form master to the remote machine in the spark conf foldern. Still its not working. Can anyone suggest how to perform this step.
... View more
Labels:
- Labels:
-
Apache Spark
08-14-2017
03:22 AM
I have tried doing it by installing mysql and created user and database for hive and granted all its privileges. But when i do the ambari-start, the ambari server wont get strated. I get a message as saying "couldnt get the PID of ambari-server". If anyone knows how to setup ambari with mysql database please reply as soon as possible.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
08-03-2017
10:57 AM
error.txt Can anyone suggest me what to be done to resolve this.
... View more
Labels:
- Labels:
-
Apache Hive
08-03-2017
02:16 AM
Thank you for the reply@Sindhu I tried doing that and the result what i found was as connection refused. #OUTPUT Trying 192.168.56.1... telnet: Unable to connect to remote host: Connection refused So next what is should do to solve this issue.
... View more
08-02-2017
07:47 AM
Metastore connection URL: jdbc:mysql://erblrpc02/hive?createDatabaseIfNotExist=true
Metastore Connection Driver : com.mysql.jdbc.Driver
Metastore connection User: hive
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
Underlying cause: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException : Communications link failure
... View more
Labels:
- Labels:
-
Apache Hive