About yukti

yukti · ‎09-25-2019

2019-09-25 15:27:04,797 INFO scm-web-56864:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/services/7/serviceSummary 2019-09-25 15:27:04,798 INFO scm-web-56365:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/services/7/healthStatusBar 2019-09-25 15:27:04,817 INFO scm-web-56864:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/services/7/serviceSummary, Status:200 2019-09-25 15:27:04,819 INFO scm-web-56365:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/services/7/healthStatusBar, Status:200 2019-09-25 15:27:09,886 WARN avro-servlet-hb-processor-10:com.cloudera.server.cmf.AgentProtocolImpl: Received an optimized heartbeat for a host with ID '21db8408-a064-49b4-a9e5-5a207b9c40fe ' that is not recognized

yukti · ‎09-25-2019

Cloudera agent is not able to communicate with cloudera manager server. giving error invalid uuid. I have checked the uuid its correct. In server logs it is taking some different uuid.

yukti · ‎09-11-2019

@EricL Hi Eric it was pointing to wrong spark conf so I replaced it with the new one. But now its giving me another error. I will open anew thread for another error.

yukti · ‎09-09-2019

Hi Eric please see the attached error logs. @EricL

yukti · ‎09-06-2019

CREATE TABLE IF NOT EXISTS mydb.employees ( name STRING COMMENT 'Employee name', salary FLOAT COMMENT 'Employee salary', subordinates ARRAY<STRING> COMMENT 'Names of subordinates', deductions MAP<STRING, FLOAT> COMMENT 'Keys are deductions names, values are percentages', address STRUCT<street:STRING, city:STRING, state:STRING, zip:INT> COMMENT 'Home address') COMMENT 'Description of the table' TBLPROPERTIES ('creator'='me', 'created_at'='2012-01-02 10:00:00', ...) LOCATION '/user/hive/warehouse/mydb.db/employees'; you can use struct as given in example.

yukti · ‎09-06-2019

while running a normal spark job SparkContext is not getting initialized giving below error: [Thread-6] ERROR org.apache.spark.SparkContext - Error initializing SparkContext. org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. I believe it is pointing to standby NN. This error is coming after we enabled Namenode HA in our cloudera's cluster. I have checked hive-site.xml, core-site.xml and spark-defaults.xml. These all are havinf correct configs pointing to nameservice id.

yukti · ‎09-02-2019

Hi Team, I was trying to read data from kafka topics by using hive table. SInce my data is in avro format so trying to create a hive using below statement: CREATE EXTERNAL TABLE kafka_t_avro (`timestamp` timestamp , `page` string, `newPage` boolean, added int, deleted bigint, delta double) STORED BY 'org.apache.hadoop.hive.kafka.KafkaStorageHandler' TBLPROPERTIES ("kafka.topic" = "topic-name", "kafka.bootstrap.servers"="hostname:9092", "kafka.serde.class"="org.apache.hadoop.hive.serde2.avro.AvroSerDe"); It is giving me below error: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: MetaException(message:java.lang.ClassNotFoundException Class org.apache.hadoop.hive.kafka.KafkaSerDe not found). I have added the below jars in my class path: kafka-handler-3.1.0.3.1.0.0-78.jar; hive-serde-0.10.0.jar; hive-exec-3.1.0.3.1.0.0-78.jar; @jsensharma

yukti · ‎09-02-2019

Thanks jay!!! I am starting a new thread.

yukti · ‎09-02-2019

Hi jay, That issue get resolved but then I tried altering table it was giving me error: hive> ALTER TABLE kafka_table SET TBLPROPERTIES ("kafka.serde.class"="org.apache.hadoop.hive.serde2.avro.AvroSerDe"); FAILED: SemanticException [Error 10134]: ALTER TABLE cannot be used for a non-native table kafka_table So I dropped that table ad try creating a new one having below statements: CREATE EXTERNAL TABLE kafka_t_avro (`timestamp` timestamp , `page` string, `newPage` boolean, added int, deleted bigint, delta double) STORED BY 'org.apache.hadoop.hive.kafka.KafkaStorageHandler' TBLPROPERTIES ("kafka.topic" = "topic-name", "kafka.bootstrap.servers"="hostname:9092", "kafka.serde.class"="org.apache.hadoop.hive.serde2.avro.AvroSerDe"); Itsi sgiving me below error: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: MetaException(message:java.lang.ClassNotFoundException Class org.apache.hadoop.hive.kafka.KafkaSerDe not found)

yukti · ‎09-01-2019

I am trying to create hive table to read data from kafka topics. I am using CDH 6.2.0. I am adding the below jar before creating the table : kafka-handler-3.1.0.3.1.0.0-78.jar; hive-serde-0.10.0.jar; hive-metastore-0.9.0.jar; below is the create table statement: CREATE EXTERNAL TABLE kafka_table (`timestamp` timestamp , `page` string, `newPage` boolean, added int, deleted bigint, delta double) STORED BY 'org.apache.hadoop.hive.kafka.KafkaStorageHandler' TBLPROPERTIES ("kafka.topic" = "topic-name", "kafka.bootstrap.servers"="hostname:9092"); giving me below error: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.metastore.DefaultHiveMetaHook org/apache/hadoop/hive/metastore/DefaultHiveMetaHook Error: Error running query: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/metastore/DefaultHiveMetaHook (state=,code=0)

Online	Offline
Last Visited	‎10-22-2019 11:28 PM

Member Since	‎09-01-2019 08:05 PM
Last Visited	‎10-22-2019 11:28 PM
Posts	14
Kudos received	2

Cloudera Community

Re: HIVE DATA TYPE

Re: Host with invalid Cloudera Manager Agent UUID ...

Host with invalid Cloudera Manager Agent UUID dete...

Re: SparkContext giving error in initialization : ...

Re: SparkContext giving error in initialization : ...

Re: HIVE DATA TYPE

SparkContext giving error in initialization : org....

Hive kafka integration giving error class not foun...

Re: Creating hive table to read data from kafka to...

Re: Creating hive table to read data from kafka to...

Creating hive table to read data from kafka topics...