Hi, We have a custom Java code producing messages from file data. We are able to produce the messages but while writing them on to topic it is giving timeout error java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 60000 ms. Has anyone faced similar issue earlier. Any guidance to get this fixed is highly appreciated Regards, Phaneendra ... View more

We have a requirement in pySpark where an aggregated value from a SQL query is to be stored in a variable and that variable is used for SELECTion criteria in subsequent query. For ex: get the max(sales_date) and get the data from table for that date. Can you please share some inputs on this? Regards, Phaneendra ... View more

Hi, We have a large chunk of data which need to be migration from warehouse hosted in SAP HANA into Hadoop (Hive) as one time as well as schedule incremental loads. We were evaluating the options of Sqoop (which seems to have certain restrictions on the JDBC driver on performance front) and the two way approach of loading data from HANA into Flatfiles and then copy those files into Hive. I would like to know if anyone has already done something similar and if they can share their experiences and the recommended methodology for the same. Regards, Phaneendra ... View more