@DFrank, have you resolved your issue? If so, can you please provide the solution here, as it will make it easier for others to find the answer in the future?  If you are still experiencing the issue, can you provide the information @asish  has requested? ... View more

@nuxeo-nifi, here is the link to the recording: https://youtu.be/8cZJ9CyLYyI.    Hope this helps.  ... View more

Tried follow accordingly, not working at the moment hit the same issue. Will look into other configuration. ... View more

@Ansh001 Just to provide an answer here.   HDP is a no longer supported product and you should not be trying to build or learn on hdp sandbox.  Take a look at CDP Private Cloud Base or CDP Public Cloud.  As @VidyaSargur you can start conversations around becoming a customer with sales.   If you are looking for self-service you can get a trial here of CDP Public Cloud: https://www.cloudera.com/campaign/try-cdp-public-cloud.html   ... View more

@MukaAddA, Welcome to our community! To help you get the best possible answer, I have tagged in our NiFi experts @SAMSAL @cotopaul @steven-matison who may be able to assist you further. Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question. ... View more

@Josh2023 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks. ... View more

@Airtel, Welcome to our community! To help you get the best possible answer, I have tagged in our CDP experts @rki_ @vaishaakb  who may be able to assist you further. Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question. ... View more

Once the data has been read from database, you don't need to write the same data to  file (i.e. CSV ) .  Instead you can write directly into hive table using DataFrame API's.  Once the Data has been loaded you query the same from hive.    df.write.mode(SaveMode.Overwrite).saveAsTable("hive_records")     Ref - https://spark.apache.org/docs/2.4.7/sql-data-sources-hive-tables.html Sample Code Snippet    df = spark.read \ .format("jdbc") \ .option("url", "jdbc:postgresql://<server name>:5432/<DBNAME>") \ .option("dbtable", "\"<SourceTableName>\"") \ .option("user", "<Username>") \ .option("password", "<Password>") \ .option("driver", "org.postgresql.Driver") \ .load() df.write.mode('overwrite').saveAsTable("<TargetTableName>") From hive INFO : Compiling command(queryId=hive_20230607042851_fa703b79-d6e0-4a4c-936c-efa21ec00a10): select count(*) from TBLS_POSTGRES INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, type:bigint, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20230607042851_fa703b79-d6e0-4a4c-936c-efa21ec00a10); Time taken: 0.591 seconds INFO : Executing command(queryId=hive_20230607042851_fa703b79-d6e0-4a4c-936c-efa21ec00a10): select count(*) from TBLS_POSTGRES . . . +------+ | _c0 | +------+ | 122 | +------+      ... View more

@techveera, Welcome to our community! To help you get the best possible answer, I have tagged our CDP experts @vaishaakb @tjangid @rki_  who may be able to assist you further. Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question. ... View more