Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

I have big input file which i want to process and then insert into Oracle databse from java with apache storm application or even with spark application if possible. Can you or someone provide me link if there is any availability?

Highlighted

I have big input file which i want to process and then insert into Oracle databse from java with apache storm application or even with spark application if possible. Can you or someone provide me link if there is any availability?

New Contributor

I have big input file which i want to process and then insert into Oracle databse from java with apache storm application or even with spark application if possible. Can someone provide guidelines/links if there is any availability?

1 REPLY 1
Highlighted

Re: I have big input file which i want to process and then insert into Oracle databse from java with apache storm application or even with spark application if possible. Can you or someone provide me link if there is any availability?

@Rushikesh Sawant

Hi,

You can process the data in spark or hive.

Storm's more predominant use is for streaming data (Not saying that you cannot use it though).

And then use sqoop to export it to Oracle.

FYI:

https://sqoop.apache.org/docs/1.4.2/SqoopUserGuide.html#_literal_sqoop_export_literal

You can also use the export from spark and make a single job:

https://docs.databricks.com/spark/latest/data-sources/sql-databases.html

Thanks

Don't have an account?
Coming from Hortonworks? Activate your account here