About TimothySpann

TimothySpann · ‎03-01-2017

I wrote this for basic facebook ingest https://community.cloudera.com/t5/Community-Articles/Accessing-Facebook-Page-Data-from-Apache-NiFi-1-2/ta-p/246915

TimothySpann · ‎02-28-2017

I want to query Hive for only changed records ala QueryDatabaseTable. Should I use QueryDatabaseTable or is there a way to make SelectHiveQL maintain current state?

TimothySpann · ‎02-28-2017

store to HDFS as ORC and then create HIVE table ontop of it. I did 600,000 rows on a 4 GB machine and did that in a few minutes

TimothySpann · ‎02-27-2017

The SparkSQL JDBC driver works, do you have a firewall or something blocking that port 1. Make sure Spark Thrift server is running through Ambari 2. Test Spark SQL from local spark shell 3. Check from another machine, make sure firewall / networkign is not blocking that port. Is this a sandbox? local cluster? cloud based? can you post a screen shot of the tool you tried. see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_spark-component-guide/content/jdbc-odbc-access-sparksql.html which version of spark/hdp are you using? do you see anything in the logs in your tool or on the server?

TimothySpann · ‎02-26-2017

For Hive: https://community.hortonworks.com/articles/53629/writing-a-spring-boot-microservices-to-access-hive.html For Phoenix/HBASE https://community.hortonworks.com/content/kbentry/56642/creating-a-spring-boot-java-8-microservice-to-read.html https://community.hortonworks.com/content/repo/75498/apache-phoenix-hbase-spring-boot-microservices.html https://community.hortonworks.com/articles/60480/using-images-stored-in-hdfs-for-web-pages.html

TimothySpann · ‎02-23-2017

have you restarted NIFI?

TimothySpann · ‎02-23-2017

what is the Oracle Connection parameters you are using? which JDBC driver? is it the same user/password that you are using in SQL Developer? is oracle limiting where connections are allowed from? do you have enough / too many connections specified in your NIFI pool? if you have Oracle DBA access, can you see if anything is showing up in Oracle? anything in oracle logs? can you trace via TCP/IP ala wireshark? can you read from that connection via NIFI? are there specific table permissions?

TimothySpann · ‎02-23-2017

Look for errors https://community.hortonworks.com/articles/71839/decyphering-error-messages-in-apache-nifi.html

TimothySpann · ‎02-23-2017

Can you access oracle 12c from that same machine from the command-line or from Oracle SQL Developer? Make sure there are no firewall or other blockers. Check the SQL connection, is there errors listed there? Anything in the data provenance look odd? For me, sometimes that will happen if there's a network issue or bad data.

TimothySpann · ‎02-22-2017

Step 1: List XML files Step 2: Execute Script Step 3: On Success, List Data Files Step 4: Process those files I have done that with some things, works fine.

Online	Offline
Last Visited	‎04-26-2024 10:17 AM

Member Since	‎01-07-2019 11:58 AM
Last Visited	‎04-26-2024 10:17 AM
Posts	1,973
Kudos received	1121

Cloudera Community

Re: Has anyone tried NiFi consuming (JMSConsume) f...

Re: NiFi Crash after runing chain of lookups

Re: Recommend approach for listening to RSS Feed i...

Re: NiFi ListenFTP Processor Default Data Port

Re: Nifi: Kafka Producer with Avro format in both ...

Re: How to get facebook feeds into NiFi?

NIFI: SelectHiveQL vs QueryDatabaseTable

Re: ConvertJSONtoSQL in Apache NiFi for Sending to...

Re: Connecting BI tools to Spark

Re: how I can fetch data from Hadoop and show that...

Re: NiFi Error:failed to update database due to fa...

Re: NiFi Error:failed to update database due to fa...

Re: NiFi Error:failed to update database due to fa...

Re: NiFi Error:failed to update database due to fa...

Re: Need help on a logic using NiFi.