Member since
04-13-2017
3
Posts
0
Kudos Received
0
Solutions
08-06-2020
08:42 AM
In reality despite ConsumeIMAP is stateless, the IMAP server holds /Recent flag that is system read-only flag (theoretically within IMAP session, but how Gmail detect unique session is a BlackBox and I was not able to manage it with NiFi ConsumeIMAP client). If you want to re-fetch all your historical emails I recommend using ConsumePOP3 NiFi component, with the following setting on Gmail server: Gmail - settings - all - forwarding - Enable POP for all mail After performing such historical fetch you can disable ConsumePOP3 and continue to work with ConsumeIMAP to consume new messages.
... View more
04-13-2017
04:17 PM
Hi Mark, com.databricks.spark.xml loader expect to have XML files in the path, not Sequence Files. How spark-xml will deals with SequenceFileInputFormat instead com.databricks.spark.xml.XmlInputFormat?
... View more