Support Questions

Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

i'am trying to develop my first project with horthonworks so i need to stream data from (not twitter) facebook ,web site ,instagram , using spring-xd , apache flume,or nifi .Does anyone have any examples/templates for using this plugins .


@nejm hadj Adding more information based on your comments

You should stick with NiFi and use built in processor to ingest the data from various social media sources.

Please do read docs.

In NiFi, the contents of a FlowFile are accessed via a stream, but in Flume it is stored in a byte array. This means the full content will be loaded into memory when a FlowFile is processed by the ExecuteFlumeSink processor. You should consider the typical size of the FlowFiles you'll process and the batch size, if any, your sink is configured with when setting NiFi's heap size.

@nejm hadj

nifi templates Link

thnx , i'am confused about what i will use for streaming data ( nifi or flume)to hdfs ,what is the difference between this plugins ,my goal is streaming data from social media (facebook ,instagram,website,mobile) . i can use them together ??


@nejm hadj nifi is a visual tool, flume is not. You can work with nifi and flume together as nifi has flume processors. Once you try nifi you won't need to look at flume.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.