Hi, I have the below data: Record 6|Invalid values for Entry Date. Record 7|Processing failed due to error in record: 6 Record 8|Processing failed due to error in record: 6 Recor...
I have to do some custom preprocessing tasks on a huge data file (~200GB). currently, its works as below way. select * from table preprocessing line by line return a new single flow file so...
Introduction
Stock market is always a thing when it comes to data analysis and examples, so how can we easily create an ingestion pipeline that allows quick insights with Cloudera Data P...
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
Table of Contents Overview Over the last few years, Cloudera has evolved to become the Hybrid Data Company. Inarguably, the future of the data ecosystem is a hybrid one that enables common secu...
The NiFi community maintains a NiFi Docker image that comes very handy when you want to play with NiFi on your laptop. When you develop flows to run in a NiFi cluster with 2 or more nodes, though, th...
HDF or CFM best practices guide to configuring your system and NiFi for high performance dataflows. Note: The recommendation outlined in this article are for the NiFi service and apply whet...
Intro
Online shopping is on the rise as more of us stay at home and let our credit cards do the walking. Keeping pace with that trend is an unfortunate increase in credit card fraud.
It’s no ...
Table of Contents Overview In this article, let's build a real-time data visualization to analyze Twitter feeds using Cloudera Data Platform. Design Explanation: N...
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
