Welcome to the Cloudera Community
Your Hybrid Data Community. With over 91,800 members and 20,300 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
- Cloudera Community
- :
- Search
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
40,000 results
Sorted by:
06-09-2021
08:56 PM
18 Kudos
Expert Contributor
Created on 06-09-2021 08:56 PM - edited 06-20-2021 10:31 PM
Table of Contents 1. Introduction 2. Executor Memory 3. Memory Management 4. Static Memory Manager (SMM) 5. Unified Memory Manager (UMM) 6. Understand the Memory Allocation using Spark UI 1. I...
Labels:
Objective
This tutorial walks you through a NiFI flow that utilizes the
QueryRecord processor and Record Reader/Writer controller services to convert a CVS file into JSON format and then query th...
- Find more articles tagged with:
- csv
- Data Ingestion & Streaming
- How-ToTutorial
- json
- NiFi
- sql
Labels:
Show results in comments (5)
-
@Meghna_3 as this is an older article, you would have a better chance of receiving a resolutio...
-
Hello, Right now user.txt file is with header. As easily records can be picked. If this file is w...
-
check further back in the logs for a sql error
-
Hi @spdvnz It looks like you ran into a bug that should have been addressed in NiFi 1.5.0 (https:/...
-
Hi @Andrew Lim Thanks for the article. I tried to execute this using NiFi 1.5 but I get an error...
02-11-2016
09:36 PM
19 Kudos
Master Guru
Created on 02-11-2016 09:36 PM - edited 08-17-2019 01:14 PM
The purpose of this article is to explain what Process Groups
and Remote Process Groups (RPGs) are and how input and output ports are used to
move FlowFiles between them. Process groups are a valuabl...
- Find more articles tagged with:
- Data Ingestion & Streaming
- hdf
- How-ToTutorial
- NiFi
- process-groups
Labels:
Show results in comments (5)
-
Thanks @MattWho , actually found a way to filter/search process groups by name using the ...
-
@ebeb You can name each of your process groups uniquely by name that identifies the ETL pi...
-
Hello, Is it still the best practice to create say 100 process groups for 100 dataflow/etl pipelin...
-
Maybe I can simplify my point by seeing RPGs just as functions with inputs and outputs, or servers ...
-
@Romain Guay - I a not sure i am following your comments completely. Keep in mind that this Art...
06-10-2019
10:38 PM
7 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
Show results in comments (5)
-
Hi, Thanks for the good explanation. What would be the jolt specification for the following...
-
Hi @wcbdata Can you explain the usage of '#' in the spec you used above: { &nbs...
-
@peter1_biro [ { "operation": "shift", "spec": { "log": { ...
-
I really appreciated your work. I bookmarked this page.
-
Hello, thanks for perfect examples! What would be the jolt specification for this input/output lo...
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (9)
-
Thank you @mburgess , this was a great help. Could you or someone pls how to get the variable valu...
-
Awesome! just tested out... Works like a charm! Thank you so much... just in case if you have any r...
-
@mburgess this is just awesome! Thank you so much for this. I am trying to call a rest API vi...
-
You can call a REST API from Nashorn/Javascript in ExecuteScript, but since Nashorn doesn't have ac...
-
Extremely usefull examples. However, I'm not sure how to receive one flowfile but transfer several ...
-
@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first men...
-
Thank you! Also just for interest's sake and hope you don't mind answering here, but when will you ...
-
Thanks, Matt. This is very informative.
-
Yes we currently build with JDK 8 so we get Nashorn "for free". This will be the case when building...
01-12-2017
08:36 PM
15 Kudos
Super Guru
Created on 01-12-2017 08:36 PM - edited 08-17-2019 05:50 AM
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. This is Part...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (5)
-
@mburgess .. Hope you are doing good. I am facing issue while creating a groovy script for Scr...
-
非常赞的ExecuteScript使用系列文章. 在Accessing Controller Services 的groovy例子中 def StringDeserializer = { by...
-
Thanks Matt. I've learned a lot from your article. And in this tutorial, I also want to share a l...
-
I am trying to use this processor to access HBase client and getting errors (implementing custom in...
-
Thank you for this tutorial Matt. There is a copy/paste error in the configuring the Processor you ...
How to Submit Spark Application through Livy REST API Apache Livy supports using REST APIs to submit Spark applications, it is quite similar to use “spark-submit” in vanilla Spark. In this article w...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- How-ToTutorial
- livy
- Spark
- zeppelin
Labels:
Show results in comments (5)
-
Hi @Sbofa Yes you are right. Based on kind it will decide which kind of spark s...
-
How does livy know which shell to use? say if I use kind:spark or kind:pyspark, does it connect usi...
-
@sshao am submitting spark job through livy , below are my conf parameters data = {'kind': 'pyspar...
-
hi i have exception java.io.FileNotFoundException 2019-06-01 00:43:19,160 WARN util.NativeCodeLoad...
-
I am newer in BigData, i have tried to call spark jobs with apache Livy . With submit command line ...
Continuing my series of how-to articles for CDP, today we explore how to connect to Impala via JDBC in JSON. In my example, I will use a Jupyter notebook running in CML, but this can be generalized. ...
Labels:
05-05-2022
07:59 PM
2 Kudos
Super Guru
Created on 05-05-2022 07:59 PM - edited 05-25-2022 06:44 AM
Cyber/Log data ingestion is super simple using CDP NiFi; however, it alone does not complete the full picture InfoSec & Threat hunters are interested in. Often these uber pros are looking for bre...
09-04-2019
11:47 AM
2 Kudos
Super Guru
Created on 09-04-2019 11:47 AM - edited 09-04-2019 01:53 PM
My Kubernetes series (Part1, Part2) was strictly focused on MiNiFi on K8S. NiFi and MiNiFi may communicate over Site 2 Site; however, often the pattern is to...
Labels:
Show results in comments (5)
-
Yes the above comment on the functionality not working any longer is accurate. NiFi has gone throug...
-
So following this guide directly doesn't actually work. I'm assuming one has to have access t...
-
Thanks sunil for this nice article. I have one query, how you get Nifi UI outside k8 cluster witho...
-
Thanks Sunil. I did happen to try this the other day. I did it through the helm charts - cetic/nifi...
-
@haris_khan Good observation. Clustering concept in k8s in general requires a fair bit ...
