Welcome to the Cloudera Community
Your Enterprise Data Cloud Community. With over 82,700 members and 19,500 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Cloudera Community
- :
- Search
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
60,000 results
Sorted by:
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (9)
-
Thank you @mburgess , this was a great help. Could you or someone pls how to get the variable valu...
-
@mburgess this is just awesome! Thank you so much for this. I am trying to call a rest API vi...
-
You can call a REST API from Nashorn/Javascript in ExecuteScript, but since Nashorn doesn't have ac...
-
Awesome! just tested out... Works like a charm! Thank you so much... just in case if you have any r...
-
Extremely usefull examples. However, I'm not sure how to receive one flowfile but transfer several ...
-
@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first men...
-
Thank you! Also just for interest's sake and hope you don't mind answering here, but when will you ...
-
Thanks, Matt. This is very informative.
-
Yes we currently build with JDK 8 so we get Nashorn "for free". This will be the case when building...
06-10-2019
10:38 PM
7 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
Show results in comments (5)
-
Hi, Thanks for the good explanation. What would be the jolt specification for the following...
-
Hi @wcbdata Can you explain the usage of '#' in the spec you used above: { &nbs...
-
@peter1_biro [ { "operation": "shift", "spec": { "log": { ...
-
I really appreciated your work. I bookmarked this page.
-
Hello, thanks for perfect examples! What would be the jolt specification for this input/output lo...
Objective
With the release of NiFi Registry 0.2.0, flow contents can now be stored under a Git directory using the new
GitFlowPersistenceProvider .
This tutorial walks you through how to ...
- Find more articles tagged with:
- apache-nifi
- Data Ingestion & Streaming
- git
- How-ToTutorial
- registry
- version
Labels:
Show results in comments (9)
-
I have same issue as @andP with github token. Any help please ? @alim
-
@thuylevn I have customized the image from base image by adding the updated providers.xml file...
-
Cannot do similar with docker images apache/nifi-registry:latest, because cannot mount fo...
-
@alim Thanks for the details for git integration, its working fine. However its always pushing...
-
Hi, @alim NiFi fails to push to GitHub. Buckets appear in the folder specified ...
-
@Ven5 - Login to git in browser and create branch called 'develop'. - Login to server(node)...
-
Hi, setting up the NiFi Registry so that it automatically pushes to GitHub worked well fol...
-
Hi @Andrew Lim, Thank you for your tutorials. I have been trying to restore ...
-
Hi @yuvapraveen_k NiFi Registry is not supported on Windows. You can see the system req...
09-04-2019
11:47 AM
2 Kudos
Super Guru
Created on 09-04-2019 11:47 AM - edited 09-04-2019 01:53 PM
My Kubernetes series (Part1, Part2) was strictly focused on MiNiFi on K8S. NiFi and MiNiFi may communicate over Site 2 Site; however, often the pattern is to...
Labels:
Show results in comments (4)
-
Thanks sunil for this nice article. I have one query, how you get Nifi UI outside k8 cluster witho...
-
Hello.. This is a very informative article. I just have a question in terms of creating a Nifi clu...
-
@haris_khan Good observation. Clustering concept in k8s in general requires a fair bit ...
-
Thanks Sunil. I did happen to try this the other day. I did it through the helm charts - cetic/nifi...
Introduction For a simple PySpark application, you can use `--py-files` to specify its dependencies. A large PySpark application will have many dependencies, possibly including transitive dependenc...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- How-ToTutorial
- pyspark
- Spark
Labels:
Security/Governance/GDPR Demo on CDP-Private Cloud Base 7.x Summary This article explains how to quickly setup Cloudera Security/Governance/GDPR (Worldwide Bank) demo using Cloudera Data Platfor...
Show results in comments (9)
-
@abajwa I have tried to use the given AMI 7.3/7.4 and received the below message....
-
@abajwa Hi, thanks for your help in the past. Now I have a new question: I want...
-
@antonio_r Could you share the location details of datasets/data inside the script, please?
-
@Rajesh2622 you can find the CSV files containing the data under https://github.com/abajw...
-
@boulder the AMI comes with trial license of CM which expires after 90 days. At that point, th...
-
Thanks for the clarification and for your efforts overall. I tried the self-install on a Centos ...
-
@antonio_r Glad to hear it! Thanks for providing the details to help the next person. Have up...
-
Just make sure the networking is setup as required by Hadoop: https://docs.cloudera.com/cloude...
-
@antonio_r after running the script, I noticed some services show weird state (even though th...
08-16-2016
09:56 PM
21 Kudos
Super Guru
Created on
08-16-2016
09:56 PM
- edited on
02-12-2020
06:33 AM
by
SumitraMenon
NiFi is most effectively used as an "always-on" system, meaning that the data flows are often always operational (running). Doing batch processing is a more difficult task and usually requires some u...
- Find more articles tagged with:
- Data Ingestion & Streaming
- How-ToTutorial
- incremental
- NiFi
- nifi-processor
- querydatabasetable
- rdbms
Labels:
Show results in comments (9)
-
@mburgess Helpful information shared. I am using Nifi 1.7.1 For my case, the increme...
-
@mburgess , Could you please suggest how I can achieve the same with Cassandra. I tried to us...
-
Hi Matt, Is there a suggested way to perform incremental fetching when the columns increas...
-
Hi @mattburgess i am using the same processor for fetching incremental data from relational tables....
-
Thanks, Matt. Very informative for beginners like me.
-
You may use ExecuteSQL processor for that. You can write custom SQL query with that processor.
-
@Matt Burgess Really helpful!! But, I have a question By using this flow How we will get the upda...
-
Hi, is there any way to use this processor to check for a change in a specific record that may not ...
-
Thanks Matt , one more good article from you. If my nifi went down or processor stopped somehow. A...
08-03-2020
05:41 PM
6 Kudos
Cloudera Employee
Created on 08-03-2020 05:41 PM - edited 05-06-2021 08:50 AM
Introduction Cloudera Data Platform DC doesn't have one Quickstart/Sandbox VM like the ones for CDH/HDP releases that helped a lot of people (including me), to learn more about the open-source comp...
Labels:
Show results in comments (8)
-
Hi @MiamiDataEng , To access via ssh you just need to enter via vagrant comand: ...
-
Hi @carrossoni I followed the tutorial and I was able to start the virtual mach...
-
Hi @Cisco94, Thanks! No you don't need it since the process indeed use the trial repository. A...
-
Hi @carrossoni , do you need a CDP license to follow the installation? I know that ...
-
Hi @AkhilTech , The primary problem is that the host isn't in health state, this is evalua...
-
@carrossoni , Thanks for the inputs. After checking the file /etc/cloudera-scm-agent/con...
-
Just tried to follow instructions and received the error below when I run Vagrant Up command. Any h...
-
Hi Akhil, It seems that the download wasn't completed and the host isn't in a health state...
Interacting with Hadoop HDFS using Python codes This post will go through the following:
Introducing python “subprocess” module Running HDFS commands with Python Examples of HDFS commands fro...
- Find more articles tagged with:
- code
- coding
- Data Processing
- HDFS
- How-ToTutorial
- Linux
- python
Labels:
Show results in comments (6)
-
Hi, Thank you for this great article and code snippets. its really useful. i just face one...
-
@wasiftanveer , As this is an old article, you would have a better chance of receiving a us...
-
@VidyaSargur Thank you for the response and the suggestion, i will create a new thread for my ...
-
Hi All. Here is all steps for doing same!!! Link :- https://www.oreilly.com/library/view/hadoop-...
-
It was an excellent article on interacting of Hadoop HDFS using Python to hear from you which is v...
-
Thanks for the comment Michael. I wrote these commands for hdp environments using standard python 2...
Continuing my series of how-to articles for CDP, today we explore how to connect to Impala via JDBC in JSON. In my example, I will use a Jupyter notebook running in CML, but this can be generalized. ...
Labels:
