Welcome to the Cloudera Community
Your Enterprise Data Cloud Community. With over 80,000 members and 19,300 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Cloudera Community
- :
- Search
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
60,000 results
Sorted by:
06-10-2019
10:38 PM
6 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
Show results in comments (5)
-
Hi, Thanks for the good explanation. What would be the jolt specification for the following...
-
Hi @wcbdata Can you explain the usage of '#' in the spec you used above: { &nbs...
-
@peter1_biro [ { "operation": "shift", "spec": { "log": { ...
-
I really appreciated your work. I bookmarked this page.
-
Hello, thanks for perfect examples! What would be the jolt specification for this input/output lo...
08-16-2016
09:56 PM
21 Kudos
Super Guru
Created on
08-16-2016
09:56 PM
- edited on
02-12-2020
06:33 AM
by
SumitraMenon
NiFi is most effectively used as an "always-on" system, meaning that the data flows are often always operational (running). Doing batch processing is a more difficult task and usually requires some u...
- Find more articles tagged with:
- Data Ingestion & Streaming
- How-ToTutorial
- incremental
- NiFi
- nifi-processor
- querydatabasetable
- rdbms
Labels:
Show results in comments (9)
-
@mburgess Helpful information shared. I am using Nifi 1.7.1 For my case, the increme...
-
@mburgess , Could you please suggest how I can achieve the same with Cassandra. I tried to us...
-
Hi Matt, Is there a suggested way to perform incremental fetching when the columns increas...
-
Hi @mattburgess i am using the same processor for fetching incremental data from relational tables....
-
Thanks, Matt. Very informative for beginners like me.
-
You may use ExecuteSQL processor for that. You can write custom SQL query with that processor.
-
@Matt Burgess Really helpful!! But, I have a question By using this flow How we will get the upda...
-
Hi, is there any way to use this processor to check for a change in a specific record that may not ...
-
Thanks Matt , one more good article from you. If my nifi went down or processor stopped somehow. A...
Objective
With the release of NiFi Registry 0.2.0, flow contents can now be stored under a Git directory using the new
GitFlowPersistenceProvider .
This tutorial walks you through how to ...
- Find more articles tagged with:
- apache-nifi
- Data Ingestion & Streaming
- git
- How-ToTutorial
- registry
- version
Labels:
Show results in comments (9)
-
Hi, @alim NiFi fails to push to GitHub. Buckets appear in the folder specified ...
-
Hi, setting up the NiFi Registry so that it automatically pushes to GitHub worked well fol...
-
Hi @Andrew Lim, Thank you for your tutorials. I have been trying to restore ...
-
Hi @yuvapraveen_k NiFi Registry is not supported on Windows. You can see the system req...
-
@alim I am trying to configure git with the NIFI registry installation on windows(runnin...
-
Hi @Andrew Lim thank you for this detailed and step-by-step information, exactly what I was lookin...
-
Hi, Let's pretend that I'm being forced against my will to run Nifi on Windows. The registry isn't ...
-
Hi, let me advertise an option for git clone using git+ssh. I have put together a Docker image whi...
-
@Marshal Tito, I think you can. I just did on GitLab. Those access tokens are used by all those hos...
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (9)
-
@mburgess this is just awesome! Thank you so much for this. I am trying to call a rest API vi...
-
You can call a REST API from Nashorn/Javascript in ExecuteScript, but since Nashorn doesn't have ac...
-
Awesome! just tested out... Works like a charm! Thank you so much... just in case if you have any r...
-
Extremely usefull examples. However, I'm not sure how to receive one flowfile but transfer several ...
-
@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first men...
-
Thank you! Also just for interest's sake and hope you don't mind answering here, but when will you ...
-
Thanks, Matt. This is very informative.
-
Yes we currently build with JDK 8 so we get Nashorn "for free". This will be the case when building...
-
Hey Matt, great series of articles. I have learnt everything I know about ExecuteScript from here a...
Interacting with Hadoop HDFS using Python codes This post will go through the following:
Introducing python “subprocess” module Running HDFS commands with Python Examples of HDFS commands fro...
- Find more articles tagged with:
- code
- coding
- Data Processing
- HDFS
- How-ToTutorial
- Linux
- python
Labels:
Show results in comments (6)
-
@wasiftanveer , As this is an old article, you would have a better chance of receiving a us...
-
@VidyaSargur Thank you for the response and the suggestion, i will create a new thread for my ...
-
Hi, Thank you for this great article and code snippets. its really useful. i just face one...
-
Hi All. Here is all steps for doing same!!! Link :- https://www.oreilly.com/library/view/hadoop-...
-
It was an excellent article on interacting of Hadoop HDFS using Python to hear from you which is v...
-
Thanks for the comment Michael. I wrote these commands for hdp environments using standard python 2...
Security/Governance/GDPR Demo on CDP-Private Cloud Base 7.x Summary This article explains how to quickly setup Cloudera Security/Governance/GDPR (Worldwide Bank) demo using Cloudera Data Platfor...
Show results in comments (9)
-
@boulder the AMI comes with trial license of CM which expires after 90 days. At that point, th...
-
Thanks for the clarification and for your efforts overall. I tried the self-install on a Centos ...
-
@antonio_r Glad to hear it! Thanks for providing the details to help the next person. Have up...
-
Just make sure the networking is setup as required by Hadoop: https://docs.cloudera.com/cloude...
-
@antonio_r Could you share the location details of datasets/data inside the script, please?
-
@antonio_r after running the script, I noticed some services show weird state (even though th...
-
thanks for the suggestion, I will investigate at next opportunity (probably over the weekend). ...
-
Trying to get this working in a VMWare VM on an on-premise server. Running into a number of i...
-
@Rajesh2622 you can find the CSV files containing the data under https://github.com/abajw...
08-03-2020
05:41 PM
5 Kudos
Cloudera Employee
Created on 08-03-2020 05:41 PM - edited 08-06-2020 09:32 AM
Introduction Cloudera Data Platform DC doesn't have one Quickstart/Sandbox VM like the ones for CDH/HDP releases that helped a lot of people (including me), to learn more about the open-source comp...
Labels:
Show results in comments (5)
-
Hi @carrossoni I followed the tutorial and I was able to start the virtual mach...
-
Just tried to follow instructions and received the error below when I run Vagrant Up command. Any h...
-
Hi Akhil, It seems that the download wasn't completed and the host isn't in a health state...
-
Hi @AkhilTech , The primary problem is that the host isn't in health state, this is evalua...
-
@carrossoni , Thanks for the inputs. After checking the file /etc/cloudera-scm-agent/con...
09-26-2016
03:05 PM
3 Kudos
Expert Contributor
Created on 09-26-2016 03:05 PM - edited 08-17-2019 09:36 AM
Controlling the environment of an application is vital for it's
functionality and stability. Especially in a distributed environment it
is important for developers to have control over the version ...
- Find more articles tagged with:
- conda
- Data Processing
- How-ToTutorial
- pyspark
- Spark
Labels:
Show results in comments (4)
-
Thanks for this great tutorial and I got your tutorial mostly working. However, the Python workers ...
-
Hi @hkropp I followed your post and when I trigger my spark-submit and the application is accepted ...
-
Hello thank you so much for this post it is awesome as we could ship any version of python interpre...
-
Hi, I've tried your article with a simpler example using HDP2.4.x. Instead of NLTK, I created a sim...
03-31-2020
05:39 AM
2 Kudos
Contributor
Created on
03-31-2020
05:39 AM
- edited on
11-19-2020
04:38 AM
by
VidyaSargur
What happened?
Starting up a ZooKeeper server in a Kerberized CDP-DC 7.0.3 cluster failed with the logs below.
2020-03-30 12:23:10,251 ERROR org.apache.zookeeper.server.q...
Labels:
Synopsis This tutorial will demonstrate using Spark for data processing operations on a large set of data consisting of pipe delimited text files. Delimited text files are a common format seen in Da...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- DataFrame
- How-ToTutorial
- pyspark
- rdd
- SparkSQL
Labels:
Show results in comments (4)
-
Is the input dataset available somewhere?
-
Is this still valid? I mean there are many improvements on spark-sql & catalyst engine since sp...
-
can we say this difference is only due to the conversion from RDD to dataframe ? because as per ap...
-
Very interesting, but I think it'd have been as more even comparision if you'd have used SparkSQL c...
