Welcome to the Cloudera Community
Your Enterprise Data Cloud Community. With over 74,700 members and 18,900 solutions, you've come to the right place!
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
- Cloudera Community
- :
- Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
- « Previous
- Next »
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
60,000 results
Sorted by:
06-10-2019
10:38 PM
6 Kudos
Rising Star
Created on 06-10-2019 10:38 PM - edited 08-17-2019 02:15 PM
OBJECTIVE: Provide a quick-start guide for using the Jolt language within a NiFi JoltTransform (JoltTransformJSON or JoltTransformRecord). OVERVIEW: The NiFi JoltTransform uses the powerful Jo...
- Find more articles tagged with:
- Data Ingestion & Streaming
- FAQ
- jolt
- joltransformjson
- jolttransformrecord
- NiFi
Labels:
Show results in comments (4)
-
Hi @wcbdata Can you explain the usage of '#' in the spec you used above: { &nbs...
-
@peter1_biro [ { "operation": "shift", "spec": { "log": { ...
-
I really appreciated your work. I bookmarked this page.
-
Hello, thanks for perfect examples! What would be the jolt specification for this input/output lo...
Interacting with Hadoop HDFS using Python codes This post will go through the following:
Introducing python “subprocess” module Running HDFS commands with Python Examples of HDFS commands fro...
- Find more articles tagged with:
- code
- coding
- Data Processing
- HDFS
- How-ToTutorial
- Linux
- python
Labels:
Show results in comments (6)
-
@wasiftanveer , As this is an old article, you would have a better chance of receiving a us...
-
Hi, Thank you for this great article and code snippets. its really useful. i just face one...
-
@VidyaSargur Thank you for the response and the suggestion, i will create a new thread for my ...
-
Hi All. Here is all steps for doing same!!! Link :- https://www.oreilly.com/library/view/hadoop-...
-
It was an excellent article on interacting of Hadoop HDFS using Python to hear from you which is v...
-
Thanks for the comment Michael. I wrote these commands for hdp environments using standard python 2...
07-23-2020
01:49 PM
1 Kudo
Expert Contributor
Created on 07-23-2020 01:49 PM - edited 07-28-2020 11:48 AM
The Cloudera Data Platform (CDP) comes with a wide variety of tools that move data, these are the same in any cloud as well as on-premises. Though there is no formal decision tree, I will summarize ...
This article describes various "recipes" on how to accomplish certain tasks with the NiFi processor ExecuteScript, with examples given in Groovy, Jython, Javascript (Nashorn), and JRuby. Recipes in t...
- Find more articles tagged with:
- Data Ingestion & Streaming
- executescript
- How-ToTutorial
- NiFi
Labels:
Show results in comments (9)
-
@mburgess this is just awesome! Thank you so much for this. I am trying to call a rest API vi...
-
You can call a REST API from Nashorn/Javascript in ExecuteScript, but since Nashorn doesn't have ac...
-
Awesome! just tested out... Works like a charm! Thank you so much... just in case if you have any r...
-
Extremely usefull examples. However, I'm not sure how to receive one flowfile but transfer several ...
-
@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first men...
-
Thank you! Also just for interest's sake and hope you don't mind answering here, but when will you ...
-
Thanks, Matt. This is very informative.
-
Yes we currently build with JDK 8 so we get Nashorn "for free". This will be the case when building...
-
Hey Matt, great series of articles. I have learnt everything I know about ExecuteScript from here a...
08-03-2020
05:41 PM
5 Kudos
Cloudera Employee
Created on 08-03-2020 05:41 PM - edited 08-06-2020 09:32 AM
Introduction Cloudera Data Platform DC doesn't have one Quickstart/Sandbox VM like the ones for CDH/HDP releases that helped a lot of people (including me), to learn more about the open-source comp...
Labels:
Show results in comments (5)
-
Just tried to follow instructions and received the error below when I run Vagrant Up command. Any h...
-
@carrossoni , Thanks for the inputs. After checking the file /etc/cloudera-scm-agent/con...
-
Hi Akhil, It seems that the download wasn't completed and the host isn't in a health state...
-
Hi @AkhilTech , The primary problem is that the host isn't in health state, this is evalua...
-
@carrossoni , when I open Cloudera Manager, it is taking me to the installation page. That mea...
08-16-2016
09:56 PM
21 Kudos
Super Guru
Created on
08-16-2016
09:56 PM
- edited on
02-12-2020
06:33 AM
by
SumitraMenon
NiFi is most effectively used as an "always-on" system, meaning that the data flows are often always operational (running). Doing batch processing is a more difficult task and usually requires some u...
- Find more articles tagged with:
- Data Ingestion & Streaming
- How-ToTutorial
- incremental
- NiFi
- nifi-processor
- querydatabasetable
- rdbms
Labels:
Show results in comments (9)
-
@mburgess , Could you please suggest how I can achieve the same with Cassandra. I tried to us...
-
Hi Matt, Is there a suggested way to perform incremental fetching when the columns increas...
-
Hi @mattburgess i am using the same processor for fetching incremental data from relational tables....
-
@mburgess Helpful information shared. I am using Nifi 1.7.1 For my case, the increme...
-
Thanks, Matt. Very informative for beginners like me.
-
You may use ExecuteSQL processor for that. You can write custom SQL query with that processor.
-
@Matt Burgess Really helpful!! But, I have a question By using this flow How we will get the upda...
-
Hi, is there any way to use this processor to check for a change in a specific record that may not ...
-
Thanks Matt , one more good article from you. If my nifi went down or processor stopped somehow. A...
09-26-2016
03:05 PM
3 Kudos
Expert Contributor
Created on 09-26-2016 03:05 PM - edited 08-17-2019 09:36 AM
Controlling the environment of an application is vital for it's
functionality and stability. Especially in a distributed environment it
is important for developers to have control over the version ...
- Find more articles tagged with:
- conda
- Data Processing
- How-ToTutorial
- pyspark
- Spark
Labels:
Show results in comments (4)
-
Thanks for this great tutorial and I got your tutorial mostly working. However, the Python workers ...
-
Hi @hkropp I followed your post and when I trigger my spark-submit and the application is accepted ...
-
Hello thank you so much for this post it is awesome as we could ship any version of python interpre...
-
Hi, I've tried your article with a simpler example using HDP2.4.x. Instead of NLTK, I created a sim...
Objective This tutorial will walk you through the process of using the PyHive Python module from Dropbox to query HiveServer2. You can read more about PyHive here: PyHive Prerequisites
You sho...
- Find more articles tagged with:
- Hive
- How-ToTutorial
- python
- Sandbox
- Sandbox & Learning
- tableau
Labels:
Show results in comments (5)
-
Can I use pyhive to connect to Hive using Hive JDBC string instead of a single hostname? The follow...
-
Hi @TimothySpann , Could you please let me know if you was able to resolve issue, since I ...
-
Hive doesn't use thrift anymore. new Python APIs work fine. https://github.com...
-
Login with username
-
Great article...BUT...this only seems to work for small queries "show databases", "show tables", "S...
Synopsis This tutorial will demonstrate using Spark for data processing operations on a large set of data consisting of pipe delimited text files. Delimited text files are a common format seen in Da...
- Find more articles tagged with:
- Data Science & Advanced Analytics
- DataFrame
- How-ToTutorial
- pyspark
- rdd
- SparkSQL
Labels:
Show results in comments (4)
-
Is the input dataset available somewhere?
-
Is this still valid? I mean there are many improvements on spark-sql & catalyst engine since sp...
-
can we say this difference is only due to the conversion from RDD to dataframe ? because as per ap...
-
Very interesting, but I think it'd have been as more even comparision if you'd have used SparkSQL c...
09-04-2019
11:47 AM
2 Kudos
Super Guru
Created on 09-04-2019 11:47 AM - edited 09-04-2019 01:53 PM
My Kubernetes series (Part1, Part2) was strictly focused on MiNiFi on K8S. NiFi and MiNiFi may communicate over Site 2 Site; however, often the pattern is to...
Labels:
