Member since
02-14-2019
8
Posts
0
Kudos Received
0
Solutions
04-18-2019
03:06 PM
Hi I have started developing a python application where I have to perform following tasks in sequence: 1) Load the Video (*.avi / *.mp4 etc.) from HDFS into Spark (without saving it into local PC which is an overhead) 2) Inside Spark Job (using CV2 functions), extract image frames from loaded video. 3) Perform any transformation on the extracted image like Invert the Image frames. 4) Store the Inverted frames back to HDFS From above steps, I have code to : - extract the image frames from video using CV2 - Inverting the image frame using PIL.ImageOps Seeking solutions for Step 1 and using CV2 with Spark because the code which I use to extract frames is in CV2 which should be integrated with Spark. Any idea or suggestion would be very helpful.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Spark
02-21-2019
12:22 PM
I have tried this in my 2nd attempt but this is also not working for me. Cluster was created but no nodes were attached with this.
... View more
02-21-2019
10:41 AM
Hi @Mauro Beltrame , I am also configuring NiFi cluster with 3 machines (1 Manager and 2 Nodes) but could not be able to configure it yet. Can you share some useful link in this regard. My NiFi version is 1.8.0 and using external Zookeeper instead of embedded Zookeeper.
... View more
02-21-2019
10:37 AM
Hi @Kamal Sehgal , Can you share some useful link about how did u setup the cluster because I am also configuring NiFi cluster with 3 machines (1 Manager and 2 Nodes) but could not be able to configure it yet. My NiFi version is 1.8.0 and using external Zookeeper instead of embedded Zookeeper.
... View more
02-21-2019
10:35 AM
Hi @siddharth pande, I am also configuring NiFi cluster with 3 machines (1 Manager and 2 Nodes) but could not be able to configure it yet. Can you share some useful link in this regard. My NiFi version is 1.8.0 and using external Zookeeper instead of embedded Zookeeper.
... View more
02-21-2019
10:25 AM
Hi @Abhinav Joshi, I am also configuring NiFi cluster with 3 machines (1 Manager and 2 Nodes) but could not be able to configure it yet. Can you share some useful link in this regard. My NiFi version is 1.8.0 and using external Zookeeper instead of embedded Zookeeper.
... View more
02-21-2019
10:04 AM
@Matt Clarke, I have installed external zookeeper and started it. Then I modified configuration files in Zookeeper and NiFi. After this when I restarted NiFi service then I am able to see the cluster symbol on NiFi canvas but there is only 1 node which is connected (showing 1/1). No other node is getting connected with the cluster. Can you share some useful link or explain how this should be done?
... View more
02-20-2019
05:32 AM
Hi, I want to setup the NiFi cluster with at least 3 different machines (1 Manager and 2 nodes). I have followed many approaches which are available over internet but could not be able to configure the cluster successfully. Can any one explain in detail how to set up NiFi cluster with at least 3 different machines (1 Manager and 2 nodes). Any help would be very useful in this regard. Purpose of this cluster : Huge Data Transfer from Remote source path to HDFS with the highest possible data transfer rate.
... View more
Labels:
- Labels:
-
Apache NiFi