Member since
04-07-2021
19
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3729 | 04-09-2021 09:34 AM |
05-17-2021
02:43 AM
Thanks for your reply. 1: the google test was successful. 2: the command you suggested did not give me any response. which which directory do i need to run it?
... View more
05-12-2021
06:14 AM
Hi all, pyspark is still not recognised in my jupyter notebook for instance when I do: import pyspark or anything related i get an error. I have also installed many versions of python. I try open a new notebook with different python version but still facing trouble. Here copy and paste for my .bashrc file. Please can you tell me where my error is : # .bashrc # User specific aliases and functions alias rm='rm -i' alias cp='cp -i' alias mv='mv -i' # Source global definitions if [ -f /etc/bashrc ]; then . /etc/bashrc fi export SPARK_CLASSPATH=/usr/share/java/postgresql-jdbc-8.4.704.jar export PYSPARK_DRIVER_PYTHON_OPTS="notebook" export PYSPARK_DRIVER_PYTHON=jupyter export SPARK_CLASSPATH=/usr/share/java/postgresql-jdbc-8.4.704.jar export PYSPARK_DRIVER_PYTHON_OPTS="notebook" export PYSPARK_DRIVER_PYTHON=jupyter export PATH=$PATH:/home/cloudera/anaconda3/bin # added by Anaconda3 4.0.0 installer export PATH="/home/cloudera/anaconda3/bin:$PATH" export SPARK_CLASSPATH=/usr/share/java/postgresql-jdbc-8.4.704.jar export PYSPARK_DRIVER_PYTHON_OPTS="notebook" export PYSPARK_DRIVER_PYTHON=jupyter export SPARK_CLASSPATH=/usr/share/java/postgresql-jdbc-8.4.704.jar export PYSPARK_DRIVER_PYTHON_OPTS="notebook" export PYSPARK_DRIVER_PYTHON=jupyter Thank you
... View more
05-11-2021
05:00 AM
Hi All, I am doing this course on Cloudera which requires installation of anaconda, spark. After many attempts, i have successfully installed all packages but i still get this error in my notebook. import pyspark import pyspark --------------------------------------------------------------------------- ImportError Traceback (most recent call last) <ipython-input-7-c15ae3402d12> in <module>() ----> 1 import pyspark /usr/lib/spark/python/pyspark/__init__.py in <module>() 39 40 from pyspark.conf import SparkConf ---> 41 from pyspark.context import SparkContext 42 from pyspark.rdd import RDD 43 from pyspark.files import SparkFiles /usr/lib/spark/python/pyspark/context.py in <module>() 22 from tempfile import NamedTemporaryFile 23 ---> 24 from pyspark import accumulators 25 from pyspark.accumulators import Accumulator 26 from pyspark.broadcast import Broadcast /usr/lib/spark/python/pyspark/accumulators.py in <module>() 89 import select 90 import struct ---> 91 import SocketServer 92 import threading 93 from pyspark.cloudpickle import CloudPickler ImportError: No module named 'SocketServer' Can someone please help me ? Thank you
... View more
Labels:
- Labels:
-
Cloudera Manager
05-07-2021
04:37 AM
Since yesterday afternoon, i am not able to access internet in cloudera (Oracle VM ). I keep getting errors Cloudera: Firefox can't establish a connection to the server at localhost:8889 Two days ago things were working fine. and I don't think it is an internet problem on my end since i have been using it all day. Any idea? Thanks
... View more
Labels:
- Labels:
-
Cloudera Manager
04-25-2021
01:29 PM
Thank you for the detailed reply. I forgot to mention that my computer is 8GB RAM and I cannot use Cloudera express do to any experiment. Can i use CDH to get familiar with Hadoop, MapReduce and so on? If so, can you point me to the right direction please? Apologies for the basic question, i am new to this. Does CDH require a separate installation? I already have VM Oracle installed and ready to use
... View more
04-24-2021
02:38 PM
I have an 8 GB RAM and I understand that Cloudera express won't be working on my computer. Is there any alternative? How can I work with Cloudera express using my computer? Is there any way to use the Cloud to get more RAM power? Thank you for your help and guidance
... View more
Labels:
- Labels:
-
Cloudera Analytic DB
-
Cloudera Manager
04-23-2021
03:45 AM
Thank you for your reply. I am not sure which screenshots you mean but i have done these for you. Hopefully that clarifies the situation? For info, here are my pc information: Processor: Intel(R) Core (TM) i5 -4210U CPU @ 1.70 GHz 2.40 GHz Installed RAM 8.00GB (7.89 GB usable) System type: 64-bit operating system x64-based processor Windows 10 home (version 2004) OS build: 19041.867 Capacity 910 GB (Free 655 GB) File System: NTFS Please let me know what you think. Especially if i can run Cloudera express with my pc
... View more
04-22-2021
11:01 AM
I am trying to stop the VM VirtualBox to be able to change the base memory but it is still greyed out. Can i enable the change please? Thank you
... View more
Labels:
- Labels:
-
Cloudera Manager
04-22-2021
04:01 AM
I have successfully installed Oracle VM Virtual Box Manager. I am trying to do very simple tutorials to get familiar with the hadoop framework https://www.cloudera.com/tutorials.html but i can't seem to find the cloudera machine learning, cloudera data platform and so on where i can i find them please? Also what tutorial can you recommend to get familiar with Hadoop, MapReduce and Yarn? there are so many.. Thank you
... View more
Labels:
- Labels:
-
Cloudera Manager
04-21-2021
02:57 AM
Dear All, I am looking for mini exercises/projects in Hadoop Cloudera to get familiar with the framework. Do you know any website or youtube channel that provides that? I d like to start basic from 'copy data from local to HDFS' to intermediate level projects. Thank you
... View more
Labels:
- Labels:
-
Cloudera Manager
04-09-2021
09:34 AM
Anyone has any opinion on the error shown in the logs file below. Thank you
... View more
04-09-2021
08:09 AM
Dear Vaishaak Thank you for your quick reply. I am still getting the same error message The virtual machine 'cloudera-quickstart-vm-5.4.2-0-virtualbox' has terminated unexpectedly during startup with exit code 1 (0x1). More details may be available in 'C:\Users\badao\VirtualBox VMs\New group\cloudera-quickstart-vm-5.4.2-0-virtualbox\Logs\VBoxHardening.log' . I am not sure which system settings i need to use for Oracle VM to work. Can you please recommend any? I have been struggling with this Yes i checked the logs. Here is the last message i found: 23d4.2150: Fatal error: 23d4.2150: supR3HardenedMainGetTrustedMain: LoadLibrary "C:\Program Files\Oracle\VirtualBox/VirtualBoxVM.dll" failed, rc=1790 24b0.21a0: supR3HardNtChildWaitFor[2]: Quitting: ExitCode=0x1 (rcNtWait=0x0, rcNt1=0x0, rcNt2=0x103, rcNt3=0x103, 2805 ms, the end); 13f4.2734: supR3HardNtChildWaitFor[1]: Quitting: ExitCode=0x1 (rcNtWait=0x0, rcNt1=0x0, rcNt2=0x103, rcNt3=0x103, 3641 ms, the end); I am not sure about the message, it is like a foreign language to me. Any idea?
... View more
04-09-2021
07:41 AM
Following on my previous post, i successfully installed Hyper V in my Windows 10 following these instructions https://www.itechtics.com/enable-hyper-v-windows-10-home/ However, I am still not able to run cloudera. Please any help is more than welcome
... View more
04-09-2021
03:13 AM
Hi there, Thanks for the link (very helpful still not there yet). Here what people i have been trying for WIndows 10. Windows Features ---------------------- Disabled -> Hyper-V Enabled -> Virtual Machine Platform Enabled -> Windows Hypervisor Platform Disabled -> Windows Sandbox Elevated Powershell/Cmd ------------------------------- bcdedit /set hypervisorlaunchtype off BIOS ----- Enabled -> Virtualization Technology (VTx) Enabled -> Virtualization Technology for Directed I/O (VTd) Disabled -> HP Hypervisor my issue is that when i go to ''Turn Windows Features on and Off' i do not find: - Hyper-V - Windows Sandbox so i am not able to disable them. I have already enabled Virtual Technology in BIOS. I did not see HP Hypervisor though nor have i seen Virtualization Technology for Directed I/O (VTd) Any advice is more than welcome. Thanks very much
... View more
04-07-2021
06:16 AM
Dear isoardi, Thanks for the reply. In Oracle VM, I went to Machine -> Settings -> Network -> unclicked 'Enable Network Adapter'. Restarted Oracle VM but i am still getting the same error message. Any thoughts?
... View more
04-07-2021
02:52 AM
I am doing the coursera course in big data. I followed the instruction and did the installation. I realised then i had to enable the Virtual Technology in BIOS (which was enabled anyway). However, i still get the same error: 'Failed to Open a session for the virtual machine cloudera-quickstart-vm-5.4.2-0-virtualbox' The virtual machine 'cloudera-quickstart-vm-5.4.2-0-virtualbox' has terminated unexpectedly during startup with exit code 1 (0x1). More details may be available in 'C:\Users\badao\VirtualBox VMs\cloudera-quickstart-vm-5.4.2-0-virtualbox\Logs\VBoxHardening.log'. Result Code: E_FAIL (0x80004005) Component: MachineWrap Interface: IMachine {b2547866-a0a1-4391-8b86-6952d82efaa0} Please help me with a comment
... View more
Labels:
- Labels:
-
Cloudera Manager