Member since
05-29-2017
43
Posts
7
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3873 | 10-02-2017 08:40 AM | |
2015 | 10-02-2017 08:13 AM | |
3444 | 09-20-2017 09:24 AM | |
10265 | 09-18-2017 06:35 AM | |
18080 | 09-06-2017 04:52 AM |
10-03-2017
09:19 AM
Hello Pej, The exhaustive list of all Cloudera Manager API commands is available in it's documentation. As Cloudera Manager API is designed to manage and provide information about the cluster status, it has currently no capabilities to research the data itself, like receiving the result data of Impala queries. I'd recommend to use impala-shell or one of the available connectors (ODBC / JDBC) to interface with impala, depending on your specific use-case. Regards, Zsolt
... View more
10-03-2017
09:11 AM
Hello saisvk, Are you looking for the description of the table structures you've used? In this case you're probably looking for the DESCRIBE / DESCRIBE FORMATTED commands of Hive. Zsolt
... View more
10-03-2017
08:57 AM
Hello prashanthyadav, I'm not sure which Cloudera software would you like to install on top of Windows Server, but in case of Cloud, it's best to run Linux VMs directly. As a Cloud VM is already running in a virtualized container, another layer of virtualization on top of that is usually not supported. If you're interested in Cloudera Enterprise on Microsoft Azure, you may find useful our documentation about reference architecture of Cloudera Enterprise for Azure Zsolt
... View more
10-02-2017
08:40 AM
Hello Awisawe, In order for Hue to work over HTTPS, it needs a TLS certificate and a corresponding private key. These are configured via ssl_certificate, ssl_private_key, and ssl_password variables. We've documentation about setting up Hue as TLS/SSL server for Cloudera Enterprise, which you may be able to adapt to your distribution. Best regards, Zsolt
... View more
10-02-2017
08:13 AM
1 Kudo
Hello kangkang0705, You can achieve that via setting up rules for " Audit Event Filter" according to Configuring Service Auditing Properties. Please note that the audit events discarded this way will never reach the Cloudera Navigator database, because of that you'll have no way to review them in the future. Let me know if that helps. Best regards, Zsolt
... View more
09-21-2017
03:14 AM
Hi stumilius, We have a blogpost about storing Avro data inside HBase tables. In short, HBase does not know about the avro content, treats it as binary blob. The client which is reading/writing the data has to deal with the avro schemas, after HBase delivered the raw data to it. Zsolt
... View more
09-20-2017
09:24 AM
1 Kudo
Hi I think you're referring to Cloudera Navigator Encrypt which was formerly known as Gazzang zNcrypt. Our install guide is available in the documentation as well. Zsolt
... View more
09-20-2017
08:40 AM
Hi venkatachetkuri, If you ldaps server is using a certificate which is signed by an internal CA, you can just upload the internal CA to the "CA Certificate" field, and CDSW will trust your ldaps connection. It only check against the CA provided in that field, it does not matter whether it's public or internal CA. If it still does not work, you can test with openssl wether the trustchain is set up correctly: openssl s_client -connect your.cdsw.domain.name:443 -CAfile /path/to/your/internal/ca Zsolt
... View more
09-20-2017
08:30 AM
Hi Rabk, I think you're asking more information about the step 8. in our enabling TLS documentation, which recommends turning on authentication if you set up TLS. In a CDH cluster, authentication is usually provided by kerberos, whereas encryption on the wire is provided by TLS. By turning on " Enable Kerberos Authentication for HTTP Web-Consoles " the webservices will require SPNEGO authentication, with a trusted kerberos principal. We've a documentation on Enable Kerberos Authentication for HTTP Web-Consoles as a part of our kerberos setup guide, and on setting up browsers for SPNEGO authentication. You can also find information about that authentication in the Apache documentation. Do you have any specific questions about that? Zsolt
... View more
09-19-2017
08:46 AM
Hi Shushrut, Which type of encryption are you interested in? We've an overview of Cloudera Navigator Data Encryption and Encryption in CDH in our documentation. Do you have any specific questions about these? Zsolt
... View more
09-18-2017
06:35 AM
1 Kudo
Hello Creaping, As HDFS is not a standard unix filesystem, it is not possible to read it with native python IO libraries. As HDFS is open-source, there are plenty of connectors out there. You can also acces HDFS via HttpFS on a REST interface. In case you'd like to parse large amount of data, none of that will be suitable, as the script itself still runs on a single computer. To solve that, you can use pyspark to rewrite your script and use the spark-provided utils to manipulate data. This'll solve both HDFS access and the distribution of the workload for you. Zsolt
... View more
09-18-2017
06:02 AM
Hello Sachin81 and venkatachetkuri, You can specify a CA certificate on the CDSW webui for ldaps, to verify the ldap server which CDSW connects to. This is not optional, a CA with a valid trustchain to the ldaps servers certificate must be provided for CDSW to work. You can check the certificates your ldap server provides with openssl s_client -connect as a hint which CA to specify for CDSW. Zsolt
... View more
09-18-2017
05:55 AM
Hello asherma5, You can configure Hue with an external load-balancer, that way it'll keep the browser on the load-balancer and does not redirect it to itself: http://gethue.com/automatic-high-availability-with-hue-and-cloudera-manager/ This is only partial solution, as it'll not solve your issue with moving Hue to a subfolder. Hue is based on django, which handles the routing for it. I'm not aware of a way to reliably relocate Django apps to a subfolder without editing the source-code. Zsolt
... View more
09-08-2017
01:01 AM
Hi Nadi1998, The download website http://go.cloudera.com/ced has also been updated, and it's working for me now. Can you re-try it?
... View more
09-07-2017
05:24 AM
Hi Nad1998, - Select the latest version - Click on "Get it now" - A form appears with "Sign in or complete our product interest form to continue" - Fill in these details and click on "CONTINUE" - Read the agreement - Click on the checkbox before " I accept the Terms of Cloudera's Standard License and Cloudera Manager Notices " - Click "Submit" - There'll be a green bar appearing in the page with " Thank you for choosing Cloudera Manager, your download instructions are below:" and the install instructions are below that. Let me know where your browser is stuck, if this does not work.
... View more
09-06-2017
08:37 AM
Hi SumeetRaheja, Wildcard certificates are only working from CDH 5.10, which version do you plan to install? A valid certificate is required for all nodes. In case of a wildcard certificate, it may be used on multiple nodes where it matches the hostname. If all of the DNs FQDN is matching the wildcard certificate, and your cluster version is at least 5.10.0, than I don't see any problems with your setup. Zsolt
... View more
09-06-2017
07:45 AM
Hi Vamp, Unfortunately at the current version only Cloudera Navigator has a configuration to log events to syslog. You may find the Cloudera Manager API as a useful alternative, where all the Cloudera Manager Events are exposed: http://cloudera.github.io/cm_api/apidocs/v17/path__events.html
... View more
09-06-2017
04:52 AM
Hi, Can you check if the port is reachable from the Tableau computer? You might have a firewall or other network restriction in between. For beeline migration, you can check our blogpost: https://blog.cloudera.com/blog/2014/02/migrating-from-hive-cli-to-beeline-a-primer/ You may use beeline on the computer tableau is installed, to verify if hive is reachable.
... View more
09-06-2017
04:40 AM
I see your issue on that link. I'd recomend to download Cloudera Enterprise from the link provided in my post. You'll be able to chose the 30-day trial upon install. https://www.cloudera.com/downloads/manager/5-12-1.html
... View more
09-05-2017
08:31 AM
Hello Nad1998, Which website are you tring to download Cloudera Enterprise from? On the Cloudera Manager download page, I did not have to provide company address information. Zsolt
... View more
09-05-2017
08:26 AM
Hello HN, Do you have the Hive ODBC driver installed for tableau? Please also check that the configured IP address is points to a HiveServer2 instance, and the required ports on that ip is reachable from the tableau node. Zsolt
... View more
09-05-2017
08:19 AM
Hello Vamp, We've documentation about logging audit events to syslog. Do you have any questions about that? You can also refer to the log4j documentation, and the SyslogAppender configurations for further options, such as prepending message headers. Zsolt
... View more
08-31-2017
07:37 AM
Hi, Hue is connecting directly to the mysql server that this configuration provides. Which machine do you use to login mysql? Is it the same node where Hue is installed?
... View more
08-28-2017
08:28 AM
1 Kudo
Hi kchandra123, I'm likely late on this post, but if you still have this problem, can you tell us what do you see after you've relogined to Cloudera Manager? I think it could be the first-run wizard, which may appear because Cloudera Manager's configuration has been changed to different database, or similar. Zsolt
... View more
08-28-2017
08:21 AM
1 Kudo
Hello, At the moment, only Amazon S3 or another Cloudera cluster is supported as a BDR replication target, but we have support for Microsoft Azure Data Lake Store as HDFS backend for Cloudera clusters. For Hive table replication databases or whole tables can be selected. It is not possible to set up replication to only a single partition of a hive table.
... View more
08-28-2017
08:06 AM
Hello ztoth, If you have the administrator credentials of Cloudera Manager, you can use it to request the SQL credentials of the Hue service. For example, the below REST API call returns the password in the configuration variable named "database_password" for any Hue service: https://cloudera.github.io/cm_api/apidocs/v17/path__clusters_-clusterName-_services_-serviceName-_config.html Unfortunately, the Hue API does not have a programmatical way to add regular users, but you can use external authentication backends such as LDAP.
... View more
08-28-2017
07:37 AM
Hello, Receiving "Results Expired" error in Hue for Impala queries, is usually a symptom of having a misconfigured load-balancer in front of Impala. Impala has the assumption, that the query results will be downloaded from the same impalad where the query was issued. A load-balancer can break that assumption, if it sendis sequential connections of the same client to different impalad daemons. If Hue connects two a different impalads to run the query and download the results, the "Results Expired" error will appear. To avoid the above issue, it's required that the proxy routes subsequent connections of the same client to the same impalad. This proxy behavior is usually called sticky sessions. Our documentation has detailed information about impala load-balancer setup, includeing the above information as well: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_proxy.html#proxy_overview
... View more
06-07-2017
07:34 AM
2 Kudos
I would double-check network and CM configuration before considering a database issue. It seems that cloudera manager is ignoreing your proxy configuration. I tried to reproduce your error, and I found that specifing http:// before the proxy servers domain name could cause this. Could you confirm that you have it set to abcd.net and not http://abcd.net? If that doesn't help, please specify your CM, OS and database version, so I can try that configuration.
... View more
06-07-2017
06:31 AM
Hi jeroenr! You're right, this is most likely an issue with cloudera manager's configuration. The parcels are downloaded by CM server, so the status of cloudera-scm-agent shouldn't metter. Please help me better understand your situation: Have you set up proxy via Administration > Settings > Network in Cloudera Manager? Is xxx.net your proxy's domain name, or the hostname of a pracel repository mirror? Seems like CM can't resolve the domain xxx.net causing this failure. Could you check if you can resolve xxx.net to an IP from the same host? (dig xxx.net)
... View more
06-07-2017
12:38 AM
Hi autumnSea! Cloudera Manager use SSH to install the agent on new hosts. This error message indicates an SSH timeout. Are you able to SSH to the new hosts? Could you check on the new hosts logs that Cloudera Manager authenticates successfully via ssh or not? If everything seems OK, please share more information about your environment, such as your Cloudera Manager version, OS type, maybe SSH configuration of the new hosts if possible.
... View more