Member since
01-19-2017
3681
Posts
633
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1636 | 06-04-2025 11:36 PM | |
| 2087 | 03-23-2025 05:23 AM | |
| 991 | 03-17-2025 10:18 AM | |
| 3772 | 03-05-2025 01:34 PM | |
| 2595 | 03-03-2025 01:09 PM |
01-02-2020
07:47 AM
@Uppal Great that worked out better for you, did you run MSCK REPAIR TABLE table_name; on the target table? f you found this answer addressed your initial question, please take a moment to login and click "accept" on the answer. Happy hadooping
... View more
01-01-2020
11:06 AM
@Uppal Any updates on this thread.
... View more
01-01-2020
11:04 AM
@saivenkatg55 You didn't respond to this answer, do you still need help or it was resolved if so please do accept and close the thread.
... View more
01-01-2020
04:16 AM
@alialghamdi Your issue is being generated by the python script /usr/lib/ambari-agent/lib/ambari_agent/ConfigurationBuilder.py see line 38 "host_level_params_cache = self.host_level_params_cache[cluster_id" Solution 1 on node 6 Delete the tmp files to empty the cache on node 6 after stopping the ambari-agent node6 # ambari-agent stop node6 # rm -rf /var/lib/ambari-agent/* Then restart the ambari-agent on host 6 node6 # ambari-agent start Solution 2 on node 6 node6 # ambari-agent stop yum erase ambari-agent rm -rf /var/lib/ambari-agent rm -rf /var/run/ambari-agent rm -rf /usr/lib/amrbari-agent rm -rf /etc/ambari-agent rm -rf /var/log/ambari-agent rm -rf /usr/lib/python2.6/site-packages/ambari* Re-install of Ambari Agent yum install ambari-agent # Change hostname to point to the Ambari Server vi /etc/ambari-agent/conf/ambari-agent.ini Start the ambari-agent agent # ambari-agent start Please revert
... View more
12-31-2019
07:57 PM
@alialghamdi I have an idea, depending on your backend Ambari database please first do a backup. We are not going to do any changes yet but validate my suspicion DB backup Assuming you are on MySQL /MariaDB mysqldump –u[user name] –p[password] [database name] > [dump file] Check cluster state select * from clusterstate; The value found above should be there in Stage table's "cluster_id" columns select stage_id, request_id, cluster_id from stage; Identify troublesome host select host_id,host_name from hosts; Assuming you got host id 3 for the troublesome host select cluster_id,component_name from hostcomponentdesiredstate where host_id=3; select cluster_id,component_name from hostcomponentstate where host_id=3; select cluster_id,service_name from hostconfigmapping where host_id=3; Share your output for all the above steps, please tokenize your hostname.domain
... View more
12-30-2019
10:12 AM
@RobertCare Check the value in Ambari---> Ranger---> Configs---> Advanced---> Advanced *ranger-ugsync-site * if that is appropriate for the HDP version else adjust ranger.usersync.policymanager.mockrun=true means usersync is disabled as its a mock run set it to false this will trigger the usersync if not can you share the ambari-server log? Ranger could also be looking for attribute uid if your users have cn rather than uid it did retrieve the users and groups from LDAP but not insert them in the database Hope that helps
... View more
12-28-2019
02:26 AM
1 Kudo
@Cl0ck That is possible please follow this cloudera documentation please have a look and see if it suits your situation. Keep me posted.
... View more
12-25-2019
12:38 PM
@saivenkatg55 For the screenshots, the 2 notebooks you create are Untitled Note 1 and Untitled Note 2 which should appear in the drop-down list under Notebook on the top menu. Below I will create a Spark interpreter notebook named saivenkatg55 from step 2 above This should appear on the under the notebook Launched a test I can see the job was accepted and running in RM UI So where exactly are you encountering issues? Happy hadooping !
... View more
12-25-2019
09:44 AM
@kiranpune DistCp (distributed copy) is a tool used for large inter/intra-cluster copying. It uses MapReduce to effect its distribution, error handling and recovery and reporting. It expands a list of files and directories into the input to map tasks, each of which will copy a partition of the files specified in the source list that basic description. But one can use different command-line options when running DISTCP see the official dictcp documentation below are a few options for your different use cases. OPTIONS -append: Incremental copy of the file with the same name but different length -update: Overwrite if source and destination differ in size, block size, or checksum -overwrite: Overwrite destination -delete: Delete the files existing in the destination but not in the source I think you can schedule or script a daily copy
... View more
12-21-2019
06:47 AM
@Uppal Best way to duplicate a partitioned table in Hive Create the new target table with the schema from the old table the describe formatted could help with the SQL Use hadoop fs -cp to copy all the partitions from source to the target table Run MSCK REPAIR TABLE table_name; on the target table HTH
... View more