Support Questions
Find answers, ask questions, and share your expertise

Cluster wide command line tool in CDP 7.1.x ?

New Contributor

Hi All,

 

I'm very new to cloudera cdp, I have just been moved over from MapR.

I'm looking to find out, i've looked quite a bit but haven't found anything thus far, if there is a cluster wide tool for doing things in the cluster.

 

i.e. in a mapr cluster, if i wanted to get a list of all hdfs volumes with loads of other info on the volumes,  i could type:
"maprcli volume list" and it will give me all the below information. 

 

This is just one example, the maprcli interface into MapR has the following commands (below), i'm just wondering if there is anything similar for CDP so that I could work this into home grown scripts that could easily span clusters.

 

Thanks

 

 

full list of mapr commands:

acerole    acerole [validate] -role [role_name]

acl        acl [show|set|edit] -type [cluster|volume] -name <volume name>

alarm      alarm [list|raise|clear|clearall|mute|unmute|config|names|group]

audit      audit [data|cluster|info]

blacklist  blacklist [user|listusers]

cluster    cluster [mapreduce [get|set] | gateway | feature [enable|list] | info getminmax]

config     config [load|save]

dashboard  dashboard [info] -[version|multi_cluster_info]

debugdb    debugdb cdscan|bmap|checkTablet|rawScan|multiOp

dialhome   dialhome [metrics|enable|status|ackdial|lastdialed]

disk       disk [list|listall|add|remove]

dump       dump [containerinfo|containers|cldbmetainfo|volumeinfo|volumenodes|replicationmanagerinfo|replicationmanagerqueueinfo|rereplicationinfo|rereplicationmetrics|balancerinfo|balancermetrics|rolebalancerinfo|rolebalancermetrics|assignvouchers|fileserverworkinfo|zkinfo|supportdump|cldbnodes]snapshotsizeupdateinfo

entity     entity [list|info|modify|remove]

fid        fid [dump|stat]

file       file [offload|recall|tierjobabort|tierjobstatus|tierstatus]

job        job [kill|changepriority|linklogs|status]

license    license [add|remove|list|apps|showid|addcrl|listcrl]

nagios     nagios [generate]

nfs4mgmt   nfs4mgmt [add-export|remove-export|list-exports]

nfsmgmt    nfsmgmt [refreshexports|refreshgidcache]

node       node [list|move|modify|allow-into-cluster|services|topo|remove|heatmap|listcldbs|listzookeepers|cldbmaster|canremovesp|maintenance|metrics|show|listcldbzks|refill]

rlimit     rlimit [set|get] -resource <resource>

schedule   schedule [create|modify|list|remove]

security   security [genkey|genticket|getmapruserticket]

service    service [list|info]

setloglevel setloglevel [cldb|fileserver|nfs|jobtracker|tasktracker|hbmaster|hbregionserver]

stream     stream [create|edit|info|delete|topic|cursor|replica|upstream|listrecent]

table      table [create|edit|delete|listrecent|info|cf|region|replica|upstream|index|changelog]

task       task [killattempt|failattempt]

tier       tier [create|modify|remove|info|list|rule]

trace      trace [dump|setmode|setlevel|resize|reset|info|print|setslowopsmillis] -host x.x.x.x -port <port>

urls       getting service webserver link

virtualip  virtualip [add|remove|edit|move|list]

volume     volume [create|modify|remove|mount|unmount|list|snapshot|mirror|dump|rename|upgradeformat|move|link|info|showmounts|fixmountpath|offload|recall|compact|tierjobabort|tierjobstatus|tierstats]

 

maprcli volume list data retrieved:

AdvisoryQuotaExceededAlarm

AlmostFullTopologyAlarm

BecomeMasterStuckAlarm

CannotMirrorAlarm

CompactionFailureAlarm

ContainersNonLocalAlarm

CriticallyDegradedEcStripesAlarm

DataUnavailableAlarm

DataUnderReplicatedAlarm

DegradedEcStripesAlarm

EcDataUnavailableAlarm

FullTopologyAlarm

InodesExceededAlarm

LargeRowWarning

MirrorFailureAlarm

NoNodesInTopologyAlarm

OffloadRecallFailureAlarm

QuotaExceededAlarm

ReplTypeConversionInProgress

SnapshotFailureAlarm

TableIndexEncodingErrorAlarm

TableIndexErrorAlarm

TableIndexLagHighAlarm

TableReplicationAsyncAlarm

TableReplicationErrorAlarm

TableReplicationLagHighAlarm

VOLUME_ALARM_ADVISORY_QUOTA_EXCEEDED

VOLUME_ALARM_BECOME_MASTER_STUCK

VOLUME_ALARM_CANNOT_MIRROR

VOLUME_ALARM_COMPACTION_FAILURE

VOLUME_ALARM_CRITICALLY_DEGRADED_EC_STRIPES

VOLUME_ALARM_DATA_CONTAINERS_NONLOCAL

VOLUME_ALARM_DATA_UNAVAILABLE

VOLUME_ALARM_DATA_UNDER_REPLICATED

VOLUME_ALARM_DEGRADED_EC_STRIPES

VOLUME_ALARM_EC_DATA_UNAVAILABLE

VOLUME_ALARM_INODES_EXCEEDED

VOLUME_ALARM_MIRROR_FAILURE

VOLUME_ALARM_NO_NODES_IN_TOPOLOGY

VOLUME_ALARM_OFFLOAD_RECALL_FAILURE

VOLUME_ALARM_QUOTA_EXCEEDED

VOLUME_ALARM_SNAPSHOT_FAILURE

VOLUME_ALARM_TOPOLOGY_ALMOST_FULL

VOLUME_ALARM_TOPOLOGY_FULL

accesstime

actualreplication

advisoryquota

aename

aetype

allowGrant

allowReadForExecute

auditVolume

audited

coalesceInterval

containerAllocationFactor

creationTime

creator

creatorcontainerid

creatorvolumeuuid

criticalReReplTimeOutSec

dareEnabled

data-size-mirrored-mb

data-size-to-mirror-mb

dbindexlagsecalarmthresh

dbrepllagsecalarmthresh

disableddataauditoperations

enableddataauditoperations

enforceMinReplicationForIO

fixCreatorId

forceAudit

lastSuccessfulMirrorTime

limitspread

localpath

logicalUsed

maxinodesalarmthreshold

maxnssizembalarmthreshold

metricsEnabled

minreplicas

mirror-percent-complete

mirrorDataSrcCluster

mirrorDataSrcVolume

mirrorDataSrcVolumeId

mirrorId

mirrorSrcCluster

mirrorSrcVolume

mirrorSrcVolumeId

mirrorscheduleid

mirrorstatus

mirrorthrottle

mirrortype

mountdir

mounted

nameContainerDataThresholdMB

nameContainerSizeMB

needsGfsck

nextMirrorId

nsMinReplicas

nsNumReplicas

numactivecgcontainers

numcontainers

numreplicas

partlyOutOfTopology

quota

rackpath

reReplTimeOutSec

readonly

replicatedlogicalused

replicatedtotalused

replicationtype

scheduleid

schedulename

skipWireSecuityForTierInternalOps

snapshotcount

snapshotused

tierenable

totalused

used

volumeid

volumename

volumetype

wireSecurity

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Cluster wide command line tool in CDP 7.1.x ?

@innominate There is no such command line tool in CDP as per my knowledge. CDP distribution of Hadoop supports all Vanilla commands like hdfs dfs etc and similar for other components. 


Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post

1 REPLY 1

Re: Cluster wide command line tool in CDP 7.1.x ?

@innominate There is no such command line tool in CDP as per my knowledge. CDP distribution of Hadoop supports all Vanilla commands like hdfs dfs etc and similar for other components. 


Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post