Thursday, July 25, 2024

One Large Cluster Caught: Setting Well being Scorecard

What We’ve Lined

All through the One Large Cluster Caught sequence we’ve explored impactful greatest practices to achieve management of your Cloudera Information platform (CDP) atmosphere and considerably enhance its well being and efficiency. We’ve shared code, dashboards, and instruments that will help you in your well being enchancment journey. We’d like to supply one final instrument.

The Environmental Well being Scorecard

We monitor atmosphere well being on the macro stage with a dashboard that mirrors our weblog sequence methodology with a couple of additions. We set quarterly OKR (Aims and Key Outcomes) targets to enhance our rating.

At decrease ranges of grain our measurements are data-driven and automatic, however on the macro stage we desire to use some subjectivity (in fact our weightings will differ from yours as we’re on a unique journey). Our knowledge and analytics leaders meet month-to-month to guage our well being enchancment and log subjective measures. Some might name that anecdotal proof however we worth the pairing of our data-driven evaluation with our observable actuality. 

Platform Well being 

All of it begins with platform well being which we selected to measure in 3 dimensions: {hardware} efficiency, companies efficiency, and optimum configuration/tuning. We supplied dozens of how-to manuals to acquire visibility and tune your atmosphere

Is it shocking that we weighted platform well being solely an 8 on a 100 level scale? Our mannequin considers the length and useful resource dedication required to finish 80% of the journey, and since our platform optimization took just a few assets a couple of months, we weighted it low. In case you’ve acquired a multiyear platform journey forward of you, you’ll weigh it extra closely.

NOTE: The Optimally configured quantity is only a rely of tunings we accomplished, and the odds are subjective evaluations.

Visibility and Transparency

Weighted a 20?! Yup. It’s that necessary to us as now we have written. We selected separate measures for our personal jobs and our customers’ jobs. With 100% monitoring, alerting (notifications to DevOps), and notifications (to our clients), why didn’t we earn a 20? As a result of we weren’t as proactive in resolving points as our OKR targets indicated we must be.

Information Democratization 

Though we didn’t weblog about knowledge democratization, we discover it an necessary measure of environmental well being. Each different measurement is meaningless if crucial knowledge parts are unavailable to choice makers. By the way, this measure is within the reverse seat of the see-saw because the others: ungoverned knowledge democratization is the one best explanation for all the issues we’re making an attempt to impression. Take into consideration that.

Information Course of Well being

Though we didn’t dedicate a weblog to this well being measure, we supplied quite a few directions to restore issues you discover. The objectives we selected within the dashboard are necessary to us, however select these which are necessary to you. The person scores are counts however the total well being rating is just not a sum, it’s subjective. It is a multiyear journey.

Information Asset Standardization

This measure will get our highest weighting at 25 out of 100. The well being of the atmosphere is most depending on the belief that customers have within the knowledge. The better your knowledge observability, and the better the quantity that’s accessed through enterprise customary dashboards and governance-certified sources of reality, the better the chance for belief. The belief develops via an understanding of the information as maintained via metadata in your Information Catalog: classification, lineage, forex, and enterprise context . You’ll be able to see that we did nice on report standardization however now we have longer to go to certify our enriched datasets and knowledge marts, and to repipe our customers’ property. One other multiyear journey.

Information High quality & Information Governance Extensibility

Like knowledge standardization this goes to the center of trusted knowledge. We’ve 37 whole well being factors measuring knowledge trustworthiness. That will appear counterintuitive when utilized to an environmental “well being” measure, however that’s how we see it. You may even see these and different measures otherwise.   

Better of Luck!

We smile on the chance that we’d have enabled you to be extra environment friendly or succesful (or each!). Go to our Group Web page, our blogs, and Information and IT Leaders web page for a lot extra.

Related Articles


Please enter your comment!
Please enter your name here

Stay Connected

- Advertisement -spot_img

Latest Articles