Skip to main content

How to avoid being mislead with your data-driven approach - Triple A rule

Data is crucial for any product development process that aim to be customer-centric and human-first data-driven process. Product managers and teams aim to acquire as much data as they can get to learn more about their customers behavior and hence improve the product key outcomes. 

When it comes to data, many product teams struggle figuring out the best approach to be data-driven, and to best use their data pipelines and digital footprints. However, being data-driven isn't a simple thing, and require much effort from the team to understand where and how they can structure this data flow.  

But, can data-driven be misleading sometimes? In this short article, I'm going to unleash 1 aspect that can be misleading sometimes for any product team and that can lead to false conclusions about product situation. Being falsely data-driven is more dangerous than being non data-driven at all!

Vanity metrics as an example

Every metric we choose to act upon can be a vanity metric, a term coined by Eric Ries, author of The Lean Startup, which means that there could be a metric that tells you nothing about the actual situation. It's not an actionable metric, you cannot take an action or decide major milestones by acting upon. 

So, how to avoid misleading vanity metric while choosing the product metric you focus on? 

Eric gave some simple steps that you may consider, in order for your metric to feed actual situation. Which I summarized in the term `Triple A rule` 

Triple A Rule

The triple A rule is an abbreviation for: Actionable, Accessible, Auditable. We're going to investigate more about each aspect in the following lines. 

Actionable

The metrics you decide to measure must have a clear cause-effect relationship. This will allow you to know exactly what to do to if you want to replicate or improve results. You can learn from every action you take.

Accessible

Metrics are nothing if they are not understood by the people whose decision they must influence. As a Product Manager, you need every team who you work with to understand what it means that the churn rate went from 5% to 10%. There are two options to make this happen. Either simplify the language with which you present your results, or train everyone in the technical terms that need to be used.

Auditable

Good metrics are unbiased. Anyone measuring them should be able to come to the same conclusion. This will allow you to build trust from the teams you work. Also, it will limit finger-pointing when things don’t go as expected. An auditable metric should be able to stand the test of real customer discussion: what your customers say validate what your reports do.

I hope that gives you a bit perspective on how to think about your product metric that you're going to act upon, and always aiming for your metrics to be Triple A compliant. 

Comments

Popular posts from this blog

سبر أغوار العقل البشري - نظرية العقل كصفحة الفارغة لچون لوك

نستكمل اليوم رحلة فلسفية أخرى والتي هي بمثابة مغامرة جريئة! منذ فترة قريبة، كنا نستكشف فكرة المعرفة الفطرية، التي أذهلت الفلاسفة العباقرة ذوي الأفكار الثورية. سابقًا، تعرضنا بشيء من التفصيل المبسّط لمفكرين عظماء مثل إيمانويل كانط . وهو من شاكلة المفكرين المثاليين الذين اعتقدوا أنّ عقولنا تأتي إلى العالم مزوّدة بمبادئ أولى عن المفاهيم التي نعاصرها في عالمنا.، والتي تُدعى بالمعرفة الفطرية. ( رابط الفيديو الذي يتحدث عن نظرة إيمانويل كانط للمعرفة الفطرية ) . الآن سنغير المسار قليلًا. وسنتجه إلى الفريق المقابل للفلاسفة المثاليين، وعلى رأس هذا الفريق هناك "چ ون لوك " وهو مرشدنا في مهمة اليوم الجريئة. إنه بمثابة المحقق الجاد في عالم الأفكار. لوك ، الفيلسوف والطبيب الشهير، يتحدى فكرة المعرفة الفطرية، ويقول أن عقولنا تكون عبارة عن ألواح فارغة عندما نولد، دون أي معرفة فطرية. في هذه المقالة، سوف ننظر عن كثب إلى فكرة المعرفة الفطرية ولكن من زاوية مختلفة، التي يمكننا أن نسميها بزاوية الفلسفة " الماديّة ". يقول لوك إننا لا ندخل إلى العالم بأفكار مُدمجة بشكل فطري، بل نتعلم الأشيا...

Unlocking the Mind's Mysteries: The mind as a blank page (Tabula Rasa Theory)

Picture this: our philosophical journey is like a grand adventure. We've been exploring the idea of innate knowledge, something that has fascinated intelligent folks who think about big ideas. Before, we soared through the clouds of fancy thoughts with thinkers like Immanuel Kant . They believed that our minds held secret wisdom from the start. But now, we're changing course. Imagine John Locke as our guide on a daring quest. He's like a detective in the world of ideas. Locke, a famous philosopher, challenges the notion of innate knowledge. He says our minds are blank slates when we're born, with no secret knowledge. In this article, we're getting focused. We will look closely at the idea of innate knowledge but from a different angle - what we call "materialism." Locke says we don't pop into the world with built-in ideas. Instead, we learn stuff through our senses and by watching and experimenting. Join us for an exciting journey as we compare these ...

Tech-Driven Isolation: Exploring the Price of Constant Connectivity

In the heart of a bustling metropolis, Sarah was surrounded by the rhythmic hum of life. Tall skyscrapers reached for the heavens, and neon billboards painted the night sky with a kaleidoscope of colors. It was a city that never slept, a city where people were always on the move, and connectivity was a way of life. As Sarah navigated the streets, her smartphone clutched firmly in hand, she seemed like any other denizen of this digital age. Emails, messages, and social media notifications beckoned for her attention, promising connection and instant gratification. Yet, amid this whirlwind of digital activity, Sarah felt strangely disconnected. She recalled a time when friendships were nurtured over heartfelt conversations at cozy cafes, laughter echoed through living rooms during game nights, and the art of letter writing was a cherished form of expression. But now, screens have become intermediaries, replacing genuine human connections with fleeting glimpses into each other's lives....