post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Customer Research

Hardware

Digital Transformation

Our Privacy Policy is changing on April 5, 2022 - for more information and a description of the updates, <a href="https://mtpdevwpe.wpengine.com/privacy/" style="color:#FFFFFF;text-decoration:underline;">see the policy here.</a>

Switching back the focus from ‘Build only’ to ‘Build-measure-learn’

Product career special part 2: Making a change

Build what matters with vision-led product management

Lessons in fearless leadership

Building a product organisation from scratch by Kevin Mansfield

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

The executive product leader persona

Test blog post

As a passionate product person, Mareike works for the Amsterdam-based European scale-up ParkBee and their vision to give space back to cities by moving cars off the street and into underutilized urban space.

Mareike Leitermann

<p>Most product teams review goals in hindsight to see whether they have succeeded. But what if you could not just assess what you’ve already done but prioritize your actions along the way? To help do that with a strong focus on outcomes, Product Management coach and author Tim Herbig took ProductTank Amsterdam through a hands-on workshop. He provided context behind the idea of OKRs and surprised some of the other attendees with new thoughts on the matter.</p>
<p>The session was a mixture of both theory and practical exercises for the audience to directly try out the introduced concepts and get feedback from Tim and the community. Tim closed the workshop by discussing questions from the audience. Below is a summary of the workshop’s takeaways:</p>
<ul>
<li>There are no right or wrong key results</li>
<li>Adding the dimension of leading / lagging indicators</li>
<li>Most common (underestimated) mistakes</li>
<li>Using output-driven key results to establish a product discovery practice within the company</li>
</ul>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://mtpdevwpe.wpengine.com/wp-content/uploads/2022/03/36d2acbd-3133-462b-a4e6-6ebfb8977487_workshop.jpg" alt="" width="1600" height="941" /><figcaption class="wp-caption-text">ProductTank audience participating in a workshop exercise</figcaption></figure>
<h1>There are no right or wrong key results</h1>
<p>“Outcome over output” is a well-known claim in product management. Output OKRs (e.g. “feature x has been released”) are said to be rather shallow, not inspirational and are likely to block learning opportunities. However, there is nothing wrong with output OKRs per se for measuring success. The team should just be aware of the <span style="font-weight: bold;">consequences</span> when they settle on a specific type of key result. The key results should give a holistic picture of the objective, capturing the objective from as many perspectives and levels as possible. This will give more space to come up with the best solution(s), but also requires more confidence and skill from the team.</p>
<p>Based on the consequences of the key results, OKRs can be separated into three different types:</p>
<ul>
<li><span style="font-weight: bold;">Impact-ish OKRs</span>: a high-level expression of the <span style="font-weight: bold;">company’s</span> strategic priority expressed through a result/metric</li>
<li><span style="font-weight: bold;">Outcome-ish OKRs</span>: a change in human behaviour that creates an impact on <span style="font-weight: bold;">department</span> level. It can be validated through the “how might we” test.</li>
<li><span style="font-weight: bold;">Output-ish OKRs</span>: a completed activity that aims to create a change in behaviour and has an impact on <span style="font-weight: bold;">team</span> level</li>
</ul>
<h1>Adding the dimension of leading/lagging indicators</h1>
<p>Categorising your OKRs like this will likely not be enough for actually working with them on a day-to-day basis. A second layer should be pointing out the <span style="font-weight: bold;">likelihood/certainty</span> of the aimed change. This can be measured by a concept that has been around for a while:</p>
<ul>
<li>Leading indicators are more difficult to spot since they require insights from actual user behavior. They are responsive to team actions. They also most likely can be used to predict future success, trading a certain degree of certainty.</li>
<li>Lagging indicators: are easier to spot (e.g. user growth, revenue) but are often unresponsive and hard to change from a company perspective. Also, they are definitive results of the past.</li>
</ul>
<p>⚠️ Be conscious about the difference between causation and correlation here: the more leading the indicator is, the less certain you can be about the success of this action. “Outcomes over outputs” generally is a good idea—but not at all cost. It does not help you to pick an outcome indicator just for the sake of it when it leads to a metric of a lagging nature.</p>
<p>⚠️ The nature of the metric highly depends on the context of your company: how your business works, the business cadence, if this metric changes and how often</p>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://mtpdevwpe.wpengine.com/wp-content/uploads/2022/03/0f8878ce-1cd9-4b00-b204-7f0bf8ebabd0_pasted20image200.png" alt="" width="1600" height="900" /><figcaption class="wp-caption-text">Leading/ lagging indicators and outcome and output sequence and difference &#8211; example of team OKRs for a plugin marketplace</figcaption></figure>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://mtpdevwpe.wpengine.com/wp-content/uploads/2022/03/996b9f6b-f628-49a0-8384-dd05e61176d3_pasted20image200.png" alt="" width="1600" height="900" /><figcaption class="wp-caption-text">If you try to move from lagging to leading indicators, you can try and clarify the activities that have to take place to achieve this success metric (reverse customer journey mapping)</figcaption></figure>
<h2>Most common (underestimated) mistakes</h2>
<p>The most common and risky mistake when using these techniques is to ignore a lack of clarity:</p>
<ul>
<li>Lack of clarity on the inputs for your OKR definition: You need to have your vision, strategy, customer insights, and roadmap in place to be able to estimate your next contribution to your success. <span style="font-weight: bold;">The quality of your OKR inputs highly correlates with the quality of your OKR sets.</span></li>
<li>Lack of clarity of the goals of your OKRs: Do you want to measure performance, enable more focus, get the team more autonomy? This can have a huge impact on whether your OKR sets are output or outcome-driven.</li>
</ul>
<h2>Using output-driven key results to establish a product discovery practice within the company</h2>
<p>Output key results for Product Discovery are a bit controversial since they are easy to misuse, but can be helpful for teams that struggle with prioritizing discovery work and/or discussing its progress. Metrics like &#8220;number of winning prototypes&#8221; or &#8220;number of opt-ins to user testing&#8221; can help make Discovery become a more sustainable practice.</p>
<p>Besides regular (e.g. weekly, bi-weekly) OKR check-ins with the team, make sure to have regular (e.g. quarterly) OKRs retrospectives and make sure that there is a process or person responsible to circle back the learnings to the management team to (potentially) reflect on the way the company measures success altogether.</p>
<h2>In summary</h2>
<p>In order to be able to assess your OKRs continuously and successfully…</p>
<ul>
<li>Mind that there are no right or wrong OKRs, just different dimensions (with relating consequences) that you as a team should be aware of</li>
<li>Be aware of unclear aspects of your OKR inputs as well as the goals you want to achieve</li>
<li>Consider using output-driven OKRs as a helpful tool to establish a product discovery practice</li>
<li>Set up regular check-ins &#8211; on team and company level</li>
</ul>
<h2>Helpful resources written by Tim</h2>
<ul>
<li>Tim‘s article on how to measure the progress of OKRs using leading and lagging indicators:<a href="https://herbig.co/leading-lagging-indicators-okrs/"> </a><span style="text-decoration: underline;"><a href="https://herbig.co/leading-lagging-indicators-okrs/" target="_blank" rel="noopener">https://herbig.co/leading-lagging-indicators-okrs/</a></span> &#8211; also includes more information about reverse customer journey mapping</li>
<li>Tim‘s article on thinking beyond outcomes in OKRs:<a href="https://herbig.co/okrs-beyond-outcomes/"> </a><span style="text-decoration: underline;"><a href="https://herbig.co/okrs-beyond-outcomes/" target="_blank" rel="noopener">https://herbig.co/okrs-beyond-outcomes/</a></span> &#8211; helpful for teams that are still hesitating to start using &#8220;wrong&#8221; OKRs</li>
<li>And if you’re curious, here is <span style="text-decoration: underline;"><a href="https://drive.google.com/file/d/1EAeruV0XqOouj2KGJ5fuoU9Zr4SUoQ8h/view?usp=sharing" target="_blank" rel="noopener">the recording of the workshop with all the details.</a></span></li>
</ul>
<div></div>
<div class="g g-21"><div class="g-single a-95"><a class="gofollow" data-track="OTUsMjEsMSw2MA==" href="https://mtpdevwpe.wpengine.com/product-management-training/public-workshops/product-metrics-workshop/"><img decoding="async" src="https://mtpdevwpe.wpengine.com/wp-content/uploads/2022/04/Training-Metrics-what-should-a-PM-know_-FOOTER-scaled.jpg" /></a></div></div>

core/freeform

Guest Post

Building Consumer-Grade Experiences for the Enterprise By Ciara Peter

What Makes a Great Product Manager by Graham Siener

The GIST Framework by Itamar Gilad

Scaling the Product and the Team by Rachael Shah

Decisions, Debt, and Other Dilemmas by Janna Bastow

Hacking Your Product Career by Gibson Biddle

How Medicine and Research Translates to Patients by Shree Patel

The Future of Product Management by Richard Harrison

Data Science and Digital Businesses by Ali Gulez

You Need A Product Strategy by Sam Odio

How product teams can measure progress through outcome OKRs

ProductTank Tallinn

ProductTank Norwich

ProductTank Portland

ProductTank Abu Dhabi

ProductTank Manchester

ProductTank Newcastle Upon Tyne

ProductTank Milton Keynes

ProductTank London

ProductTank Jacksonville

ProductTank Phoenix

ProductTank Ljubljana

ProductTank Belgrade

ProductTank Bologna

ProductTank Edinburgh

ProductTank München

ProductTank Birmingham

ProductTank Porto

ProductTank Pune

ProductTank Chennai

ProductTank Genève

ProductTank Heidelberg

ProductTank Málaga

ProductTank Paris

ProductTank Hamburg

ProductTank Kraków

ProductTank Riga

ProductTank Reading

ProductTank San Francisco

ProductTank Goiania

ProductTank Des Moines

ProductTank Bangkok

ProductTank Canberra

ProductTank Dubai

ProductTank Valencia

ProductTank Madrid

ProductTank Düsseldorf

ProductTank Bucharest

ProductTank Raleigh

ProductTank Warsaw

ProductTank Bielefeld

ProductTank Bern

ProductTank Tokyo

ProductTank Pittsburgh

ProductTank Cardiff

ProductTank Krakow

ProductTank NYC

Product Leadership Course

ProductTank Recife

ProductTank Dublin

Member AMA: Unpacking User Research with Laura Klein

ProductTank Copenhagen

Trainer-Led Workshops

ProductTank Tauranga

World Product Day

Member AMA with Ken Norton

#mtpcon London+EMEA 2022 Workshops

#mtpcon London+EMEA 2022 Conference

How product teams can measure progress through outcome OKRs

Mareike Leitermann

Comments

Read next