post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Customer Research

Hardware

Digital Transformation

Our Privacy Policy is changing on April 5, 2022 - for more information and a description of the updates, <a href="https://mtpdevwpe.wpengine.com/privacy/" style="color:#FFFFFF;text-decoration:underline;">see the policy here.</a>

Switching back the focus from ‘Build only’ to ‘Build-measure-learn’

Product career special part 2: Making a change

Build what matters with vision-led product management

Lessons in fearless leadership

Building a product organisation from scratch by Kevin Mansfield

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

The executive product leader persona

Test blog post

I've been in the digital industry for over 10 years and have worked across small and large charities, as well as my own freelance projects. I am now Director of Digital at the sector leading creative agency William Joseph. 

Having been at Cancer Research UK for the last four years, I have been able to work on high volume, high profile campaigns such as Race for Life, Dryathlon and the much-quoted #nomakeupselfie. 

In that time I helped drive forward the charity’s digital product and marketing capabilities to be some of the most respected and successful in the sector. 

I'm always excited to work with other organisations, share expertise and swap cat gifs. Give me a shout!

James Gadsby Peet

<p style="text-align: center;"><em><strong>Summary:</strong> Done properly, applied artificial intelligence (AI) can enhance the user experience across your product &#8211; providing value for your users and your organisation. However, you need to allow your users to make the final judgement, spend time training your model, build in feedback loops and be transparent about how you’re using AI.</em></p>
<h3>How to Apply AI</h3>
<p>There are lots of different conversations going at the moment about artificial intelligence. Some are more abstract than others. The sharp end of research will continue to be out of product managers’ reach for a while yet &#8211; we’ll leave that to DeepMind. However there are numerous tools at our disposal to put AI to work now &#8211; and a few watch-outs for solving customer problems with these capabilities.</p>
<h3>Start With the Problem, not the Solution</h3>
<p>As all good product managers know, we need to identify the issues our users face and then find ways in which we can add value by solving them. It’s tempting to be led by the technology not the problems we’re trying to solve when working with new tools like AI. So avoid this mindset and be aware that not every problem can be solved with AI.</p>
<h3>Any AI use Cases Have to Contribute to Your Overall Product Vision</h3>
<p>It’s worth setting up some areas where you think AI can help to improve your product in order to investigate them. These areas must support your overall product vision &#8211; whether that’s making your users’ lives easier, removing hurdles within your product’s workflow and so on</p>
<p>Typical uses of AI at Diogo’s company, international media group <a href="https://www.schibsted.com/">Schibsted</a>, have been to:</p>
<ul>
<li>Auto-fill / suggest data for users</li>
<li>Identify steps that a user can skip</li>
<li>Help with non-intuitive tasks such as categorisation</li>
<li>Recognise real-world objects to save data input</li>
</ul>
<h3>The User is the Teacher and has the Final say</h3>
<p>In any use case where you automatically suggest data to a user &#8211; such as categorisation of an item &#8211; you must allow them to “correct it” if they want to. You then must send this suggestion back to the AI tool so that it can keep learning and improving. You must track the number of these changes that users make, so you can measure the improvement of your feature. As it gets better, the feature becomes more effective and adds more value to your users and product.</p>
<h3>Compare Human and AI Accuracies to Generate Buy-in</h3>
<p>When implementing a new AI-powered feature, you need to test and monitor its accuracy. The best way to do this is to compare it against humans doing the same task. You may be surprised by how low the human success rates are for some tasks such as categorisation &#8211; and hence how good (or bad) your AI tool must be in order to still be worth investing in.</p>
<h3>Don’t Forget Your Training Data</h3>
<p>In order for your AI-powered feature to work, you need to train the algorithm on which it is based. This means you need data for the problem you’re trying to solve, with the correct answers attached. The more of this you have, the more accurate your model will be and the more value it will add to your product.</p>
<h3>Decide how to Deal With Inaccuracy</h3>
<p>Your AI won’t get the answer right every time. Fortunately though, it will give you a confidence metric with every suggestion. You can use this to decide what you want to show when it goes below a certain threshold. This can be a message to the user, allowing a choice or removing the feature altogether.</p>
<h3>Be Transparent With Your Users</h3>
<p>If you are using AI to change or influence the user experience, you have to let them know about it. If you don’t, they will get confused and stop trusting your product &#8211; causing issues across the board. Use copy like “auto-suggested XYZ” rather than just putting the information on a form.</p>
<div class="g g-21"><div class="g-single a-95"><a class="gofollow" data-track="OTUsMjEsMSw2MA==" href="https://mtpdevwpe.wpengine.com/product-management-training/public-workshops/product-metrics-workshop/"><img decoding="async" src="https://mtpdevwpe.wpengine.com/wp-content/uploads/2022/04/Training-Metrics-what-should-a-PM-know_-FOOTER-scaled.jpg" /></a></div></div>

core/freeform

Metrics don’t have all the answers: a human-centered approach to business strategy by Samihah Azim

Solving Ethical AI Problems, When Algorithms Go Wrong, and the Skills Needs To Work on AI Solutions: Insights From Kriti Sharma

How AI Is Changing The Product Management Job Description by Mayukh Bhaowal

Designing Meaningful Human Experiences by Kate O’Neill

Can AI Create a Fairer World? By Kriti Sharma

They’re Just Fancy Averages by Ben Fields

Data Science and Digital Businesses by Ali Gulez

Talking About Data Science by Jenessa Lancaster

AI at an Early Stage Startup by Zara Tam

Building Search Products With Machine Learning – Shakhina Pulatova

Diogo Coutinho – AI in the Real World

ProductTank Tallinn

ProductTank Norwich

ProductTank Portland

ProductTank Abu Dhabi

ProductTank Manchester

ProductTank Newcastle Upon Tyne

ProductTank Milton Keynes

ProductTank London

ProductTank Jacksonville

ProductTank Phoenix

ProductTank Ljubljana

ProductTank Belgrade

ProductTank Bologna

ProductTank Edinburgh

ProductTank München

ProductTank Birmingham

ProductTank Porto

ProductTank Pune

ProductTank Chennai

ProductTank Genève

ProductTank Heidelberg

ProductTank Málaga

ProductTank Paris

ProductTank Hamburg

ProductTank Kraków

ProductTank Riga

ProductTank Reading

ProductTank San Francisco

ProductTank Goiania

ProductTank Des Moines

ProductTank Bangkok

ProductTank Canberra

ProductTank Dubai

ProductTank Valencia

ProductTank Madrid

ProductTank Düsseldorf

ProductTank Raleigh

ProductTank Warsaw

ProductTank Bielefeld

ProductTank Bern

ProductTank Tokyo

ProductTank Pittsburgh

ProductTank Cardiff

ProductTank Krakow

ProductTank NYC

Product Leadership Course

ProductTank Recife

ProductTank Dublin

Member AMA: Unpacking User Research with Laura Klein

ProductTank Copenhagen

Trainer-Led Workshops

ProductTank Tauranga

World Product Day

Member AMA with Ken Norton

#mtpcon London+EMEA 2022 Workshops

#mtpcon London+EMEA 2022 Conference