TL; DR: Ideas on How to Improve Your Product Backlog Management Techniques

Scrum is a simple, yet sufficient framework to build emerging products, provided you identify in advance what is worth building. But even after a successful product discovery phase, you may struggle to make the right thing in the right way if your Product Backlog is not up to the job; garbage in, garbage out—as the saying goes. The following article points at ideas on how to improve your product backlog management techniques — including the Product Backlog refinement process.

Ideas on How to Improve Your Product Backlog Management Techniques

The Product Backlog According to the Scrum Guide

First of all, let’s have a look at the current issue of the Scrum Guide on the Product Backlog:

“Product Backlog refinement is the act of adding detail, estimates, and order to items in the Product Backlog. This is an ongoing process in which the Product Owner and the Development Team collaborate on the details of Product Backlog items. During Product Backlog refinement, items are reviewed and revised. The Scrum Team decides how and when refinement is done. Refinement usually consumes no more than 10% of the capacity of the Development Team. However, Product Backlog items can be updated at any time by the Product Owner or at the Product Owner’s discretion.

Higher ordered Product Backlog items are usually clearer and more detailed than lower ordered ones. More precise estimates are made based on the greater clarity and increased detail; the lower the order, the less detail. Product Backlog items that will occupy the Development Team for the upcoming Sprint are refined so that any one item can reasonably be “Done” within the Sprint time-box. Product Backlog items that can be “Done” by the Development Team within one Sprint are deemed “Ready” for selection in a Sprint Planning. Product Backlog items usually acquire this degree of transparency through the above-described refining activities.

The Development Team is responsible for all estimates. The Product Owner may influence the Development Team by helping it understand and select trade-offs, but the people who will perform the work make the final estimate.”

Source & Copyright: ©2016 Scrum.Org and ScrumInc. Offered for license under the Attribution Share-Alike license of Creative Commons, accessible here and also described in summary form.

Common Product Backlog Anti-Patterns

Despite being relatively straightforward, the process of creating and refining a Product Backlog often suffers from various anti-patterns. I have identified five different categories for Product Backlog techniques:

General Product Backlog Techniques

  1. Prioritization by proxy: A single stakeholder or a committee of stakeholder prioritize the Product Backlog. (The strength of Scrum is building on the strong position of the Product Owner. The PO is the only person to decide what tasks become Product Backlog items. Hence, the Product Owner also decides on the priority. Take away that empowerment, and Scrum turns into a pretty robust waterfall 2.0 process.)
  2. 100% in advance: The Scrum Team creates a Product Backlog covering the complete project or product upfront because the scope of the release is limited. (Question: how can you be sure to know today what to deliver in six months from now?)
  3. Over-sized: The Product Backlog contains too many items. (This way, the Product Owner probably creates waste by hoarding issues that might never materialize. Depending on the specific context, many products might benefit from limiting the Product Backlog to three, possibly four Sprints, particularly in highly competitive markets.)
  4. Outdated issues: The Product Backlog contains items that haven’t been touched for six to eight weeks or more. (That is typically the length of two to four sprints. If the Product Owner is hoarding backlog items, the risk emerges that older items become outdated, thus rendering previously invested work of the Scrum Team obsolete.)
  5. Everything is estimated: All items of the Product Backlog are detailed and estimated. (That is too much upfront work and bears the risk of misallocating the Scrum Team’s time.)
  6. Component-based items: The Product Backlog items are sliced horizontally based on components instead of vertically based on end-to-end features. (This may be either caused by your organizational structure. Then move to cross-functional teams to improve the team’s ability to deliver. Otherwise, the team – and the Product Owner – need a workshop on writing items.)
  7. Missing acceptance criteria: There are items in the Product Backlog without acceptance criteria. (It is not necessary to have acceptance criteria at the beginning the refinement cycle although they would make the task much more manageable.)
  8. No more than a title: The Product Backlog contains items that comprise of little more than a title. (See above.)
  9. Issues too detailed: There are items with an extensive list of acceptance criteria. (This is the other extreme: the Product Owner covers each edge case without negotiating with the team. Typically, three to five acceptance criteria are more than sufficient.)
  10. Neither themes nor epics: Neither themes or epics do structure the Product Backlog. (This makes it hard to align individual items with the “big picture” of the organization. The Product Backlog is not supposed to be an assortment of isolated tasks or a massive to-do-list. Please note that both themes and epics are not elements of the Scrum Guide.)
  11. No research: The Product Backlog contains few to no spikes. (This often correlates with a team that is spending too much time on discussing prospective problems, instead of researching them with a spike as a part of an iterative item creation process.)

Techniques at Portfolio and Product Roadmap Level

  1. Roadmap? The Product Backlog is not reflecting the roadmap. (The Product Backlog is supposed to be detailed enough only for the first two or three sprints. Beyond that point, the Product Backlog should rather focus on themes and epics — see above — from the product roadmap. If those are not available, the product backlog is likely to granular.)
  2. Annual roadmaps: The organization’s portfolio plan, as well as the release plan or product roadmap, are created once a year in advance. (If the Product Backlog stays aligned to these plans, it introduces waterfall planning through the backdoor. Agile planning is always “continuous.” At the portfolio level, the plan needs to be revised be least every three months.)
  3. Roadmaps kept secret: The portfolio planning and the release plan or product roadmap are not visible to everybody. (If you do not know where you are going any road will get you there. This information is crucial for any Scrum Team and needs to be available to everybody at any time. )
  4. China in your hands: The portfolio planning and the release plan or the product roadmap are not considered achievable and believable. (If this is reflected in the Product Backlog, working on items will probably be a waste.)

Product Backlog Techniques of the Product Owner

  1. Storage for ideas: The Product Owner is using the Product Backlog as a repository of ideas and requirements. (This practice is clogging the Product Backlog, may lead to cognitive overload and makes alignment with the ‘big picture’ at portfolio management and roadmap planning level very tough.)
  2. Part-time or busy PO: The Product Owner is not working daily on the Product Backlog. (The Product Backlog needs to represent at any given time the best use of the Development Team’s resources. Updating it once a week before the next refinement session does not suffice to meet this requirement.)
  3. Copy & paste PO: The Product Owner creates items by breaking down requirement documents received from stakeholders into smaller chunks. (That scenario helped to coin the nickname “ticket monkey” for the product owner. Remember: item creation is a team exercise.)
  4. Dominant PO: The Product Owner creates items by providing not just the ‘why’ but also the ‘how,’ and the ‘what.’ (The team answers the ‘how’ question – the technical implementation –, and both the team and the PO collaborate on the ‘what’ question: what scope is necessary to achieve the desired purpose.)
  5. INVEST? The Product Owner is not applying the INVEST principle by Bill Wake to items.
  6. Issues too detailed: The Product Owner invests too much time upfront thus making them too detailed. (If an item looks complete, the team members might not see the necessity to get involved in further refinement. This way, a “fat” item reduces the engagement level of the team, compromising the creation of a shared understanding. By the way, this didn’t happen back in the days when we used index cards given their physical limitation.)
  7. What team? The Product Owner is not involving the entire Scrum Team in the refinement process and instead is relying on just the “lead engineer” (or any other member of the team independently of the others).
  8. ‘I know it all’ PO: The Product Owner does not involve stakeholders or subject matter experts in the refinement process. (A Product Owner who believes to be either omniscient or a communication gateway is a risk to the Scrum Team’s success.)

Development Team Techniques

  1. Submissive team: The Development Team submissively follows the demands of the Product Owner. (Challenging the Product Owner whether his or her selection of issues is the best use of the Development Team’s time is the noblest obligation of every team member: why shall we do this?)
  2. What technical debt? The Development Team is not demanding adequate resources to tackle technical debt and bugs. (The rule of thumb is that 25% of resources are allocated every sprint to fixings bugs and refactor the code base.)
  3. No slack: The Development Team is not demanding 20% slack time from the Product Owner. (This is overlapping with the sprint planning and the team’s forecast. However, it cannot be addressed early enough. If a team’s capacity is always utilized at 100 %, its performance will decrease over time. Everyone will focus on getting his or her tasks done. There will be less time to support teammates or to pair. Small issues will no longer be addressed immediately. And ultimately, the ‘I am busy’ attitude will reduce the generation of a shared understanding among all team members why they do what they are doing.)

Product Backlog Techniques of the Scrum Team

  1. No time for refinement: The team does not have enough refinement sessions, resulting in a low-quality backlog. (The Scrum Guide advises spending up to 10% of the Scrum Team’s time on the Product Backlog refinement. Which is a sound business decision: Nothing is more expensive than a feature that is not delivering any value.)
  2. Too much refinement: The team has too many refinement sessions, resulting in a too detailed backlog. (Too much refinement isn’t healthy either.)
  3. No DoR: The Scrum Team has not created a ‘definition of ready’ that Product Backlog items need to match before becoming selectable for a sprint. (A simple checklist like the ‘definition of ready’ can significantly improve the Scrum Team’s work. It will increase the quality of both the resulting item as well as the general way of working as a team. Please note that the SG only mentions “ready” in the following sense: “Product Backlog items that can be “Done” by the Development Team within one Sprint are deemed “Ready” for selection in a Sprint Planning.”)

Conclusion

Even in the case, you have successfully identified what to build next, your Product Backlog, as well as its refinement process, will likely provide room for improvement. Just take it to the team and address possible Product Backlog techniques.

Are Product Backlog techniques missing that you have observed? Please share with us in the comments.