![\"processes\"](\"https:\/\/b-spoke.net\/wp-content\/uploads\/2016\/08\/processes.png?w=200\")
<\/a>I was recently clearing some old, battered furniture from the garage; I also had recently chopped down a tree, and had a yardful of logs that had to go. (Scratch that \u2013 it wasn\u2019t me, it was Some Other Guy I Know).<\/h3>\nThe county dump charged by weight \u2013 arriving vehicles drive across a scale at the entrance, and again at the exit, and pay a price-per-pound on the delta. My plan \u2013 rather, that other guy\u2019s plan \u2013 was to load the furniture, dump it, and come back with the logs.<\/h3>\nSurprise! The dump changed its pricing model \u2013 for passenger vehicles, it now charged a flat fee per trip. So instead of two small-ish loads, the \u201csmart\u201d move was to load as much into the bed of the truck as possible and make one trip.<\/h3>\n![\"2016-07-14-12-06-09\"](\"https:\/\/b-spoke.net\/wp-content\/uploads\/2016\/09\/2016-07-14-12-06-09.jpg?w=300\")
Everything fit perfectly, but the driver decided to do the right thing and cover the load; so I, er, he, opened the gate, tied down the tarp, and slammed the gate shut. When the gate opened, the load shifted aft just a bit \u2013 including the nine-foot branch leaning in the eight-and-a-half foot bed. The closing gate pushed that branch back up against the truck\u2019s rear window \u2013 applying just the teensiest amount of pressure that, upon hitting the first bump in the road, caused the window to shatter as if Tarantino\u2019s thugs were standing in the driveway with sawed-off double-aughts.<\/h3>\n![\"2016-07-14-16-10-46\"](\"https:\/\/b-spoke.net\/wp-content\/uploads\/2016\/09\/2016-07-14-16-10-46.jpg?w=300\")
This Didn’t Really Happen.<\/figcaption><\/figure>\nBy trying to minimize \u201cdumping expense\u201d, I made some bad decisions that ultimately cost a lot more money. Measurement systems have an important role to play in how we manage and make decisions – but a risk to consider is that any single metric will be used out of context, or a simply as a blind proxy, and that’s just bad business.<\/p>\n
On the other side of the world, a financial-services client was selling buggy software, and focused its improvement efforts on pre-release testing. Dashboards were created, making various measures of testing visible for all to see. So far, so good.<\/h3>\nBut what happened was, like with that overloaded truck, people tried to make the system work for them. Projects that were largely bulletproof went through \u201cextra\u201d testing in order to turn green on the dashboard \u2013 adding to the Test departments\u2019 queues. Projects that could probably benefit from additional testing \u2013 surprise, surprise \u2013 moved on to Change Control once they passed the requisite metrics.<\/h3>\n
In short, people were working towards <\/em>the measures, rather than using the measurement system as it should be intended.<\/p>\nA fundamental step in any significant improvement effort is getting the metrics right. This is more than just identifying what<\/em> to measure and how<\/em> to measure it: \u201cGetting measures right\u201d includes adapting the right attitude and using measurement systems correctly.<\/p>\nDashboards Aren\u2019t Weapons<\/h4>\n
One thing to be careful of is using singular measurements as indicators of overall performance, or divorcing one system from another. Overloading the truck put one measure \u2013 \u201cdump expense\u201d – in the green, but created significant expense (in dollars and time) to recover.<\/p>\n
We have all been in reviews where a manager pulls one number off the operating report or dashboard and takes everyone to the woodshed. What does one data point really tell us?<\/p>\n
![\"dashboard\"](\"https:\/\/b-spoke.net\/wp-content\/uploads\/2016\/09\/dashboard.jpg\")
Think of a reading on another dashboard: For example, let\u2019s say a speedometer reads \u201c55 miles per hour\u201d. Is that good or bad?<\/p>\n
That is impossible to say, based on just that information: Is the vehicle on an empty freeway or a school zone? Are the roads dry or icy? Is the car well-maintained, or are bald tires held onto the rims with duct tape? Is this even a car, or is it an A321 36,000 feet over the Atlantic?<\/p>\n
Management dashboards are valuable only in context. Measurements work best when viewed as trends, and in overall systems.<\/p>\n
\u00a0Using the System Correctly<\/h4>\n
There are essentially four objectives behind a robust measurement system, and managers would do well to remember all four when reviewing progress.<\/p>\n
So why measure?<\/p>\n
\n- To Provide a Foundation for Identifying Problems
\n<\/strong>Although a single speedometer reading is not enough to judge the success or failure of a road trip, a sudden change may<\/em> be an indicator of something<\/em>. When a number is \u201cmissed\u201d, the initial reaction should not be to punish whoever is presumed to be responsible; the first thing to do is to decide if this is something that needs to be fixed, is a symptom of a larger issue, or is otherwise explainable.<\/li>\n<\/ul>\nAnother client performed business-development services for its franchisees, and built a number of dashboards reviewing established metrics of recruiting rates, enrollment costs, community sponsorship, and the like. While the employees had influence over those items, any one particular project could be held up for a number of factors outside of their control, ranging from undercapitalized franchisees to something as simple as a field manager not returning phone calls.<\/h3>\nSeeing blips against these numbers was not an indication that the individual in the corporate office was not doing her job, but tripped an alert that said, \u201cWe need to take a deeper look here. Is this a temporary issue with this one franchisee? Is this a performance issue with the manager? Are we offering the wrong products?\u201d<\/h3>\nThe measurement was the catalyst for that review \u2013 and knowing that it was good, objective data meant that if any deeper investigation was needed, it could provide the basis for that analysis.<\/h3>\n\n- To Provide a Basis for Identifying Improvement Opportunities
\n<\/strong>Look at the data in as many interesting ways as possible. What are the situations that outperform the rest? Does productivity skyrocket on certain products? What can we do to make all runs like that one? Is \u201cFirst Call Resolution\u201d higher on one day of the week? Why was March the best sales month ever? We tend to get so caught up in looking for problems that we forget to look for chances to grow. A good measurement system allows for both.<\/li>\n<\/ul>\n\n- To Focus Capability Development Efforts
\n<\/strong>Similar to the above, but looking at the human element. Is everyone struggling in a certain area? That may be a chance to shore up peoples\u2019 skills. Alternately, is there one performer \u2013 or crew, or position \u2013 that seems to be ahead of the curve? This may provide a learning opportunity for everyone.<\/li>\n<\/ul>\n\n- To Drive Behaviors
\n<\/strong>As stated initially, this tends to be the default use of a measurement system. When we know how we are being assessed, we will do the things that \u201clook good\u201d \u2013 such as the software developers ordering extra, unneeded testing iterations, because they don\u2019t want the numbers to drop.This is not to imply that this is wrong \u2013 far from it. Clearly understanding what exactly is expected, and how it will be determined, is the key to success. The danger comes from pursuing the metric at the expense of other factors.<\/li>\n<\/ul>\nThe simple fact is, we are<\/u> going to pursue the things that look good on the dashboard and avoid the rest. That something is being measured indicates its relative priority in the organization. This makes it doubly important that we design the right measures, but also that we separate the concept of \u201cprocess measures\u201d from incentives. Having significant financial stakes (e.g., bonus plans) tied to pieces of a system, reduces the likelihood that we will use the measures as the information system to troubleshoot and improve our overall performance.<\/p>\n
Save<\/span><\/p>\nSave<\/span><\/p>\nSave<\/span><\/p>\nSave<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"When metrics are used wisely, they can be effective tools for managing and improving processes. When they are used as weapons, or just improperly handled, they can be dangerous.<\/p>\n
Some things to consider to keep yourself in the ‘wise’ column.<\/p>\n
Everything fit perfectly, but the driver decided to do the right thing and cover the load; so I, er, he, opened the gate, tied down the tarp, and slammed the gate shut. When the gate opened, the load shifted aft just a bit \u2013 including the nine-foot branch leaning in the eight-and-a-half foot bed. The closing gate pushed that branch back up against the truck\u2019s rear window \u2013 applying just the teensiest amount of pressure that, upon hitting the first bump in the road, caused the window to shatter as if Tarantino\u2019s thugs were standing in the driveway with sawed-off double-aughts.<\/h3>\nThis Didn’t Really Happen.<\/figcaption><\/figure>\nBy trying to minimize \u201cdumping expense\u201d, I made some bad decisions that ultimately cost a lot more money. Measurement systems have an important role to play in how we manage and make decisions – but a risk to consider is that any single metric will be used out of context, or a simply as a blind proxy, and that’s just bad business.<\/p>\n
On the other side of the world, a financial-services client was selling buggy software, and focused its improvement efforts on pre-release testing. Dashboards were created, making various measures of testing visible for all to see. So far, so good.<\/h3>\nBut what happened was, like with that overloaded truck, people tried to make the system work for them. Projects that were largely bulletproof went through \u201cextra\u201d testing in order to turn green on the dashboard \u2013 adding to the Test departments\u2019 queues. Projects that could probably benefit from additional testing \u2013 surprise, surprise \u2013 moved on to Change Control once they passed the requisite metrics.<\/h3>\n
In short, people were working towards <\/em>the measures, rather than using the measurement system as it should be intended.<\/p>\nA fundamental step in any significant improvement effort is getting the metrics right. This is more than just identifying what<\/em> to measure and how<\/em> to measure it: \u201cGetting measures right\u201d includes adapting the right attitude and using measurement systems correctly.<\/p>\nDashboards Aren\u2019t Weapons<\/h4>\n
One thing to be careful of is using singular measurements as indicators of overall performance, or divorcing one system from another. Overloading the truck put one measure \u2013 \u201cdump expense\u201d – in the green, but created significant expense (in dollars and time) to recover.<\/p>\n
We have all been in reviews where a manager pulls one number off the operating report or dashboard and takes everyone to the woodshed. What does one data point really tell us?<\/p>\n
Think of a reading on another dashboard: For example, let\u2019s say a speedometer reads \u201c55 miles per hour\u201d. Is that good or bad?<\/p>\n
That is impossible to say, based on just that information: Is the vehicle on an empty freeway or a school zone? Are the roads dry or icy? Is the car well-maintained, or are bald tires held onto the rims with duct tape? Is this even a car, or is it an A321 36,000 feet over the Atlantic?<\/p>\n
Management dashboards are valuable only in context. Measurements work best when viewed as trends, and in overall systems.<\/p>\n
\u00a0Using the System Correctly<\/h4>\n
There are essentially four objectives behind a robust measurement system, and managers would do well to remember all four when reviewing progress.<\/p>\n
So why measure?<\/p>\n
\n- To Provide a Foundation for Identifying Problems
\n<\/strong>Although a single speedometer reading is not enough to judge the success or failure of a road trip, a sudden change may<\/em> be an indicator of something<\/em>. When a number is \u201cmissed\u201d, the initial reaction should not be to punish whoever is presumed to be responsible; the first thing to do is to decide if this is something that needs to be fixed, is a symptom of a larger issue, or is otherwise explainable.<\/li>\n<\/ul>\nAnother client performed business-development services for its franchisees, and built a number of dashboards reviewing established metrics of recruiting rates, enrollment costs, community sponsorship, and the like. While the employees had influence over those items, any one particular project could be held up for a number of factors outside of their control, ranging from undercapitalized franchisees to something as simple as a field manager not returning phone calls.<\/h3>\nSeeing blips against these numbers was not an indication that the individual in the corporate office was not doing her job, but tripped an alert that said, \u201cWe need to take a deeper look here. Is this a temporary issue with this one franchisee? Is this a performance issue with the manager? Are we offering the wrong products?\u201d<\/h3>\nThe measurement was the catalyst for that review \u2013 and knowing that it was good, objective data meant that if any deeper investigation was needed, it could provide the basis for that analysis.<\/h3>\n\n- To Provide a Basis for Identifying Improvement Opportunities
\n<\/strong>Look at the data in as many interesting ways as possible. What are the situations that outperform the rest? Does productivity skyrocket on certain products? What can we do to make all runs like that one? Is \u201cFirst Call Resolution\u201d higher on one day of the week? Why was March the best sales month ever? We tend to get so caught up in looking for problems that we forget to look for chances to grow. A good measurement system allows for both.<\/li>\n<\/ul>\n\n- To Focus Capability Development Efforts
\n<\/strong>Similar to the above, but looking at the human element. Is everyone struggling in a certain area? That may be a chance to shore up peoples\u2019 skills. Alternately, is there one performer \u2013 or crew, or position \u2013 that seems to be ahead of the curve? This may provide a learning opportunity for everyone.<\/li>\n<\/ul>\n\n- To Drive Behaviors
\n<\/strong>As stated initially, this tends to be the default use of a measurement system. When we know how we are being assessed, we will do the things that \u201clook good\u201d \u2013 such as the software developers ordering extra, unneeded testing iterations, because they don\u2019t want the numbers to drop.This is not to imply that this is wrong \u2013 far from it. Clearly understanding what exactly is expected, and how it will be determined, is the key to success. The danger comes from pursuing the metric at the expense of other factors.<\/li>\n<\/ul>\nThe simple fact is, we are<\/u> going to pursue the things that look good on the dashboard and avoid the rest. That something is being measured indicates its relative priority in the organization. This makes it doubly important that we design the right measures, but also that we separate the concept of \u201cprocess measures\u201d from incentives. Having significant financial stakes (e.g., bonus plans) tied to pieces of a system, reduces the likelihood that we will use the measures as the information system to troubleshoot and improve our overall performance.<\/p>\n
Save<\/span><\/p>\nSave<\/span><\/p>\nSave<\/span><\/p>\nSave<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"When metrics are used wisely, they can be effective tools for managing and improving processes. When they are used as weapons, or just improperly handled, they can be dangerous.<\/p>\n
Some things to consider to keep yourself in the ‘wise’ column.<\/p>\n
By trying to minimize \u201cdumping expense\u201d, I made some bad decisions that ultimately cost a lot more money. Measurement systems have an important role to play in how we manage and make decisions – but a risk to consider is that any single metric will be used out of context, or a simply as a blind proxy, and that’s just bad business.<\/p>\n
On the other side of the world, a financial-services client was selling buggy software, and focused its improvement efforts on pre-release testing. Dashboards were created, making various measures of testing visible for all to see. So far, so good.<\/h3>\nBut what happened was, like with that overloaded truck, people tried to make the system work for them. Projects that were largely bulletproof went through \u201cextra\u201d testing in order to turn green on the dashboard \u2013 adding to the Test departments\u2019 queues. Projects that could probably benefit from additional testing \u2013 surprise, surprise \u2013 moved on to Change Control once they passed the requisite metrics.<\/h3>\n
In short, people were working towards <\/em>the measures, rather than using the measurement system as it should be intended.<\/p>\n A fundamental step in any significant improvement effort is getting the metrics right. This is more than just identifying what<\/em> to measure and how<\/em> to measure it: \u201cGetting measures right\u201d includes adapting the right attitude and using measurement systems correctly.<\/p>\n One thing to be careful of is using singular measurements as indicators of overall performance, or divorcing one system from another. Overloading the truck put one measure \u2013 \u201cdump expense\u201d – in the green, but created significant expense (in dollars and time) to recover.<\/p>\n We have all been in reviews where a manager pulls one number off the operating report or dashboard and takes everyone to the woodshed. What does one data point really tell us?<\/p>\n That is impossible to say, based on just that information: Is the vehicle on an empty freeway or a school zone? Are the roads dry or icy? Is the car well-maintained, or are bald tires held onto the rims with duct tape? Is this even a car, or is it an A321 36,000 feet over the Atlantic?<\/p>\n Management dashboards are valuable only in context. Measurements work best when viewed as trends, and in overall systems.<\/p>\n There are essentially four objectives behind a robust measurement system, and managers would do well to remember all four when reviewing progress.<\/p>\n So why measure?<\/p>\n The simple fact is, we are<\/u> going to pursue the things that look good on the dashboard and avoid the rest. That something is being measured indicates its relative priority in the organization. This makes it doubly important that we design the right measures, but also that we separate the concept of \u201cprocess measures\u201d from incentives. Having significant financial stakes (e.g., bonus plans) tied to pieces of a system, reduces the likelihood that we will use the measures as the information system to troubleshoot and improve our overall performance.<\/p>\n Save<\/span><\/p>\n Save<\/span><\/p>\n Save<\/span><\/p>\n Save<\/span><\/p>\n","protected":false},"excerpt":{"rendered":" When metrics are used wisely, they can be effective tools for managing and improving processes. When they are used as weapons, or just improperly handled, they can be dangerous.<\/p>\n Some things to consider to keep yourself in the ‘wise’ column.<\/p>\nDashboards Aren\u2019t Weapons<\/h4>\n
Think of a reading on another dashboard: For example, let\u2019s say a speedometer reads \u201c55 miles per hour\u201d. Is that good or bad?<\/p>\n\u00a0Using the System Correctly<\/h4>\n
\n
\n<\/strong>Although a single speedometer reading is not enough to judge the success or failure of a road trip, a sudden change may<\/em> be an indicator of something<\/em>. When a number is \u201cmissed\u201d, the initial reaction should not be to punish whoever is presumed to be responsible; the first thing to do is to decide if this is something that needs to be fixed, is a symptom of a larger issue, or is otherwise explainable.<\/li>\n<\/ul>\nAnother client performed business-development services for its franchisees, and built a number of dashboards reviewing established metrics of recruiting rates, enrollment costs, community sponsorship, and the like. While the employees had influence over those items, any one particular project could be held up for a number of factors outside of their control, ranging from undercapitalized franchisees to something as simple as a field manager not returning phone calls.<\/h3>\n
Seeing blips against these numbers was not an indication that the individual in the corporate office was not doing her job, but tripped an alert that said, \u201cWe need to take a deeper look here. Is this a temporary issue with this one franchisee? Is this a performance issue with the manager? Are we offering the wrong products?\u201d<\/h3>\n
The measurement was the catalyst for that review \u2013 and knowing that it was good, objective data meant that if any deeper investigation was needed, it could provide the basis for that analysis.<\/h3>\n
\n
\n<\/strong>Look at the data in as many interesting ways as possible. What are the situations that outperform the rest? Does productivity skyrocket on certain products? What can we do to make all runs like that one? Is \u201cFirst Call Resolution\u201d higher on one day of the week? Why was March the best sales month ever? We tend to get so caught up in looking for problems that we forget to look for chances to grow. A good measurement system allows for both.<\/li>\n<\/ul>\n\n
\n<\/strong>Similar to the above, but looking at the human element. Is everyone struggling in a certain area? That may be a chance to shore up peoples\u2019 skills. Alternately, is there one performer \u2013 or crew, or position \u2013 that seems to be ahead of the curve? This may provide a learning opportunity for everyone.<\/li>\n<\/ul>\n\n
\n<\/strong>As stated initially, this tends to be the default use of a measurement system. When we know how we are being assessed, we will do the things that \u201clook good\u201d \u2013 such as the software developers ordering extra, unneeded testing iterations, because they don\u2019t want the numbers to drop.This is not to imply that this is wrong \u2013 far from it. Clearly understanding what exactly is expected, and how it will be determined, is the key to success. The danger comes from pursuing the metric at the expense of other factors.<\/li>\n<\/ul>\n