What examples of Goodhart's law have you encountered in your own life?

kfwyre
2022-03-15T22:21:07Z

Goodhart's law:

When a measure becomes a target, it ceases to be a good measure.

For example: my parents' health insurance company incentivized physical activity¹ by giving rebates to people that got a certain number of steps daily, as measured by Fitbits. While my parents genuinely did make an effort to walk more, there were also days where they attached their Fitbits to the dog, gave them to someone else who was going for a walk, or even aggressively tapped their feet with the device on their knees while sitting in order to meet the measurement. Thus, their step counts ceased being an actual measure of physical activity.

How does this play out in your life, job, industry, field of study, etc.? What measures have been made targets? How has that changed the reliability or validity of the measures themselves?

Also, have you experienced any counterexamples? Are there measures in your domains that haven't succumbed to Goodhart's law? Why do you think that is?

1. This was the face value reason given. I'm more cynical and feel it probably wasn't about physical activity but instead about data gathering.

Comments URL: https://tildes.net/~talk/10pl/what_examples_of_goodharts_law_have_you_encountered_in_your_own_life

Votes: 19

Comments: 21