Metric Fixation

CAT 2018 Slot 2 · VARC · Medium · Reading Comprehension

Passage / data set

More and more companies, government agencies, educational institutions and philanthropic organisations are today in the grip of a new phenomenon: 'metric fixation'. The key components of metric fixation are the belief that it is possible – and desirable – to replace professional judgment (acquired through personal experience and talent) with numerical indicators of comparative performance based upon standardised data (metrics); and that the best way to motivate people within these organisations is by attaching rewards and penalties to their measured performance.

The rewards can be monetary, in the form of pay for performance, say, or reputational, in the form of college rankings, hospital ratings, surgical report cards and so on. But the most dramatic negative effect of metric fixation is its propensity to incentivise gaming: that is, encouraging professionals to maximise the metrics in ways that are at odds with the larger purpose of the organisation. If the rate of major crimes in a district becomes the metric according to which police officers are promoted, then some officers will respond by simply not recording crimes or downgrading them from major offences to misdemeanours. Or take the case of surgeons. When the metrics of success and failure are made public – affecting their reputation and income – some surgeons will improve their metric scores by refusing to operate on patients with more complex problems, whose surgical outcomes are more likely to be negative. Who suffers? The patients who don't get operated upon.

When reward is tied to measured performance, metric fixation invites just this sort of gaming. But metric fixation also leads to a variety of more subtle unintended negative consequences. These include goal displacement, which comes in many varieties: when performance is judged by a few measures, and the stakes are high (keeping one's job, getting a pay rise or raising the stock price at the time that stock options are vested), people focus on satisfying those measures – often at the expense of other, more important organisational goals that are not measured. The best-known example is 'teaching to the test', a widespread phenomenon that has distorted primary and secondary education in the United States since the adoption of the No Child Left Behind Act of 2001.

Short-termism is another negative. Measured performance encourages what the US sociologist Robert K Merton in 1936 called 'the imperious immediacy of interests where the actor's paramount concern with the foreseen immediate consequences excludes consideration of further or other consequences'. In short, advancing short-term goals at the expense of long-range considerations. This problem is endemic to publicly traded corporations that sacrifice long-term research and development, and the development of their staff, to the perceived imperatives of the quarterly report.

Question 1 of 5

All of the following can be a possible feature of the No Child Left Behind Act of 2001, EXCEPT:

  1. A.

    school funding and sanctions are tied to yearly improvement shown on tests.

  2. B.

    standardised test scores can be critical in determining a student's educational future.

  3. C.

    the focus is more on test-taking skills than on higher order thinking and problem-solving.

  4. D.

    assessment is dependent on the teacher's subjective evaluation of students' class participation.

Answer

D

Explanation

In paragraph 3, the author cites the No Child Left Behind Act of 2001 as an example of 'teaching to the test' (focus on quantifiable metric measures). Subjective, unmeasured/unquantified evaluations like a teacher's subjective evaluation of class participation cannot be a feature of such metric-fixated acts.

Question 2 of 5

Which of the following is NOT a consequence of the 'metric fixation' phenomenon mentioned in the passage?

  1. A.

    Short-term orientation induced by frequent measurement of performance.

  2. B.

    Finding a way to show better results without actually improving performance.

  3. C.

    Improving cooperation among employees leading to increased organisational effectiveness in the long run.

  4. D.

    Deviating from organisationally important objectives to measurable yet less important objectives.

Answer

C

Explanation

The passage focuses exclusively on the negative effects of metric fixation. Option C describes a positive outcome ('improving cooperation' and 'increased effectiveness'), which is NOT mentioned or implied as a consequence in the passage.

Question 3 of 5

What main point does the author want to convey through the examples of the police officer and the surgeon?

  1. A.

    Some professionals are likely to be significantly influenced by the design of performance measurement systems.

  2. B.

    Metrics-linked rewards may encourage unethical behaviour among some professionals.

  3. C.

    The actions of police officers and surgeons have a significantly impact on society.

  4. D.

    Critical public roles should not be evaluated on metrics-based performance measures.

Answer

B

Explanation

The author gives the examples of police officers (downgrading crimes) and surgeons (refusing complex patients) in paragraph 2 to illustrate how metrics-linked rewards encourage professionals to game the system in unethical ways at odds with organisational purpose.

Question 4 of 5

Of the following, which would have added the least depth to the author's argument?

  1. A.

    An analysis of the reasons why metrics fixation is becoming popular despite its drawbacks.

  2. B.

    A comparative case study of metrics- and non-metrics-based evaluation, and its impact on the main goals of an organisation.

  3. C.

    More real-life illustrations of the consequences of employees and professionals gaming metrics-based performance measurement systems.

  4. D.

    Assessment of the pros and cons of a professional judgment-based evaluation system.

Answer

C

Explanation

The author has already provided clear examples of gaming (police officers and surgeons). Adding more real-life illustrations of gaming would be superfluous and repetitive, thus adding the least new depth to the argument.

Question 5 of 5

What is the main idea that the author is trying to highlight in the passage?

  1. A.

    Long term organisational goals should not be ignored for short-term measures of organisational success.

  2. B.

    All kinds of organisations are now relying on metrics to measure performance and to give rewards and punishments.

  3. C.

    Evaluating performance by using measurable performance metrics may misguide organisational goal achievement.

  4. D.

    Performance measurement needs to be precise and cost effective to be useful for evaluating organisational performance.

Answer

C

Explanation

The central thesis of the passage is that relying heavily on measurable performance metrics (metric fixation) leads to gaming, goal displacement, and short-termism, thereby misguiding organisations away from achieving their true goals.

Practise this under exam conditions

Sign in to solve it with a live timer, the on-screen CAT calculator, and streak and accuracy tracking across every question you attempt.

Solve in the workspace