Sunday, August 26, 2012

Why the Slope Handicap System Doesn’t Work for Plus Indices: A Proposal for Revising the Slope Handicap System




Introduction - In a previous article, Far Hills, We Have a Problem,[1] it was argued the United States Golf Association (USGA) Handicap System does not accurately measure a golfer’s potential when scores are below the Course Rating.  Under the Handicap System, a player who scores 5 strokes under the Course Rating at a course with a low Slope Rating is considered a better player than one who scores 5 strokes under the Course Rating at a course with a high slope Rating.  The USGA has attempted to defend this result in articles and statements by handicap officials. The second section of this paper examines that defense to judge its validity.  The arguments made by the USGA are found to have no theoretical or empirical foundation.   The third section examines the historical roots of the Slope Handicap System to see how the flaw came into being. It is found that institutional rigidity (i.e., an unrealistic view of its own fallibility), and secrecy played a large part in keeping this flaw as part of the Slope handicap System for over twenty years. The final section proposes a revised Slope Handicap System to correct the shortcoming in the present system.

The USGA’s Defense – The bulk of the USGA’s defense is put forward in an article entitled Slope on the Plus Side of Scratch which is posted on the USGA’s website (USGA.org):

If the USGA Course Rating System was changed such that Course Ratings were all ten strokes less…there would be no Plus Handicaps.  Close inspection shows that the adjustment of these Handicaps would produce the same relative changes between higher- and lower- Handicap players as when their handicaps were on the opposite side of scratch.[2]

This assertion is demonstrably false which can be proven by an example.  Assume Player A scores 5 strokes under the course rating on a course with a Slope Rating of 150.  His handicap differential (HD) is  -3.8.  Player B scores 5 strokes under the Course Rating on a course with Slope Rating of 87.  Player B’s HD is -6.5.  Under the USGA handicap system, Player B is deemed to be the much better player.

Now assume the article’s suggestion is adopted and the course ratings are reduced by 10 strokes.  Players A and B now score 5 strokes over the Course Rating at their respective courses.  Since Player A played on a course with a higher Slope Rating than Player B, Player A would be deemed the better player.  Therefore, there has been a relative change in the assessment of each player’s ability contrary to the USGA’s assertion.

The USGA’s article defends the curious result of high-Slope courses being relatively easy for the accomplished player with the following statement:

To some, it is instinctive that the Handicap Differential should be an even lower value (farther from zero) because it was scored on a high-Slope course.  A high–Slope course presents the challenges (and opportunities) for outstanding players to distance themselves from a Scratch performance and, conversely, a low-Slope course does not present the same challenges (or opportunities).



Even though this argument lacks substance and reason, it has been accepted as dogma by the USGA.  Jim Cowan, Director of Handicapping for the Northern California Golf Association, demonstrated his adherence to USGA doctrine when he wrote:

…it is much easier to score five below the Course Rating from a set of tees where the scores tend to spread out (i.e., courses with high Slope Ratings).  It is much more difficult to break away from the pack by scoring five below the Course Rating from a set of tees where the scores tend to squeeze together.[3]



Scott Hovde, USGA Manager of Course Rating and Handicap Education, also did not stray from orthodoxy when he put forth a similar defense:

As Slope Rating is a relative measurement of difficulty (not absolute), essentially an indication of how scores are spread out…a performance of 5 under the Course Rating on a Slope Rating of 87 is more significant. On a course with an 87 Slope Rating, scores are expected to spread out at a rate of .77 (87/113…rounded) per difference of 1.0 in the Handicap Index. To beat a scratch golfer (who is a very good player) by 5 strokes on a course where scores are very tight for players of all handicap levels, is more difficult than doing it on a course with a 150 Slope Rating, which spreads out scores by 1.32 per 1.0 in the Index.[4]



The deficiencies in the USGA’s defense are best shown by way of examples:



1.       The USGA argues it is easier to score 5-under the Course Rating at a high-Slope course because challenges allow the better player to separate himself.  A tough course may make it easier to identify the truly great player—after all, that is the theory behind the course set-up at the U.S. Open. It does not mean a score of 5-under the Course rating at the U.S. Open is relatively easy to achieve.

2.       Assume you are a +3.9 index from a course with a Slope Rating of 87 (i.e., your ten best scores average 3 strokes under the Course Rating and your home course handicap is +3).  You now travel to a course with a Slope Rating of 150.  You are made a +5 handicap because of the “challenges” presented by this course and its high Slope Rating.  You argue that if there are increased challenges at a course with a high Slope Rating, shouldn’t my handicap be increased rather than decreased? Isn’t that what the Slope system is all about?  The tournament committee consults the USGA and rejects your plea.     

3.       Hovde argues the Slope System spreads out scores.  This is incorrect.  The Slope System multiplies a player’s index by Slope Rating/113 to estimate his score relative to the course rating.[5]  If the Slope Rating is over 113, this mathematical operation gives the illusion of “spreading out scores.”  What is forgotten is the Slope System also contracts a player’s score by 113/Slope Rating to calculate a player’s index.  If a player only plays his home course, for example, the estimate of his score would not be affected by the Slope Rating.

4.       Hovde and Cowan both argue scores are very tight at a course with a low Slope Rating.  Like most of Slope Theory, their argument is based on supposition and has not been empirically verified.  There is no research indicating the standard deviation of the distribution of a player’s scores is a function of the Slope Rating.[6]

5.       Now here is a reality check.  Assume you have Player A consistently scoring 4-under the course rating at Pine Valley (Slope Rating = 155).  Player B scores 4-under the course rating at The Oasis (Slope Rating = 87).  In a match at Pine Valley, Player A would receive 3 strokes from Player B.  The USGA Handicap System implies the match would be even.  Who would you bet on?

Tracing the Historical Roots of the Slope Handicap System - Before detailing the proposed Slope System, it is important to understand the historical roots of the present system. The figure below illustrates the problems the System was designed to cure.[7]  A 10-handicap (pre-Slope System) from Perfect Valley allegedly would score several strokes higher at Panther Mountain because of various course difficulties—i.e., a 10-handicap from Perfect Valley could not fairly compete with a 10-handicap from Panther Mountain.  The argument has intuitive appeal even though it has not been empirically verified.


                                      Figure – Score Versus Perfect Valley Handicap

None of the papers proposing the Slope System, however, discuss the region below the Course Rating (i.e., plus indices).[8]  The USGA merely extrapolated the slope line based on two points (the scratch player’s score and the bogey player’s score). When the slope line was in the region below the Course Rating, it had to be assumed that the plus handicap player from Perfect Valley was a better player than a Panther Mountain player with the same plus handicap. This meant the Perfect Valley player with a plus handicap would have his handicap reduced when he travelled to Panther Mountain. There is no empirical or theoretical evidence to support this reduction.  It is simply the result of assuming the slope line continues as a linear function in the region below the Course Rating.  A revised Slope System should have a more realistic assumption of what occurs in this region.

This flaw in the Slope Handicap System has minimal effect on the equity of competition.  After all, there are not that many players with plus indices.  Why then has the USGA made a spirited defense of its error?  The reason appears to be twofold.  First, the Slope Handicap System is a USGA product and to admit a manufacturing defect would hurt the brand image.  Whether it is the handicap system, equipment testing, or rules changes, the USGA is loathe to admitting fallibility.   This is especially true in the handicapping area where for many years external criticism was handled directly by those who developed the Slope System. 

Second, the USGA conducts what little research it does on handicapping without peer review. This has made the USGA a very insular organization.  The Handicap Procedures Committee apparently has no members who can challenge the Handicap Research Team (HRT).  This allowed the HRT to publish the gobbledygook contained in “Slope on the Plus Side of Scratch” and have it be accepted by leading officials at the USGA and at state golf associations.      

A Proposed Slope Handicap System – In the region above the Course Rating, the slope effect in the current Slope System is positive and decreases in size as the handicap of the Perfect Valley player decreases.   At scratch, there is no adjustment.  In the region of plus handicaps, the slope effect is negative and increases in size as the Perfect Valley player’s handicap decreases (i.e., a +5 handicap at Perfect Valley will have a larger handicap reduction than a +2 handicap when they play at Panther Mountain).   Is this reasonable?  Why should a reduction in handicap for a plus handicap be based on the travails of a bogey golfer?[9]   Isn’t it possible Panther Mountain has course difficulties the plus handicap from Perfect Valley rarely encounters?  Shouldn’t the plus handicap from Perfect Valley have his handicap increased, rather than decreased, when he travels to Panther Mountain?

The actual behavior of the slope function below the course rating would be difficult to estimate, and would lead to increased complexity of the Slope Handicap System.  Therefore, the proposed Slope System makes the simplifying, but reasonable, assumption that the slope effect is zero for all scores below the Course Rating.    The handicap differential (HD) for scores below the Course Rating would be:

HD = Score – Course Rating


Indices would be converted to handicaps in the following manner:


                          Index <0, then Handicap = Index rounded to the nearest integer.

Index >0, then Handicap = Index x Slope Rating/113 rounded to the nearest integer.


A player who consistently scores 3 strokes under the course rating would be a +3.0 index (forgetting the bonus for excellence) and a +3-handicap at all courses.  This eliminates the paradox of the player from the course with the low Slope Rating being considered the better player when both players score the same number of strokes below the Course Rating.

This change will make a small difference for players with scores below the Course Rating in intra-club play.  Table 1 below shows the handicap differentials for various scores and Slope Ratings.  As a general rule, if a player has scores below the Course Rating in his ten best scores, his index will be reduced under the revised system if the Slope Rating is greater than 113.  His index will be increased under the revised system if the Slope Rating is less than 113.  In this example, however, both players would all play to a scratch handicap under both the old and revised system.



Table 1

Handicap Differentials Under the New and Revised System


Score – CR
Slope Rating = 87
Slope Rating = 150
Old System
Proposed System
Old System
Proposed System
-5
-6.5
-5.0
-3.8
-5.0
-4
-5.2
-4.0
-3.0
-4.0
-3
-3.9
-3.0
-2.3
-3.0
-2
-2.6
-2.0
-1.5
-2.0
-1
-1.3
-1.0
-0.8
-1.0
1
1.3
1.3
0.8
0.8
2
2.6
2.6
1.5
1.5
3
3.9
3.9
2.3
2.3
4
5.2
5.2
3.0
3.0
5
6.5
6.5
3.8
3.8
Handicap Index
0.0
0.4
0.0
+0.3

                                                               
 able 2 presents the difference in handicaps for various differences in index under the present and proposed systems for Slope Ratings of 150 and 87.  The +5 index player will give fewer strokes under the proposed system at the course with a Slope Rating of 150. Under the old system a +5 index would receive a handicap of +6.63 (not rounded).  Since the proposed system assumes no slope effect for a player with a plus index, his handicap is only +5 under the proposed system.  Similarly, the +5 index will give more strokes at the course with a Slope Rating of 87 (i.e., the proposed system assumes a +5 index will score lower that that projected by the current system.)    

Table 2

Handicap Difference for Equal Differences in Index



Index Difference
Handicap Difference (Slope Rating = 150)
Present
Proposed
+5 and 5 index
13.27
11.64
5 and 15 index
13.27
13.27
15 and 25 index
13.27
13.27

Index Difference
Handicap Difference (Slope Rating = 87)
Present
Proposed
+5 and 5 index
7.70
8.85
5 and 15 index
7.70
7.70
15 and 25 index
7.70
7.70


To see that the proposed system is equitable, Table 3 shows the difference in handicaps, regardless of the Slope Rating,  for players with the same difference in scores.

Table 3

Handicap Difference for Equal Differences in Scores


Score Diff.  Relative to Course Rating
Handicap Difference
Present
Proposed
-5 and 5
10
10
5 and 15
10
10
15 and 25
10
10


The major difference under the revised System is when a plus index travels to another course.  Let’s see how competition between Panther Mountain and Perfect Valley players would be affected by the proposed system. Assume the Panther Mountain Players scores 10 strokes over the Course Rating and the Slope Rating is 150.  Further assume the Perfect Valley player scores 5 strokes under the Course Rating and the Slope Rating is 113. Table 4 shows the difference in handicaps when matches are played at the two courses.

Table 4

Match Handicap Differences



Panther Mountain Player Handicap
Perfect Valley Player Handicap
Handicap Difference
Match at Panther Mountain
Current System
10
+6
16
Proposed System
10
+5
15




Match at Perfect Valley
Current System
7
+5
12
Proposed System
7
+5
12


As shown by the table, handicap differences generated by the two systems are the same except when a plus index player travels to another course.  If a player with a non-plus handicap travels to another course, both systems yield the same handicap difference. The question is “Which system is more equitable?”  The current system assumes a plus index from Perfect Valley will score lower–relative to the course rating—at Panther Mountain than he does at his home course.  This seems implausible. 

The proposed system appears on its face to be more equitable.  Like all proposals, however, it faces two tests.  First, can the increased accuracy of the revised system in measuring the ability of players scoring below the Course Rating be empirically verified?  Second, even if the answer to the first question is “yes,” is a change worth the effort?  The revised system may only increase the equity of competition for a few players, and it is not without cost.  Until these two questions are answered, however, it is clear the USGA should remove its defense of the Slope System, Slope on the Plus side of Scratch, from its website.







[1] Far Hills, We have a Problem, ongolfhandicaps.blogspot.com, June 4, 2012.
[2] The USGA may be arguing if there is a difference in index between players, the difference in calculated handicaps is not affected if either or both players are a plus index.  This is true and never in question. The issue is whether the Slope Handicap System accurately measures the ability of players with scores below the Course Rating.
[3] Cowan, Jim, e-mail to the author, 4/13/2012.  Cowan appears to argue there is a force proportional to 1/(Slope Rating) that constrains scores around the Course Rating (i.e., a score of 5 under the Course Rating at a course with a high Slope Rating is relatively easy to achieve because the force is relatively weak). Extending Cowan’s logic, a score of 5-over the Course Rating should be easier to achieve on a course with High Slope Rating than on one with a low Slope Rating.  Such a finding would conflict with Slope Theory that holds it is easier to score 5 over the Course Rating on the course with the lower Slope Rating.
[4] Hovde, Scott, e-mail to author, 4/16/2012.        
[5] It actually estimates the average of his ten best scores out of twenty multiplied by .96.
[6] Sheid argued the standard deviation of a player’s scores increased with his handicap, but was mute on any effect of the Slope Rating. See Scheid, F.J., “On the normality and independence of golf scores, with various applications,” in Science and Golf: The Proceedings of the First World Scientific Congress, Rutledge, Chapman, and Hall, London, 1990, pp. 147-152.
[7] Stroud, R.C., and L.J. Riccio, “Mathematical Underpinnings of the Slope Handicap System,” in Science and Golf: The Proceedings of the First World Scientific Congress, Rutledge, Chapman, and Hall, London, 1990, pp. 135-146. Stroud and Riccio did not extend the slope lines below the course rating in their paper.
[8]  Stroud, loc. cit. and Knuth, D., “A two parameter golf course rating system,” Science and Golf: the Proceedings of the First World Scientific Congress, Rutledge, Chapman, and Hall, London, 1990, pp 141-146.
[9] It is probable that the USGA adopted the linear assumption because it was simple, and made the computations from index to course handicap analytically simple.  Simplicity, however, is not a sufficient selection criterion.  The primary objective was to increase the equity of competition.  If any slope effect is not linear, then the Slope System has only distorted true handicaps and lessened equity as the case of the plus index suggests.

Monday, June 25, 2012

The USGA Responds II


A senior official at the USGA made the following response to the criticism detailed in the previous post (Far Hills, We Have a Problem):

"Thank you for the thoughtful attention and work. After meeting with the Handicap Committee, Course Rating Committee and the Handicap Procedure Committee, we are now scheduled to meet with the HRT next week with this being one of the discussion topics. We clearly understand the importance of our roles in this area relating to the USGA Handicap System and are indeed taking a more aggressive position with our R&D this year. As communicated previously, I will likely be reaching out to you for help where appropriate.
Again, thank you for taking the time to clearly outline your observations and recommendations. They will be given careful thought and consideration by all involved. I will reach back out to you once we have some actionable items. Until then, please feel free to contact me with any questions or concerns." 

I believe this is USGA speak for "You will never see or hear from us again."

.

Monday, June 4, 2012

Far Hills, We Have a Problem


Introduction – This paper explores problems with the United States Golf Association (USGA) Handicap System.  These problems stem from a failure to understand the theory behind the Slope Handicap System, and the dearth of USGA-sponsored research on handicap issues for the past 20 years.  This in turn has led the USGA to make changes in the handicap system that reduce the equity of competition. 

The device chosen to illustrate these problems is a case study involving Section 10-3, Reduction of Handicap Index Based on Exceptional Tournament Scores, of the Handicap System. The following example and question were posed to the USGA: 
Player A plays two tournaments at a course with a Slope Rating of 150. His two net scores are five strokes under the Course Rating.
Player B plays two tournaments at a course with a Slope Rating of 87. His two net scores are also five strokes under the Course Rating.
Assume these T-scores are the only ones in each player’s file. Under Section 10-3, Player A receives no reduction in index.  Player B’s index is reduced by 4.8. Why is the player on the "easier" course treated so harshly?

The problems are examined in three parts.  First, the USGA’s response is analyzed for its understanding of the Slope Handicap System. The USGA’s answer is found to be unresponsive at best and invalid at worst.  Second, a flaw in the Slope Handicap System is demonstrated.  This flaw is partially responsible for the counter-intuitive result of the above example, and its existence has been steadfastly denied by various officials at the USGA and state golf associations. Third, the mistakes made in the development of the Handicap Reduction Table of Section 10.3 are documented.  The USGA changed the vocabulary used in the table to be consistent with the Slope Handicap System (e.g., “strokes under the course rating” became “index minus average tournament differential.”  The USGA didn’t know or didn’t care that these two concepts of exceptional performance are not synonymous.  This mistake has led to inequity and the counter-intuitive result of the example.  In a concluding section, the state of research at the USGA is assessed and recommendations for improvement made.   

The USGA Response – Scott Hovde, Manager of Course Rating and Handicap Education at the USGA, made the following response in an attempt to answer the questions posed in the example:[1]

As Slope Rating is a relative measurement of difficulty (not absolute), essentially an indication of how scores are spread out…a performance of 5 under the Course Rating on a Slope Rating of 87 is more significant.  On a course with an 87 Slope Rating, scores are expected to spread out at a rate of .77 (87/113…rounded) per difference of 1.0 in the Handicap Index.  To beat a scratch golfer (who is a very good player) by 5 strokes on a course where scores are very tight for players of all handicap levels, is more difficult than doing it on a course with a 150 Slope Rating, which spreads out scores by 1.32 per 1.0 in the Index.

The advantage of a player with a lower Index grows as Slope Rating goes up and shrinks as Slope Rating goes down, regardless of which side of scratch a player is on.

Hovde argues scores are very tight on courses with low slope ratings and therefore performances of 5-under the Course Rating are more difficult to achieve.   There is no empirical or theoretical basis for such a claim. Papers proposing the Slope System only argue a player’s average score increases with the Slope rating.[2]  These papers do not argue the Slope Rating affects the distribution of a player’s score.    

Hovde next argues the advantage of a player with a lower Index grows as Slope Rating goes up and shrinks as Slope Rating goes down.  This is true by the definition, was never in question, and is irrelevant to the question posed in the example.  The question is whether indices are assigned properly, and not whether the handicap calculation based on those indices is correct.  Why does the USGA consider the player who scores 5-under the Course Rating at the PGA West Stadium Course (Slope Rating = 150) less skilled than a player scoring 5-under the Course Rating at the Oasis (Slope Rating = 87)?  This question is examined next.

Flaw in the Slope Handicap System – To understand the flaw in the theory behind the Slope Handicap System, it is important to review its theoretical underpinnings.  The Slope Handicap system was introduced by the USGA in order to bring more equity to the game.  The previous handicap system had computed handicaps by measuring the difference between a player's score and the course rating.  It was believed, however, the course rating did not properly measure the difficulty of the course for the higher handicapper.

The theory behind the Slope System is illustrated in the figure below:[3]   

Figure - Player’s Score at Panther Mountain and Perfect Valley Versus Perfect Valley Handicap


The figure plots players' expected scores (defined here as 96 percent of the average of the ten best out of the last twenty rounds) on a tough course named Panther Mountain (slope rating = 155) against their handicaps on a course of average difficulty named Perfect Valley (slope rating = 113).  For example, a 10-handicap at Perfect Valley would be expected to have a score of 83.7 at Panther Mountain or 13.7 strokes over the course rating of 70.  Also shown in the figure is the score on Perfect Valley plotted against a player's Perfect Valley Handicap.  For convenience the course rating at each course is assumed to be the same (70), though that is not necessary to the argument.
Therefore, as illustrated in the figure, players from Perfect Valley with handicaps greater than scratch (i.e., 0 handicap), will score higher at Panther Mountain than they will at their home course.  The Slope Handicap System increases these players' handicaps at Panther Mountain reflecting the difficulty of the course.  While the USGA has never presented any empirical evidence of this “slope effect,” it does make intuitive sense.  Obstacles at Panther Mountain such as length, water hazards, and rough may cause problems for bogey golfers that are not incorporated in the Course Rating.

 Perfect Valley players with plus handicaps (i.e., less than scratch), however, are expected to score lower at Panther Mountain than at Perfect Valley.  Therefore, these players will have their handicaps reduced when they play at Panther Mountain.  The Slope Handicap System assumes a course with a high slope rating is relatively easy for players with indices less than scratch.  There is no empirical evidence indicating this assumption is valid.  Nor is there any theoretical reason to believe a player who scores    5-under the Course Rating at Perfect Valley is a much better player than one who scores 5-under at Panther Mountain.

The problem arises because the USGA chose to set the scratch golfer as the standard.  Had the standard been set at the “perfect golfer” (e.g., a +10) there would be no negative differentials and all players at Perfect Valley would have their handicap stay the same or increase when traveling to Panther Mountain.[4]   
Even if negative scoring differentials were eliminated, however, the peculiar result of the example would still exist.  It is a mistake made in the development of the Handicap Reduction Table that leads to the much harsher treatment of the player at the course with the low Slope Rating.  We turn to this next.

 Handicap Reduction Table – An abbreviated Handicap Reduction Table is shown below:

Handicap Reduction Table (Abbr.)

Avg. of 2 Lowest T-Score Differentials Below Index
Number of Eligible Tournament Scores
2
3
4
5-9
10-19
4.0-4.4
1.0




4.5-4.9
1.8
1.0



5.0-5.4
2.6
1.9
1.0


5.5-5.9
3.4
2.7
1.9
1.0

6.0-6.4
4.1
3.5
2.8
1.9
1.0
6.5-6.9
4.8
4.3
3.7
2.9
2.0

The table shows the higher the tournament differential (Index - Average of 2 lowest tournament differentials), the greater the possible reduction in index.  The problem is there is no research indicating the reduction should be a function of the tournament differential.  The basic research was done by F.P. Engel who used Bogevold’s data in 1983 to determine the likelihood of a player recording a low negative differential defined as net score minus the course rating.[5]  Dean Knuth, former Senior Director of Handicapping at the USGA, developed a probability table for a player’s two best scores to beat his handicap.[6]   Even though Knuth is credited with inventing the Slope Handicap System, he used strokes below course rating and not index differentials in his analysis.  In a recent interview with the Wall Street Journal,[7]  Knuth said “the odds of a mid-range player shooting eight strokes better than his handicap are 1 in 1,138.”[8]  In other words, the handicap research done under Knuth--which practically speaking is all of the research done by the USGA--viewed exceptional scores as strokes below the Course Rating.  Knuth’s work estimates the probability of being 5-under the course rating is independent of the Slope Rating.  This makes intuitive sense as well.  A player’s score and handicaps are not affected by the Slope Rating if a player only plays at home.   If scores are normally distributed with a constant standard of deviation, a player has an equal chance of scoring n-strokes under the course rating whether the Slope Rating is 87 of 150. 

So why did the USGA change “Strokes Under Course Rating”  to “Index - Average Tournament Differential ” as the measure of exceptional performance?   The two culprits were probably sloth and ignorance.  Sloth kept the USGA from doing any new research on the problem.  When the current Appendix E, Exceptional Tournament Score Probability Table, of the Handicap System is based on         30-year old data, it is a good indication no one in the Handicap Section of the USGA is working overtime.[9]

Ignorance probably guided someone at the USGA to make the change thinking it made little difference.  According to Appendix E, a net differential 8.0 has a 1 in 1138 chance of occurring.  A player would have a net differential of 8.0 if his net score was 10.6 strokes under the Course Rating at a course with a Slope Rating of 150 or if his net score was 6.2 strokes under the Course Rating at a course with a Slope Rating of 87. To believe those two events are equally likely, one has to suspend all judgment and disregard the bulk of USGA research.  Apparently, that was no problem for some USGA staffer and the Handicap Procedures Committee.

Conclusions and Recommendations – This paper has identified a flaw in the Slope Handicap System and problems with Sec. 10.3 of the Handicap System.  The flaw is not a major impediment to equity since:

1.       The flaw primarily affects players with plus indices who constitute a very small minority of all golfers,

2.       Plus indices are typically not concerned about their handicap in inter-club net scoring events,

3.       The flaw does not affect intra-club events where players’ handicaps are based primarily on scores from their home course.

Moreover, to correct the flaw would be very difficult, and only confuse the golfing community that is already sufficiently addled by the present Slope Handicap System.

 It is recommended, however, that the USGA 1) update the research on exceptional performance, and 2) re-examine Sec. 10-3 for efficacy and effectiveness. Both tasks need to be completed to ensure an equitable handicap system.


Updating Research on Exceptional Performance - Both Appendix E and the Handicap Reduction Table appear to be based on data and analysis that are 30 to 40-years old.  Due to limits in computing power back then, the sample size was probably small.  With the advent of GHIN and modern computers, research no longer has such restraints.  It would not be a difficult task, for example, to find the percentage of golfers who have a score of 7-under the course rating in their last 20 scores.  This empirical finding could be used to revise the probabilities presented in Appendix E.

Re-Examine sec. 10.3 - As discussed above, equivalent performances (i.e., n-strokes under the course rating) are treated differently depending on the Slope Rating.   It is doubtful the USGA can demonstrate Sec. 10-3 as presently constituted is equitable.  Armed with new results on exceptional performance, the USGA would be in position to construct an equitable Handicap Reduction Table.  This re-examination should also review if Sec. 10-3 is serving its intended purpose (e.g., Is the lack of uniformity in the application of Section 10-3 affecting the equity of competition?  Is the present method of measuring tournament performance equitable?)[10]

Research on golf performance has undergone resurgence recently.  Pope and Schweitzer have analyzed success rates when players are putting for par and birdie.[11]  Minton has explored the effect of randomness in golf and the mathematical strategies behind the sport.[12]  Wells and Skowronski examined the evidence on whether players choke under pressure.[13]  What all of these studies have in common is that they were performed with data made available by the PGA Tour.  There is no similar set of studies dealing with equity in amateur golf or using data from the USGA.

The dearth of research on handicapping is due to policies of the USGA.  The USGA has not directed much attention or resources to research in years.  The present policy of restricting public access to its research has also not served the USGA well.  Without external peer review, the probability of mistakes similar to those made in Sec. 10-3 and Appendix E will continue to be high.  The USGA needs something equivalent to perestroika to breakdown the insular barriers between it and the research community.  If history is any judge, such an “opening” is decades off.





[1] E-mail from Scott Hovde to the author, April 16, 2012.
[2] R.C. Stroud and L.J. Riccio, Mathematical underpinnings of the slope handicap, in Science and Golf: The Proceedings of the First World Scientific Congress of Golf, Rutledge, Chapman and Hall, London, 1990, pp. 135-140.  D. Knuth, A two parameter golf course rating system, Ibid, pp. 141-146.
[3] The figure is a slight modification from that found in R.C. Stroud and L.J. Riccio, loc. cit.  Stroud and Riccio wisely did not show or discuss the effect on plus handicaps at Perfect Valley.
[4]The USGA did not believe it had a problem even when the Slope Handicap was first adopted. Dean Knuth, Senior Director of Handicapping wrote “The hurdle of negative differentials could be bypassed completely by setting the course rating at a low enough level to ensure their non-existence…The effect would be exactly the same as what we have and want now.  What really is happening is that ability differences are being magnified or contracted, as appropriate.”  (Letter from Knuth to Russ Palmer, Executive Director of the Connecticut State Golf Association, Sept. 13, 1994.)  The effect, of course, would not be the same.
[5] D.L. Knuth, F.J. Scheid, and F.P. Engel, Outlier identification procedure for the reduction in handicap, Science and Golf II: Proceedings of the World Scientific Congress of Golf, E & F Spon, London, 1994, p. 230.
[6] Ibid, p. 231.
[7] John Paul Newport, Fighting Back Against Sandbaggers, Wall Street Journal, July 2, 2011. Also see John Paul Newport, The Genius of Handicapping, Wall Street Journal, November 1, 2008 where Newport cites the odds(sic) of beating your handicap by three strokes is 1 in 20. 
[8] Kelly Neely, a member of the USGA Handicap Procedures Committee and Senior Director of Handicapping of the Oregon Golf Association wrote “Your chances of beating your handicap by 10 strokes in one round is (one in) 37,000.” See www.oga.org/index.php/handicapping. Apparently, Ms. Neely relied on an old version of Appendix E.
[9] As an another example of sloth, Appendix E formerly showed the probability of a 13-21 handicap player having a net differential of 0 or better was 1 in 6.  For every other index range, the probability was 1 in 5.  When the USGA was alerted to discrepancy, it changed this probability to 1 in 5 for all players in the 2012 Handicap Manual.  No new research was done.  Someone just replaced a 6 with a 5—problem solved.  Equally disturbing, the 2012 Handicap System Manual contains typographical and editorial errors in Appendix E.  When these were brought to the attention of the USGA, Mr. Hovde blamed the errors on the printer. E-mail to author, February 9, 2012.
[10] Under the old Section 10-3(1994), the penalty for exceptional performance was a function of how well you played in tournaments.  Under the current version of Section 10-3, the penalty is a function of how well you played relative to your current index.  This leads to some peculiar and perhaps inequitable results.  See Dougharty, Laurence, Reduction in Index for Exceptional Tournament Performance: Some Conceptual Problems, Measuring Golf Performance, Golf Economics, Manhattan Beach, CA, 2005.
[11] Pope, Devin and Schweitzer, Maurice, Is Tiger Woods Loss Averse? Persistent Bias in the Face of Experience, Competition, and High Stakes, American Economic Review, 101 (February 2011), pp. 129-157.
[12] Minton, Roland, Golf by the Numbers, The Johns Hopkins University Press, Baltimore, MD, forthcoming June, 2012.
[13] Brett Wells & John Skowronski, Evidence of Choking Under Pressure on the PGA Tour, Basic and Applied Social Psychology, March/April 2012, Pages 175-182.










[