Wednesday, January 8, 2014

Is Your Course Overrated?



Introduction
            Errors in estimating the course and slope rating can lessen the equity of competition between players from different clubs.  Players will have either more or less handicap strokes than they deserve because of these errors.  The complexity of estimating these ratings, however, makes it difficult for the player to assess their accuracy. 
            This paper presents two simple methods a player can use to assess the accuracy (reasonableness might be a better word) of golf course ratings.  The methods are based only on knowing the course yardage, course rating, and slope rating of the courses under consideration.
            The first method calculates the Obstacle Stroke Values (the subjective judgment on the difficulty presented by obstacles such as rough and water hazards) for courses.  The player can then use his own judgment on whether the relative size of these values is consistent with his own playing experience. 
            Second, courses are ranked by their Obstacle Stroke Values for women and compared with a similar ranking for the men.  In Southern California these rankings are done by different organizations, and can serve as a rough check against each other.  The rankings should be similar though the placement of tees (e.g., women's tees are placed in front of potential hazards) could explain any disparity.  Major differences in rankings, however, may be evidence of an error in the ratings (men's or women's).
            While neither of these methods can definitively pinpoint errors, taken together they can provide evidence on whether a course is over or underrated.
Obstacle Values
            Course and Bogey Ratings consist of two components.  The first component measures the effect of course yardage on the ratings.  The second component measures difficulty factors such as rough, topography, water hazards, out-of-bounds, etc.  This second component is called the Obstacle Stroke Value and represents the increase or decrease in course rating due to difficulty factors.
            Estimating these Obstacle Stroke Values is a subjective process. A final step in establishing a course rating is to make sure that the proposed rating for a course is consistent with other courses.  For example, the Ratings Committee will check the proposed rating against courses which are similar in nature.  A discrepancy in the comparisons is then a call for further review.
            One way to check on your course rating, then, is to see if the Obstacle Stroke Values are consistent with other courses you play.  Let’s look at the women’s ratings at a number of courses in Southern California as an example.  The Obstacle Stroke Values for these courses were calculated,[1] and are shown in Table 1.[2]
            Using Table 1, a player can judge whether the estimates of Obstacle Stroke Values correspond with her own playing experience.  For example, does she believe that obstacle factors should make SeaCliff play 1.1 strokes higher than Mesa Verde for the scratch player?  Does she believe Table 1 expresses the correct rank order of obstacle difficulty from SeaCliff being the toughest to Dove Canyon being the easiest?  Obviously opinions will vary, but if a consensus differs from the ranking presented in Table 1 there may be cause for reexamining some ratings.

Table 1
Obstacle Values for Women's Rating



Course
Scratch Obstacle Value
Bogey Obstacle Value
SeaCliff
1.9
4.2
Coto de Caza
1.7
6.7
Mission Viejo
1.4
4.1
Santa Ana
1.0
3.0
Big Canyon
1.0
2.8
Mesa Verde
0.8
3.6
Newport Beach
0.7
2.2
Old Ranch
0.7
3.3
El Niguel
0.6
1.6
Dove Canyon
-0.8
0.8

            Another approach is to use Table 1 to look for anomalies.  Coto de Caza, for example, has an unusually large Bogey Obstacle Value (6.7 strokes).  What is more unusual is that the Obstacle Value for women from the White Tees (700 yards longer) is lower (5.9 strokes) than from the Red Tees.  Typically, obstacle values go up with yardage at the same course because approaches to greens require longer clubs, and carries over hazards are more difficult.  In any event, this methodology red flags Coto de Caza for further examination.
Comparison with Men’s Obstacle Values
            A course that is difficult for women is usually difficult for men.  Therefore, the rank order of the Obstacle Values should be similar for men and women.  This is not necessarily true.  A course could be made relatively easy for women by placing their tees in front of hazards that the men have to carry.  Differences in rank order, however, should pinpoint areas for more investigation.  Table 2 presents the ranking of courses by Obstacle Stroke Values for both women and men.
            The women's and men's rankings are similar with two exceptions.  SeaCliff is ranked high in Obstacle Stroke Value for women, but is near the bottom for men.  This can be partly explained by SeaCliff being a relatively short course for men and a course of medium length for women. -- remember that Obstacle Values are usually higher the longer the course.  The other exception is El Niguel which is ranked low in Obstacle Values for women, but high for men.
            The Table cannot prove that the ratings at SeaCliff and El Niguel are in error.  The comparisons in Table 2 can only raise questions.  Why, for example, is the women’s Course Rating relatively low at El Niguel when it is 200 yards longer than SeaCliff?  Are the Obstacle Stroke Values at El Niguel really that minimal?

Table 2
Ranking of Courses by Obstacle Values


Scratch Obstacle Value Ranking
Bogey Obstacle Value Ranking
Course
Women
Men
Women
Men
SeaCliff
1
8
2
8
Coto de Caza
2
1
1
1
Mission Viejo
3
5
3
5
Santa Ana
4
7
6
7
Big Canyon
5
3
7
4
Mesa Verde
6
2
4
2
Old Ranch
8
9
5
9
Newport Beach
8
10
8
10
El Niguel
9
4
9
3
Dove Canyon
10
6
10
6

What Difference Do Errors Make?
            Errors in estimating Obstacle Stroke Values only have an effect when players from different clubs are competing.  Take for example, a player from SeaCliff and Mesa Verde.  Assume that SeaCliff is overrated, and that it should have the same Scratch and Bogey Obstacle Stroke Values as Mesa Verde.  Table 3 shows the change in index and home course handicap for a SeaCliff Player under this assumption.
The Table indicates the SeaCliff player would gain 1-stroke on her home handicap if the Mesa Verde values were used.  Since her index also rises, she would also gain strokes depending on the Slope Rating of the course when playing away.  The impact of a one-stroke swing on any individual player may not be great.  The cumulative impact in competitions such as team play, however, could be decisive.
Table 3
Differences in Index and Home Course Handicap

Using Current SeaCliff Obstacle Values
Using Mesa Verde Obstacle Values
Index
Home Handicap
Index
Home Handicap
0.0
0
.9
1
5.0
5
5.8
6
10.0
11
10.7
12
15.0
16
15.7
17
20.0
22
20.6
23
25.0
27
25.5
28
30.0
33
30.4
34


There is nothing to prove, however, that an error has been made.  This paper is only intended to document a methodology for highlighting possible errors, and stressing the impact on the equity of competition that such errors can have.


APPENDIX

Course Rating Information


WOMEN'S RATING




Course


Yardage

Slope
Rating

Course Rating
Scratch
Obstacle Value
Bogey
Obstacle Value

Mesa Verde
5486
124
71.4
0.8
3.6

SeaCliff
5587
123
73.0
1.9
4.2

Big Canyon
5788
123
73.3
1.0
2.8

Old Ranch
5877
128
73.4
0.7
3.3

Mission Viejo
5698
126
73.2
1.4
4.1

Santa Ana
5866
125
73.7
1.0
3.0

Newport Beach
5790
122
73.0
0.7
2.2

Dove Canyon
5472
117
69.7
-0.8
0.8

El Niguel
5787
120
72.8
0.6
1.6

Coto De Caza
5369
132
71.6
1.7
6.7









MEN'S RATING




Course


Yardage

Slope
Rating

Course Rating
Scratch Obstacle Value
Bogey Obstacle Value

Mesa Verde
6285
129
70.7
1.2
4.7

SeaCliff
6060
115
68.7
0.3
1.5

Big Canyon
6362
123
70.9
1.0
3.2

Old Ranch
6201
114
69.4
0.3
1.1

Mission Viejo
6464
124
71.1
0.8
3.0

Santa Ana
6213
120
69.6
0.5
2.4

Newport Beach
6232
112
68.9
-0.3
0.0

Dove Canyon
6034
121
68.8
0.5
2.9

El Niguel
6483
125
71.2
0.8
3.2

Coto De Caza
6082
127
69.9
1.4
4.8






[1]Obstacle Stroke Values can be calculated from the formulas used in estimating the ratings for women:

            Course Rating = Effective Yardage/180 + 40.1 + Scratch Obstacle Stroke Value
            Bogey Rating  = Effective Yardage/120 + 51.3 + Bogey Obstacle Stroke Value
Therefore,

            SOV = CR -YARD/180 - 40.1
where,
                                       SOV   = Scratch Obstacle Stroke Value
                                         CR   = Course Rating
                                    YARD   = Effective Playing Length

            BOV = SLOPE/4.24 - CR + (YARD/120 + 51.3)
where,
                                       BOV   = Bogey Obstacle Stroke Value
                                   SLOPE   = Slope Rating

Obstacle Stroke Values for men are found by using the course rating formulas for men.
[2]Course yardage was used for "effective" length.  The calculation of obstacle values will be in error where course yardage and effective length vary significantly.  Ratings and yardages for each course are presented in the appendix.

Thursday, December 19, 2013

A Sandbagger's Guide to Winning



It takes a great deal of effort to manipulate a handicap.  A player has to generate artificially high scores in rounds that are not in competition. This post examines a sandbagger’s winning percentage as a function of how “many strokes he has in the bag” – i.e., the difference between his manipulated handicap and his true handicap.
Let’s assume Tom and Sam play golf together.  The winner of a match is the player with the lower net score.  Sam has worked his handicap so that his average net score is 1-stroke less than Tom’s.  This does not mean Sam wins every time.  The random nature of scoring lets Tom win when he has an exceptionally good round, or Sam has a bad round.  The probability that Sam wins will depend on the standard deviation of scoring for each player.  For simplicity, it is assumed that each player has a standard deviation of three strokes (i.e., 68 percent of all scores will be between ±3 strokes of the player’s average score).  The probability that Sam wins a match is presented in Table below for various levels of sandbagging.  (Note: The methodology for calculating the probabilities is shown in the Appendix).
Table
Probability That Sam Wins the Match

Sam’s’ Average Net Score Advantage
Probability Sam Wins the Match
-1
.59
-2
.68
-3
.76
-4
.82

The best long-term strategy for the sandbagger would be to have only a 1-stroke advantage.  He wins, on average, six out of ten matches.  Tom may not realize he is at a disadvantage since having four wins and six loses is not unreasonable record.  For just a little handicap manipulation (1-stroke), Sam gets an annuity as long as Tom does not figure out the game is rigged.
Tom, however, is not a complete idiot and realizes if his net score was 1-stroke lower he would do better.  He can do this by a) decreasing his average gross score in competition by 1-stroke while maintaining his current handicap, or b) artificially increasing his handicap by 1-stroke while maintaining his average gross score in competition.  Option b) is the easier of the two and the one most often chosen.   In essence, sandbaggers beget sandbaggers.
Sadly, many players do not look at their USGA Handicap as a measure of performance—How good am I?—but as weapon in their arsenal to beat their opponents.    The best evidence of this is watching players post their score.  Are players more jubilant when their trend handicap goes down or up?    

Appendix

Suppose there are two scores, X1 and X2 drawn randomly from the normal distributions N(µ1, σ12) and N(µ2, σ22).  We want to find the probability that X1 < X2.
Now X1- X2 is normally distributed with mean,
                µ = u1 – u2
and variance,
                σ2 = σ12 + σ22
Hence, the variable (X1- X2 -µ)/σ is distributed normally with a mean of zero and a variance of 1 (i.e., the standard normal distribution N(0,1).
And so, the probability that X1 is less than X2, is the cumulative probability up to -µ /σ.   In our example, the standard deviation of scoring for each player is 3.  Therefore,
                 Ïƒ = (32 +32)½   = 4.24
For a 1-stroke advantage,
                µ = -1
The probability that X1 is less than X2 is
                = f(1/4.24)  = f(.24) = .59







               

Wednesday, December 4, 2013

The USGA's War on Sandbagging, Part VI: The War Ends in a Wimper


(The United States Golf Association (USGA) has made various attempts to control players who manipulate their handicaps in order to do well in tournaments.  The name for such manipulation is “sandbagging.” If the USGA’s effort can be characterized as a war, then it is not winning.  A series of five posts examines the history and effectiveness of the USGA’s war plan.  Part I details the flaws of the USGA’s earliest attempt at controlling sandbagging.  Part II examines a proposed policy that increased the penalties for alleged sandbagging. Part III argues the current handicap system may actually encourage sandbagging.  Part IV explains why the USGA could be losing the effort to win the hearts and minds of local golfers.  Part V examines the flaws in the USGA's current war strategy. Part VI asks if the USGA's efforts are counterproductive and suggests it may be time for the USGA to withdraw from the battlefield.)

The USGA’s War on Sandbagging is over.  Section 10-3 (Reduction of Handicap Index Based on Exceptional Tournament Scores) is still part of the Handicap System, but it is merely symbolic.   Sec. 10-3 gives the appearance the USGA has an effective instrument for controlling sandbagging.  In reality, the current incarnation of Sec. 10-3 is a failure.  Here are some reasons why Sec. 10-3 is ineffective or inequitable:
1.       Tournament Formats – Many important tournaments are partner events.  They often include formats (e.g., scramble, foursome) where a score cannot be posted (i.e., Sec. 10-3 has no effect).  In four-ball formats, it is easy for the serious sandbagger to take a high score on a hole when his partner is in good position.   This eliminates being caught by the strictures of Sec. 10-3.
2.       Inequity – As discussed in Part V[1], Sec. 10-3 applies to scores and not to whether a player actually won anything.  It is possible a player can receive a reduced index, be labeled a sandbagger, yet never place high in a tournament.  This defect was addressed by Dean Knuth, the USGA director of Handicapping responsible for the implementation of Sec. 10-3.  He developed what he termed the Tournament Point System.  Under this system, a player can receive a reduced index based on where he places in tournaments, and not on his scores.[2]   While not without its own problems, the Tournament Point System does correct for this major deficiency of Sec. 10-3.
3.       Non-Uniform Application – There are no strict guidelines on what determines a Tournament Score for posting purposes.  The USGA argues a tournament score should be reserved for significant events. [3] This leads to a variety of interpretations.  At one club, a holiday two-best ball-of-four was considered a tournament score.  At another club, even the member-guest was not considered a major event.  A lack of uniformity leads to disparate results for the same scoring performance which is antithesis of what a good handicap system should be.
4.       Anomalies – Sec. 10-3 can lead to some strange results.  Assume Player A and Player B only play rounds together from the same tees.  Player B never posts a score lower that Player A.  Under Sec. 10-3, however, it is possible for Player B to have the lower Course Handicap.  This stems from measuring exceptional performance by the difference of the T-score differentials and a player’s current index, and not the player’s index at the time of the tournament.   This makes it possible for a player to receive a reduced index not for exceptional performance, but for having a higher index some time later. (For example assume a player had two T-score differentials of 10.0 that were made when he was a 12.0 index.  Months later, for a variety of legitimate reasons, his index goes to 14.0.  The player’s index would now be reduced by 1.0 under Section   10.3.)
5.       Can’t See the Forest for the Trees – By focusing on major events, the sandbagger is free to ply his trade throughout the year (and at one major event) without the possibility of receiving a reduced index.  Without an “R” index, even the biggest handicap scoundrel receives the implicit imprimatur of the USGA. [4] Handicap Committees have traditionally been loath to reduce a player’s index on its own.  Most committees are only too happy to rely on Sec. 10-3 for identifying sandbaggers.  In essence, Committees are relying on an enforcement mechanism that does not work.

The USGA knows its war on sandbagging is over.  When asked how many players receive a reduced index, the USGA replied:

“We do not have such statistics.  However, it is a very small number compared to the total number of players in the system”[5] (How the USGA knows it is a very small number without statistics is left unsaid).

The absence of statistics implies the USGA does not have any on-going evaluation of Sec. 10-3. Apparently, the USGA is not concerned about the effectiveness of Sec. 10-3 or whether it discriminates against players by club, association, sex, frequency of tournament participation or handicap level.  Sec. 10-3 will remain part the Handicap System since bureaucracies do not readily admit to their mistakes.  Rather than having the war on sandbagging end with a bang by the removal of Sec. 10-3, the war will end on a whimper.   Sec. 10-3 will simply be allowed to wither through benign neglect. 



[1] The USGA’s War on Sandbagging, Part V: Problems With the Current Strategy, www.ongolfhandicaps.com, November 14, 2013.
[2] Newport, John Paul, “Fighting Back Against Sandbaggers,” Wall Street Journal, July 2, 2011.
[3] Hovde, Scott, Posting a Score As a Tournament Score, www.USGA.Org, 12/17/2012.
[4] When a player receives a reduced index through Sec. 10.3, it is identified with an “R.”
[5] E-mail to the author from Annie Pollock, Coordinator, Handicap and Course Rating Administration, 11/21/2013