Category: Contributor’s corner
Experts vs Data: on the science of predicting SuperRugby performances
With SuperRugby beginning again this weekend, we’ve managed to get a true scientist, Dr Ian Durbach, to comment on the ability to predict outcomes. Ian holds joint positions as adjunct senior lecturer in the Department of Statistical Sciences at the University of Cape Town and a researcher at the African Institute for Mathematical Sciences. His research interests are human judgment and decision making, particularly the way we reason when our choices involve risk or uncertainty. Quite simply, he’s a really clever guy.
When we asked Ian if we could apply science to predicting game outcomes so that we could be consistently correct as rugby experts such as Nick Mallett, he came up with a plan. Ian explains in his own words:
Picture from supersport.com “Dont miss out, warns Mallett”
The model we’re using is cobbled together from a variety of sources, and uses a few relationships we’ve been able to establish by looking at past performance and past predictions.
First, we looked at past 4 years of Super 15 rugby and worked out how many points each team won or lost by, on average over all the games they’ve played. The Crusaders come top – they have an average margin of +9, meaning they win by an average of 9 points. The table below shows the ranking, along with the average log points – you can see there’s a good but not perfect relationship between point margins and log points.
In our model, we’ve chosen to weight recent years more heavily, which also has the effect of sucking the values of all our predictions towards 0. Those values are in the third column of the table. This is actually a desirable feature to have whenever we know that the past is not a perfect predictor of the future – we’ll spare you the details!
Average points differences can be used to come up with a quick and dirty prediction. Take this weekend’s game between the Crusaders and the Rebels. We know the Crusaders win by 6 points on average. When they play the bottom teams they’ll tend to win by more, and when they play other top teams they’ll tend to win by less. The Rebels lose by 8 points on average. When they play a top team like the Crusaders, they’ll tend to lose by more than this. You can get a crude prediction by subtracting the two points differences from one another: the Crusaders are predicted to win by 6–(–8) = 14 points. That’s a start.
Next, we found that over a number of years, playing at home is “worth” about 4 points. That is, if you knew nothing at all about an upcoming game, you should predict the home team to win by 4 points. We know the Crusaders are playing at home, so we up the prediction in their favour, by 4 points. They’re now predicted to win by 18.
This is a data-driven prediction. But we know that rugby pundits are pretty good at predicting games. We’ve looked at some past predictions made by 80 000 users of the Superbru game. The players predicted the outcome of 73% of Super 15 games correctly, and were on average 10 points from the actual outcome of the game. Not bad! We found the following Superbru predictions for the upcoming week, which we’ve contrasted with the predictions from our data-driven approach. On the whole its amazing how similar the predictions are. We predict different outcomes for the Lions-Hurricanes and Blues-Chiefs games, but both sets of predictions are for the games to be close.
An obvious weakness of the data-driven approach is that it ignores a whole bunch of relevant current information – off-season transfers, injuries, form, and so on. Some of this we’ll work on building into later predictions, but for now we can assume that Superbru users are clued up on current rugby events, and use their predictions as proxies for that information. So we’ll make an additional prediction, which is a combination of our naïve data-driven model and the Superbru predictions.
Before we do that, an interesting fact is that Superbru users tend, on average, to slightly underestimate the effect of playing at home. They think it is worth around 2 points, while we know that it is actually worth about 4 points. So, if we know Superbru users think about a game, we should adjust their predictions by 2 points in favour of the home team before combining them. For now we’ll combine them in the simplest possible way, but taking the average of the two.
That’s all we’re going to do for now. Once we start getting some information in on how the teams are performing, we’ll use this information to adjust our model further. Let’s see how we do!
Mallet seems to think Chiefs will win when he referred to the team being “good again”. Who do you think will be proved correct? The experts (rugby and Superbru/couch) or the scientists? We’d like to know your thoughts before the Blues vs Chiefs match kicks off. Tell us in the poll or feel free to comment!
The concussion puzzle: is there a risk profile for sport-related concussion?
Figure 1: A proposed model summary of the systematic review of literature and adapted from Meeuwisse’s athletic injury aetiology model [7].
From all previous risk factors identified for sports concussion, only a previous concussion(s) and playing a match compared to practice has strong scientific evidence.
Concussion is caused by a force transmitted to the head resulting in symptoms ranging from a severe headache to loss of consciousness and is one of the more severe sports injuries with professional club rugby players missing up on average 12 days during two seasons [1,2]. A reported compensation pay-out of over $700 million by the American National Football League (NFL) to over 4500 former NFL players or their relatives for severe and debilitating complications, they claim resulted from concussions sustained whilst playing NFL [3,4]. This widely publicised court case has raised concern over concussion injuries not only in athletes and their families across sports [5], but also sporting organisations such as the International Rugby Board (IRB), which has implemented a controversial side-line concussion test for suspected concussions [6].
However, sport related concussion still remains a hotly debated injury mainly due to the lack of understanding of the aetiology and the individual variations in symptom presentation, which makes diagnosing and managing concussions challenging. In light of this, our research team undertook a comprehensive systematic review of the scientific literature on concussion risks that was recently published online (http://bjsm.bmj.com/cgi/content/full/bjsports-2013-092734). After a critical search and evaluation of over 13 000 articles, we identified 86 scientific research articles investigating possible risks for concussion in sport with the main findings summarised below:
- Athletes who have experienced a previous concussion(s) and playing a match compared to practice were the only concussion risks supported by strong scientific evidence.
- Although experts often state children and women are vulnerable groups[8], gender and age were amongst several potential risk factors for concussion which require further robust studies to confirm risk effect.
Although there is an abundance of papers on concussion in the scientific literature, there is still a need for robust research, preferably follow-up studies with sufficient sample sizes, to confirm concussion risks.
We suggest that there are inter-individual differences in the aetiology and manifestation of concussion and as such we are conducting a research study to investigate the genetic and non-genetic role underlying concussion risk and recovery. The future goal of this study is to further understand concussion in order to provide a model for individual diagnosis and therapy strategies improving concussion management especially in vulnerable groups such as youth players. To this end, we are in the process of inviting the top rugby-playing schools in South Africa and thus far extend our gratitude to Wynberg Boys’, Paarl Boys’, Paarl Gimnasium, SACS and Boland Landbou high schools who have eagerly accepted our invite to participate in our research study. We are equally excited to embark on this venture with them, as well as other top rugby playing high schools, to investigate why the incidence of concussion is so high our youth rugby players.
References:
- McCrory P, Meeuwisse WH, Aubry M, et al. Consensus statement on concussion in sport: the 4th International Conference on Concussion in Sport held in Zurich, November 2012. Br J Sport Med 2013;47:250–8
- Brooks JHM, Fuller CW, Kemp SPT, et al. Epidemiology of injuries in English professional rugby union: part 1 match injuries. Br J Sport Med 2005;39:757–66.
- Boren C: NFL, ex-players reach settlement over concussion lawsuits. The Washington Post online, August 29, 2013. Available at http://www.washingtonpost.com/blogs/early-lead/wp/2013/08/29/nfl-former-players-to-settle-concussion-lawsuits-judge-says/ (accessed on 25 September 2013)
- Crepeau R: The NFL Concussion Settlement. The Huffington Post blog online, September 04, 2013. Available at http://www.huffingtonpost.com/richard-crepeau/nfl-concussion-settlement_1_b_3853120.html (accessed on 27 September 2013)
- Peters S: Moody: We used to treat concussion as a joke… now I worry about dementia. The Daily Mail online, September 22, 2013. Available at: http://www.dailymail.co.uk/sport/rugbyunion/article-2428431/Lewis-Moody-We-used-treat-concussion-joke–I-worry-dementia.html (Accessed on 29 September 2013)
- Guyer J: IRB to review sideline concussion test. The Wide World of Sports online, July 18, 2013. Available at http://wwos.ninemsn.com.au/article.aspx?id=8691586 (accessed 20 September 2013)
- Meeuwisse W. Assessing causation in sport injury: A multifactorial model. Clin J Sport Med. 1994;4:66–170
- Kutcher JS, Eckner JT. At-risk populations in sports-related concussion. Current sports medicine reports 2010;9:16–20
About the Authors:
Shameemah Abrahams majored in Biochemistry and Physiology for her undergraduate BSc (2008 – 2010) with honours in Physiology, specialising in Neuroscience, (2011) at the University of Cape Town (UCT). She is currently (2012-) in her second year as a MSc (Med) student at the UCT/MRC Exercise Science and Sports Medicine research unit, UCT. Her MSc project deals with both the identification of genetic and non-genetic predisposing factors of concussion risk in South African rugby players. Her research interests include brain injury, physiological changes during exercise and genetic predisposition to injury.
Sarah Mc Fie completed a BSc in Chemical, Molecular and Cell Biology, majoring in Genetics and Human Biology, in 2010 and an Honours specializing in Neuroscience in 2011 from the University of Cape Town. She started her current degree, an MSc in Exercise Science, at the Exercise Science and Sports Medicine research unit, UCT, in 2012. Her MSc research project aims to identify intrinsic and extrinsic risk factors for risk and severity of sport-related concussions. Her research interests include genetics, neuroscience and sport.
“You can’t manage what you don’t measure.” Monitoring training load and recovery in team sports
by Ben Capostagno and Wayne Lombard
In a recent editorial for the International Journal of Sports Physiology and Performance, Iñigo Mujika highlighted the importance of quantifying training load.(3) If an athlete shows positive adaptation to training, it is important for the strength and conditioning coach to know the exact training load the athlete was exposed to. Likewise if the athlete shows a maladaptation to training, accurately collected training load data will indicate whether the training load was excessive or insufficient. One of the simplest ways to quantify training load is to multiply the duration of the session in minutes by a rating of perceived exertion for the session. For example, if a training session lasts 60 minutes and the athlete rates the session as 5 out of 10 for intensity, the training load should be 300 units.
Once the training load has been accurately quantified it is crucial to monitor how the athletes are responding to the imposed load. Daily monitoring has become more popular within sports science as athletes are constantly exposed to ever increasing training loads. The daily monitoring commonly takes the form of questionnaires and should include a subjective rating of fatigue. In addition, Kenta and Hassmen (2) identified four key areas of recovery that should also be monitored;
- nutrition and hydration
- sleep and rest
- relaxation and emotional support
- stretching and active rest
If the athlete is actively engaging in these four areas of recovery, but still reporting high levels of fatigue, then the planned training load should be adjusted accordingly.
It is important to partner the subjective measures of recovery with an objective measure. The most common target of objective measures is the autonomic nervous system. The autonomic nervous system is connected to a wide variety of systems within the human body and thus makes it a suitable target to monitor the overall well-being of the athlete.(1) Non-invasive measures of the autonomic system’s status include heart rate variability (HRV) and heart rate recovery (HRR). HRV appears to be gaining momentum as the objective measure of choice within teams and individual athletes. However, there is currently no clear consensus on the measurement and interpretation of HRR and HRV and therefore should be used with caution.
In conclusion there are simple, validated measures of both training load and the athlete’s responses to these training loads. Coaches and strength and conditioning experts are encouraged to use these or similar methods in order to manage their players during a competitive season.
Reference
1. Borresen J and Lambert MI. Autonomic Control of Heart Rate during and after Exercise : Measurements and Implications for Monitoring Training Status. Sports Medicine 38: 633-646, 2008.
2. Kentta G and Hassmen P. Overtraining and recovery. A conceptual model. Sports Medicine 26: 1-16, 1998.
3. Mujika, I. The Alphabet of Sport Science Research Starts With Q. International Journal of Sports Physiology and Performance 8: 465-466, 2013.
About the Authors
Benoit Capostagno completed his BSc degree (cum laude) specialising in the Sport Sciences at the University of Stellenbosch in 2006. He continued his studies at the University of Cape Town’s Research Unit for Exercise Science and Sports Medicine completing his honours with a first class pass in 2007. He is continuing his postgraduate work with his PhD at this same unit and is investigating training adaptation and fatigue in cyclists. He has been a consultant with the Sports Science Institute of South Africa’s High Performance Centre’s Cycling Division since 2009. In addition, Ben has also assisted the Springbok Sevens Rugby team with monitoring the training status and levels of fatigue in their players since the 2008/2009 IRB World Sevens Series. Follow Ben on twitter @BCapostagno
Wayne Lombard completed his undergraduate and honors degrees at the University of Kwa-Zulu Natal (Durban). He then joined the Sports Science Institute of South Africa as a Biokineticist and Performance enhancement specialist at the High Performance Centre. He then went on to complete is Master’s degree and is currently registered for a PhD in exercises science at the University of Cape Town, focusing on athlete monitoring of training loads, recovery and fatigue. Wayne has worked with various of South Africa’s top athletes in all sporting codes, including some of South Africa’s Paralympic and Olympic athletes. Follow Wayne on twitter @waynelombard. You can also visit the Sport Science Institute of South Africa Website at http://www.ssisa.com/pages/high-performance/-high-performance-services.




