辅导ELEC273程序、讲解MATLAB编程、讲解program语言编程
- 首页 >> Java编程 Experiment 22 - Monte Carlo Simulation
Department of Electrical Engineering & Electronics
September 2019, Ver. 3.4
Experiment specifications
Module(s) ELEC224 / ELEC273
Experiment code 22
Semester 1
Level 2
Lab location PC labs, third floor/fourth floor, check the timetable
Work In groups
Timetabled time 7 hrs
Subject(s) of relevance Probability and Statistics
Assessment method Formal report. One lab report per person following the guidelines set out in
the “How to write a good lab report” handout (available in VITAL).
Submission deadline On Friday midnight, 7 days after the date of the laboratory, submitted in
Microsoft Word or PDF format via VITAL only.
Important: Marking of all coursework is anonymous. Do not include
your name, student ID number, group number, email or any other personal
information in your report or in the name of the file submitted via VITAL.
A penalty will be applied to submissions that do not meet this requirement.
1
Instructions:
• Read this script carefully before attempting the experiment.
• Review MATLAB before attempting the experiment and use it for all the
required coding and graphs. Check VITAL for MATLAB resources (Learning
Resources→Supporting Material folder). See online material and resources as
well.
• Keep a record of all code, graphs and results.
• The code must be well-structured and organised (to get a better mark). Use
the concept of functions for better code re-usability and managment.
• The code must be provided for every requirement with appropriate explanation.
Use MATLAB commenting (%) to emphasise on and explain relevant
code lines.
• For every requirement, the code must run and screenshots of the results must
be provided.
• Any change to the code needs to be reinserted every time.
• Be sure to reference any resource you have used in writing your report.
• Use your time wisely. Finish as many tasks as you can during the lab (with
demonstrators support). If you can’t finish all tasks today, you can complete
your work at home later on.
• If you have any feedback on your laboratory experience today, please write it
down on the last page of this script.
1 Learning outcomes
The purpose of this experiment is to develop, explore and test Monte Carlo techniques in
simulating and finding solutions to real-life random processes. MATLAB will be used as the
tool to do the tests of the experiment, but it is not the main learning outcome (i.e. the
experiment is not about MATLAB).
2 Introduction
The Monte Carlo method is a numerical method of solving mathematical problems by the simulation
of random variables. The name Monte Carlo was applied to a class of mathematical
methods first by scientists working on the development of nuclear weapons in Los Alamos in
the 1940s. The essence of the method is the invention of games of chance whose behaviour and
outcome can be used to study some interesting phenomena. While there is no essential link to
computers, the effectiveness of numerical or simulated gambling as a serious scientific pursuit
is enormously enhanced by the availability of modern digital computers [1].
The term “Monte Carlo” refers to procedures in which quantities of interest are approximated
by generating many random realisations of a stochastic process and averaging them in some
way. In statistics, the quantities of interest are the distributions of estimators and test statistics,
the size of a test statistic under the null hypothesis, or the power of a test statistic under
some specified alternative hypothesis [2].
2
How can we use Monte Carlo techniques to find the sampling distribution of an estimator? In
the real world, we usually observe just one sample of a certain size N, which will give us just
one estimate. The Monte Carlo experiment is a lab situation, where we replicate the real world
study many (R) times. Every time, we draw a different sample of size N from the original
population. Thus, we can calculate the estimate many times and any estimate will be a bit
different. The empirical distribution of these many estimates approximates the true of the
estimator. A Monte Carlo experiment involves the following steps [3]:
(1) Draw a (pseudo) random sample of size N for the stochastic elements of the stochastic
model from their respective probability distribution functions.
(2) Assume values for the parts of the model or draw them from their respective distribution
function.
(3) Calculate the parts of the statistical model.
(4) Calculate the value (e.g. the estimate) you are interested in.
(5) Replicate step (1) to (4) R times.
(6) Examine the empirical distribution of the R values.
The Monte Carlo approach is relevant to different scientific disciplines and problems including
(but not limited to) the following areas [4]:
• Physical sciences: computational physics, physical chemistry, quantum chromodynamics,
statistical physics, molecular modelling, particle physics and galaxy modelling.
• Designs and visuals/Computer graphics: global illumination, photorealistic images
of virtual 3D models, video games architecture and design, computer generated films and
special effects in cinema.
• Finance and business/Operations research: evaluating investments in projects at a
business unit, evaluating financial derivatives, construction of stochastic or probabilistic
financial models and in enhancing the treatment of uncertainty in the calculation.
• Telecommunications: planning a wireless network, generating user patterns and their
states, testing the probability of losing information in a network whether it is below a
certain threshold.
• Games: game playing related artificial intelligence theory.
3 The Practical Work
Penalty kicks are a critical time of decision-making for both the goalkeeper and the penalty
taker in football matches. Given that, for most professional games, the average number of goals
scored is around 2.5, a penalty kick can have a major influence on the outcome of a match.
Penalty kicks may reach speeds near 125 mph and is usually over within a quarter of a second.
Thus, the goalkeeper must make a decision on how to stop the shot before the ball is struck.
Statistics show that goalkeepers will most often jump to the left or right, hoping to guess correctly
the position to block the kick [5,6].
Consider the situation of a football goal and a blindfolded person trying to shoot the ball from
the penalty spot and score a goal. Let’s assume that the goal has dimensions L and W as
shown in Figure 2, and there is an imaginary circle that circumscribes the goal. Two cases will
be considered: first when there is no goalkeeper and second when there is a goalkeeper saving
the ball.
3
Figure 2: The goal arrangement.
3.1 Part I: No Goalkeeper Tests (40 Marks)
In this case, there is no goalkeeper, and it is just the penalty taker against the goal. You need
to model each shot by treating the co-ordinates of the ball in the goal plane as random variables
(i.e. ignore the trajectory of the ball).
• Task-1. If a large number of shots is attempted, derive a numerical value for the fraction of
balls entering the goal to the total number of balls in the circular area. Assume the penalty
taker is blindfolded (i.e. the shots are uniformly distributed within the circle). [5 Marks]
• Task-2. Design and write a computer programme to find the probability of scoring by
simulating N random penalty shots and repeating this experiment R times and taking the
mean of the attempts. Let N and R be inputs to your code. Use a uniform random
number generator in the simulation. [8 Marks]
• Task-3. Produce an appropriate scatter plot illustrating your experiment for N = 1,000
and R = 1, using red crosses to indicate score (i.e. balls on target) and blue circles to
indicate miss (i.e. balls off target). Insert an appropriate legend. [4 Marks]
• Task-4. For R = 5, find the probability of scoring for N = 100, N = 1,000, N = 10,000
and N = 100,000. Plot the probability against the value of N. Comment on the shape of
the plot, making reference to the theoretical probability calculated in Task-1. Remember
to label the axes and to insert an appropriate caption in your report. [7 Marks]
• Task-5. For N = 1,000, find the probability of scoring for R = 5 times, R = 10 times,
R = 15 times and R = 20 times. Plot this probability against the value of R. Comment
on the shape of the plot. [4 Marks]
• Task-6. Compare with appropriate explanation the two cases of Task-4 and Task-5 based
on the obtained probability plots. [4 Marks]
• Task-7. Repeat Task-2 to Task-6 using a normal (Gaussian) random number generator.
Assume the distribution to be centred at the centre of the circle and with standard
deviation equal to the radius. Comment (with appropriate explanation) on the differences
between the results of the two cases. [8 Marks]
4
3.2 Part II: With Goalkeeper Tests (30 Marks)
Consider now the above case but with a goalkeeper. The goalkeeper can assume one of five
possible actions (see Figure 3): stays in the middle, jumps to the upper left corner, jumps to
the upper right corner, jumps to the lower left corner or jumps to the lower right corner. A
ball is saved if the goalkeeper guesses the correct ball position. The goal area can be divided
into five corresponding regions as shown in the figure.
Figure 3: Five possibilities of a goalkeeper action to a penalty shoot-out.
• Task-8. Assuming that the goalkeeper action is modelled as a uniform random process,
what is the probability of scoring a goal if the penalty taker kicks 100 balls with uniform
random distribution within the circle, as before. Increase the kicks to 1000. Compare the
probability values with the case where no goalkeeper was in the goal (Task-1 and Task-3
above). [15 Marks]
• Task-9. Repeat Task-8 if the balls are kicked with a Gaussian random distribution (as in
Task-7). Compare your results with those obtained in Task-7 and Task-8. [5 Marks]
• Task-10. Given the fact that statistically 90% of the time goalkeepers tend to jump to
the lower two corners of the goal, what is the probability of scoring in this case after
randomly kicking 100 balls? 1,000 balls? (Compare both uniform and Gaussian distributions)
[10 Marks]
Note: For Tasks 8-10 you need to provide code, plots, explanations & comments as in Part I.
4 Review Questions (30 Marks)
(Include these in your Conclusions/Discussion section of your report)
Q1. In terms of what you’ve done in this experiment, comment on the advantages and disadvantages
(or drawbacks) of the Monte Carlo experiment. [5 Marks]
Q2. Discuss the ways in which the above model could be made more accurate and realistic.
[7 Marks]
Q3. With reference to Task-7 and Task-9, discuss the effect of changing the standard deviation
of the Guassian distribution on both the accuracy and precision of the penalty
shots. [5 Marks]
Q4. If a large number of balls are kicked on the goal (i.e. if N is sufficiently large), the value
of π can be estimated using (some function of) the ratio of the number of scores to the
total number of the shots. Hence, find the relation that estimates the value of π. Verify
this using your results for both uniform and Gaussian distributions. [8 Marks]
Q5. From your observation and results of Part II, what is the best strategy that should be
adopted by the penalty taker? What is the best strategy that should be adopted by the
goalkeeper? [5 Marks]
5
5 Report Writing and Marking Scheme
This experiment is assessed by means of a formal report. Reports that get 70% and above are
first-class reports only. Please refer to Appendix A to read about report marking descriptors.
The marking scheme for the report of this experiment is as follows:
• Results of Part I with code, plots, explanation and comments: 40 Marks
• Results of Part II with code, plots, explanation and comments: 30 Marks
• Discussions and Conclusions section (including review questions): 30 Marks
6 Plagiarism and Collusion
Plagiarism and collusion or fabrication of data is always treated seriously, and action appropriate
to the circumstances is always taken. The procedure followed by the University in
all cases where plagiarism, collusion or fabrication is suspected is detailed in the University’s
Policy for Dealing with Plagiarism, Collusion and Fabrication of Data, Code of Practice on
Assessment, Category C, available on https://www.liverpool.ac.uk/media/livacuk/tqsd/
code-of-practice-on-assessment/appendix_L_cop_assess.pdf.
Follow the following guidelines to avoid any problems:
(1) Do your work yourself.
(2) Acknowledge all your sources.
(3) Present your results as they are.
(4) Restrict access to your work.
Facts about penalty shoot-outs:
• Over 10 recent world cups’ penalty shoot-outs, 80% were scored successfully [5].
• A study for 1,000 penalty shoot-outs has shown that 74.7% of the kicks were successful,
18.2% were saved by the goalkeeper, 3.5% missed the goal and 3.6% hit the woodwork and
ended with no goal [6].
• The most successful football team in penalty shoot-outs is Germany. They lost only one
shoot-out throughout their history in recorded matches [7].
• England football team has bad penalty shoot-out record in major international matches [7].
6
References
[1] G Rubino and B Tuffin, “Rare Event Simulation using Monte Carlo Methods”, Wiley,
2009.
[2] C Lemieux, “Monte Carlo and Quasi-Monte Carlo Sampling”, Springer, 2009.
[3] M Kalos and P Whitlock, “Monte Carlo Methods”, Wiley, 2004.
[4] G Fishman, “Monte Carlo Concepts, Algorithms and Applications”, Springer, 1996.
[5] M Bar-Eli and O Azar, “Penalty kicks in soccer: an empirical analysis of shooting strategies
and goalkeepers preferences”, Soccer & Society, 2009.
[6] Just About Football, “Penalty Kick Statistics and Success rates”,
http://justaboutfootball.blogspot.com/2009/02/penalty-kick-statistics.html, 2009.
[7] J Billsberry, “Shootouts Alternatives”, http://www.penaltyshootouts.co.uk/alternatives.html,
2010.
Version history
Name Date Version
Dr M L´opez-Ben´ıtez September 2019 Ver. 3.4
Dr A Al-Ataby August 2014 Ver. 3.3
Dr A Al-Ataby October 2013 Ver. 3.2
Dr A Al-Ataby and Dr W Al-Nuaimy October 2012 Ver. 3.1
Dr A Al-Ataby and Dr W Al-Nuaimy October 2011 Ver. 3.0
Dr A Al-Ataby and Dr W Al-Nuaimy October 2010 Ver. 2.0
Dr W Al-Nuaimy October 2008 Ver. 1.0
7
19
Appendix E – Report Marking Descriptors
Mark Range Knowledge and
Understanding
Intellectual and
Practical Skills
Transferable Skills
90-99%
‘Outstanding’
Total coverage of the task set.
Exceptional demonstration of
knowledge and understanding
appropriately grounded in
theory and relevant literature.
Extremely creative and
imaginative approach.
Comprehensive and
accurate analysis. Wellargued
conclusions.
Perceptive self-assessment.
Extremely clear exposition.
Excellently structured and
logical response. Excellent
presentation, only the most
insignificant errors, suitable
for use as “model report”.
80-89%
‘Excellent’
As ‘Outstanding’ but with
some minor weaknesses or
gaps in knowledge and
understanding.
As ‘Outstanding’ but
slightly less imaginative
and with some minor gaps
in analysis and/or
conclusions.
As ‘Outstanding’ but with
some minor weaknesses in
structure, logic and/or
presentation. Quality of
reporting is very high.
70-79%
‘Very Good’
Full coverage of the task set.
Generally very good
demonstration of knowledge
and understanding but with
some modest gaps. Good
grounding in theory.
Some creative and
imaginative features. Very
good and generally
accurate analysis. Sound
conclusions. Some selfassessment.
Demonstrates
an understanding of the
broader context of the task.
Generally clear exposition.
Satisfactory structure. Very
good presentation, largely
free of grammatical and
other errors. Reporting is
professional and wellpresented.
60-69%
‘Comprehensive’
As ‘Very Good’ but with
more and/or more significant
gaps in knowledge and
understanding and some
significant gaps in grounding
As ‘Very Good’ but
analysis and conclusions
contain some minor
weaknesses, oversights
and/or inaccuracies.
As ‘Very Good’ but with
some weaknesses in
exposition and/or structure
and a few more
grammatical and other
errors.
50-59%
‘Competent’
Covers most of the task set.
Patchy knowledge and
understanding with limited
grounding in literature.
Rather limited creative and
imaginative features.
Patchy analysis containing
significant flaws. Rather
limited conclusions. No
self-assessment.
Competent exposition and
structure. Competent
presentation but some
significant presentational
and structural errors.
For example, figures may
be poorly labelled and data
tabulation may be poor.
40-49%
‘Adequate’
As ‘Competent’ but patchy
coverage of the task set and
more weaknesses and/or
omissions in knowledge and
understanding. Just meets
the threshold level.
As ‘Competent’ but
probably without much
imagination. Shows barely
adequate ability to analyse
and draw conclusions.
Just meets the threshold
level.
As ‘Competent’ but with
more weaknesses in
exposition, structure,
presentation and/or errors.
Just meets the threshold
level.
35-39%
‘Compensatable
fail’
Some parts of the set task
likely to have been omitted.
Major gaps in knowledge and
understanding. Some
significant confusion. Very
limited grounding. Falls just
short of the threshold level.
No creative or imaginative
features. Analysis and
conclusions rather limited.
Falls just short of the
threshold level.
Somewhat confused and
limited exposition.
Confused structure. Some
weaknesses in presentation
and some serious
presentational and
mathematical errors. Falls
just short of the threshold
level.
20-34%
‘Deficient’
As ‘Compensatable Fail’ but
with major omissions and/or
major gaps in knowledge and
understanding, and/or
incorrect approach towards
the experimental task Falls
substantially below the
threshold level.
As ‘Compensatable Fail’
but analysis and/or
conclusions may have been
omitted, and practical
work is substantially below
the threshold level.
Demonstrates inability to
operate or manipulate
equipment.
As ‘Compensatable Fail’
but with more serious
weaknesses in delivery of
presentation. Falls
substantially below the
threshold level.
0-20%
‘Extremely weak’
Substantial sections of the
task not covered. Knowledge
and understanding of the task
and the laboratory
environment very limited
and/or largely incorrect. No
grounding in theory.
No creative or imaginative
features. No report as suc,
just collection of notes
and/or plots. Analysis
extremely weak or
omitted. No conclusions.
Largely confused
exposition and structure.
Many serious errors in
presentation of data
Feedback:
If you have any feedback on your laboratory experience for this experiment (e.g. timing,
difficulty, clarity of script, demonstration ...etc) and suggestions to how the experiment may be
improved in the future, please write them down in the space below. This feedback is important
for future versions of this script and to enhance the laboratory process, and will not be assessed.
If you wish to provide this feedback anonymously, you may do so by detaching this page and
submitting it to the Student Support Centre (fifth floor office).
9
Department of Electrical Engineering & Electronics
September 2019, Ver. 3.4
Experiment specifications
Module(s) ELEC224 / ELEC273
Experiment code 22
Semester 1
Level 2
Lab location PC labs, third floor/fourth floor, check the timetable
Work In groups
Timetabled time 7 hrs
Subject(s) of relevance Probability and Statistics
Assessment method Formal report. One lab report per person following the guidelines set out in
the “How to write a good lab report” handout (available in VITAL).
Submission deadline On Friday midnight, 7 days after the date of the laboratory, submitted in
Microsoft Word or PDF format via VITAL only.
Important: Marking of all coursework is anonymous. Do not include
your name, student ID number, group number, email or any other personal
information in your report or in the name of the file submitted via VITAL.
A penalty will be applied to submissions that do not meet this requirement.
1
Instructions:
• Read this script carefully before attempting the experiment.
• Review MATLAB before attempting the experiment and use it for all the
required coding and graphs. Check VITAL for MATLAB resources (Learning
Resources→Supporting Material folder). See online material and resources as
well.
• Keep a record of all code, graphs and results.
• The code must be well-structured and organised (to get a better mark). Use
the concept of functions for better code re-usability and managment.
• The code must be provided for every requirement with appropriate explanation.
Use MATLAB commenting (%) to emphasise on and explain relevant
code lines.
• For every requirement, the code must run and screenshots of the results must
be provided.
• Any change to the code needs to be reinserted every time.
• Be sure to reference any resource you have used in writing your report.
• Use your time wisely. Finish as many tasks as you can during the lab (with
demonstrators support). If you can’t finish all tasks today, you can complete
your work at home later on.
• If you have any feedback on your laboratory experience today, please write it
down on the last page of this script.
1 Learning outcomes
The purpose of this experiment is to develop, explore and test Monte Carlo techniques in
simulating and finding solutions to real-life random processes. MATLAB will be used as the
tool to do the tests of the experiment, but it is not the main learning outcome (i.e. the
experiment is not about MATLAB).
2 Introduction
The Monte Carlo method is a numerical method of solving mathematical problems by the simulation
of random variables. The name Monte Carlo was applied to a class of mathematical
methods first by scientists working on the development of nuclear weapons in Los Alamos in
the 1940s. The essence of the method is the invention of games of chance whose behaviour and
outcome can be used to study some interesting phenomena. While there is no essential link to
computers, the effectiveness of numerical or simulated gambling as a serious scientific pursuit
is enormously enhanced by the availability of modern digital computers [1].
The term “Monte Carlo” refers to procedures in which quantities of interest are approximated
by generating many random realisations of a stochastic process and averaging them in some
way. In statistics, the quantities of interest are the distributions of estimators and test statistics,
the size of a test statistic under the null hypothesis, or the power of a test statistic under
some specified alternative hypothesis [2].
2
How can we use Monte Carlo techniques to find the sampling distribution of an estimator? In
the real world, we usually observe just one sample of a certain size N, which will give us just
one estimate. The Monte Carlo experiment is a lab situation, where we replicate the real world
study many (R) times. Every time, we draw a different sample of size N from the original
population. Thus, we can calculate the estimate many times and any estimate will be a bit
different. The empirical distribution of these many estimates approximates the true of the
estimator. A Monte Carlo experiment involves the following steps [3]:
(1) Draw a (pseudo) random sample of size N for the stochastic elements of the stochastic
model from their respective probability distribution functions.
(2) Assume values for the parts of the model or draw them from their respective distribution
function.
(3) Calculate the parts of the statistical model.
(4) Calculate the value (e.g. the estimate) you are interested in.
(5) Replicate step (1) to (4) R times.
(6) Examine the empirical distribution of the R values.
The Monte Carlo approach is relevant to different scientific disciplines and problems including
(but not limited to) the following areas [4]:
• Physical sciences: computational physics, physical chemistry, quantum chromodynamics,
statistical physics, molecular modelling, particle physics and galaxy modelling.
• Designs and visuals/Computer graphics: global illumination, photorealistic images
of virtual 3D models, video games architecture and design, computer generated films and
special effects in cinema.
• Finance and business/Operations research: evaluating investments in projects at a
business unit, evaluating financial derivatives, construction of stochastic or probabilistic
financial models and in enhancing the treatment of uncertainty in the calculation.
• Telecommunications: planning a wireless network, generating user patterns and their
states, testing the probability of losing information in a network whether it is below a
certain threshold.
• Games: game playing related artificial intelligence theory.
3 The Practical Work
Penalty kicks are a critical time of decision-making for both the goalkeeper and the penalty
taker in football matches. Given that, for most professional games, the average number of goals
scored is around 2.5, a penalty kick can have a major influence on the outcome of a match.
Penalty kicks may reach speeds near 125 mph and is usually over within a quarter of a second.
Thus, the goalkeeper must make a decision on how to stop the shot before the ball is struck.
Statistics show that goalkeepers will most often jump to the left or right, hoping to guess correctly
the position to block the kick [5,6].
Consider the situation of a football goal and a blindfolded person trying to shoot the ball from
the penalty spot and score a goal. Let’s assume that the goal has dimensions L and W as
shown in Figure 2, and there is an imaginary circle that circumscribes the goal. Two cases will
be considered: first when there is no goalkeeper and second when there is a goalkeeper saving
the ball.
3
Figure 2: The goal arrangement.
3.1 Part I: No Goalkeeper Tests (40 Marks)
In this case, there is no goalkeeper, and it is just the penalty taker against the goal. You need
to model each shot by treating the co-ordinates of the ball in the goal plane as random variables
(i.e. ignore the trajectory of the ball).
• Task-1. If a large number of shots is attempted, derive a numerical value for the fraction of
balls entering the goal to the total number of balls in the circular area. Assume the penalty
taker is blindfolded (i.e. the shots are uniformly distributed within the circle). [5 Marks]
• Task-2. Design and write a computer programme to find the probability of scoring by
simulating N random penalty shots and repeating this experiment R times and taking the
mean of the attempts. Let N and R be inputs to your code. Use a uniform random
number generator in the simulation. [8 Marks]
• Task-3. Produce an appropriate scatter plot illustrating your experiment for N = 1,000
and R = 1, using red crosses to indicate score (i.e. balls on target) and blue circles to
indicate miss (i.e. balls off target). Insert an appropriate legend. [4 Marks]
• Task-4. For R = 5, find the probability of scoring for N = 100, N = 1,000, N = 10,000
and N = 100,000. Plot the probability against the value of N. Comment on the shape of
the plot, making reference to the theoretical probability calculated in Task-1. Remember
to label the axes and to insert an appropriate caption in your report. [7 Marks]
• Task-5. For N = 1,000, find the probability of scoring for R = 5 times, R = 10 times,
R = 15 times and R = 20 times. Plot this probability against the value of R. Comment
on the shape of the plot. [4 Marks]
• Task-6. Compare with appropriate explanation the two cases of Task-4 and Task-5 based
on the obtained probability plots. [4 Marks]
• Task-7. Repeat Task-2 to Task-6 using a normal (Gaussian) random number generator.
Assume the distribution to be centred at the centre of the circle and with standard
deviation equal to the radius. Comment (with appropriate explanation) on the differences
between the results of the two cases. [8 Marks]
4
3.2 Part II: With Goalkeeper Tests (30 Marks)
Consider now the above case but with a goalkeeper. The goalkeeper can assume one of five
possible actions (see Figure 3): stays in the middle, jumps to the upper left corner, jumps to
the upper right corner, jumps to the lower left corner or jumps to the lower right corner. A
ball is saved if the goalkeeper guesses the correct ball position. The goal area can be divided
into five corresponding regions as shown in the figure.
Figure 3: Five possibilities of a goalkeeper action to a penalty shoot-out.
• Task-8. Assuming that the goalkeeper action is modelled as a uniform random process,
what is the probability of scoring a goal if the penalty taker kicks 100 balls with uniform
random distribution within the circle, as before. Increase the kicks to 1000. Compare the
probability values with the case where no goalkeeper was in the goal (Task-1 and Task-3
above). [15 Marks]
• Task-9. Repeat Task-8 if the balls are kicked with a Gaussian random distribution (as in
Task-7). Compare your results with those obtained in Task-7 and Task-8. [5 Marks]
• Task-10. Given the fact that statistically 90% of the time goalkeepers tend to jump to
the lower two corners of the goal, what is the probability of scoring in this case after
randomly kicking 100 balls? 1,000 balls? (Compare both uniform and Gaussian distributions)
[10 Marks]
Note: For Tasks 8-10 you need to provide code, plots, explanations & comments as in Part I.
4 Review Questions (30 Marks)
(Include these in your Conclusions/Discussion section of your report)
Q1. In terms of what you’ve done in this experiment, comment on the advantages and disadvantages
(or drawbacks) of the Monte Carlo experiment. [5 Marks]
Q2. Discuss the ways in which the above model could be made more accurate and realistic.
[7 Marks]
Q3. With reference to Task-7 and Task-9, discuss the effect of changing the standard deviation
of the Guassian distribution on both the accuracy and precision of the penalty
shots. [5 Marks]
Q4. If a large number of balls are kicked on the goal (i.e. if N is sufficiently large), the value
of π can be estimated using (some function of) the ratio of the number of scores to the
total number of the shots. Hence, find the relation that estimates the value of π. Verify
this using your results for both uniform and Gaussian distributions. [8 Marks]
Q5. From your observation and results of Part II, what is the best strategy that should be
adopted by the penalty taker? What is the best strategy that should be adopted by the
goalkeeper? [5 Marks]
5
5 Report Writing and Marking Scheme
This experiment is assessed by means of a formal report. Reports that get 70% and above are
first-class reports only. Please refer to Appendix A to read about report marking descriptors.
The marking scheme for the report of this experiment is as follows:
• Results of Part I with code, plots, explanation and comments: 40 Marks
• Results of Part II with code, plots, explanation and comments: 30 Marks
• Discussions and Conclusions section (including review questions): 30 Marks
6 Plagiarism and Collusion
Plagiarism and collusion or fabrication of data is always treated seriously, and action appropriate
to the circumstances is always taken. The procedure followed by the University in
all cases where plagiarism, collusion or fabrication is suspected is detailed in the University’s
Policy for Dealing with Plagiarism, Collusion and Fabrication of Data, Code of Practice on
Assessment, Category C, available on https://www.liverpool.ac.uk/media/livacuk/tqsd/
code-of-practice-on-assessment/appendix_L_cop_assess.pdf.
Follow the following guidelines to avoid any problems:
(1) Do your work yourself.
(2) Acknowledge all your sources.
(3) Present your results as they are.
(4) Restrict access to your work.
Facts about penalty shoot-outs:
• Over 10 recent world cups’ penalty shoot-outs, 80% were scored successfully [5].
• A study for 1,000 penalty shoot-outs has shown that 74.7% of the kicks were successful,
18.2% were saved by the goalkeeper, 3.5% missed the goal and 3.6% hit the woodwork and
ended with no goal [6].
• The most successful football team in penalty shoot-outs is Germany. They lost only one
shoot-out throughout their history in recorded matches [7].
• England football team has bad penalty shoot-out record in major international matches [7].
6
References
[1] G Rubino and B Tuffin, “Rare Event Simulation using Monte Carlo Methods”, Wiley,
2009.
[2] C Lemieux, “Monte Carlo and Quasi-Monte Carlo Sampling”, Springer, 2009.
[3] M Kalos and P Whitlock, “Monte Carlo Methods”, Wiley, 2004.
[4] G Fishman, “Monte Carlo Concepts, Algorithms and Applications”, Springer, 1996.
[5] M Bar-Eli and O Azar, “Penalty kicks in soccer: an empirical analysis of shooting strategies
and goalkeepers preferences”, Soccer & Society, 2009.
[6] Just About Football, “Penalty Kick Statistics and Success rates”,
http://justaboutfootball.blogspot.com/2009/02/penalty-kick-statistics.html, 2009.
[7] J Billsberry, “Shootouts Alternatives”, http://www.penaltyshootouts.co.uk/alternatives.html,
2010.
Version history
Name Date Version
Dr M L´opez-Ben´ıtez September 2019 Ver. 3.4
Dr A Al-Ataby August 2014 Ver. 3.3
Dr A Al-Ataby October 2013 Ver. 3.2
Dr A Al-Ataby and Dr W Al-Nuaimy October 2012 Ver. 3.1
Dr A Al-Ataby and Dr W Al-Nuaimy October 2011 Ver. 3.0
Dr A Al-Ataby and Dr W Al-Nuaimy October 2010 Ver. 2.0
Dr W Al-Nuaimy October 2008 Ver. 1.0
7
19
Appendix E – Report Marking Descriptors
Mark Range Knowledge and
Understanding
Intellectual and
Practical Skills
Transferable Skills
90-99%
‘Outstanding’
Total coverage of the task set.
Exceptional demonstration of
knowledge and understanding
appropriately grounded in
theory and relevant literature.
Extremely creative and
imaginative approach.
Comprehensive and
accurate analysis. Wellargued
conclusions.
Perceptive self-assessment.
Extremely clear exposition.
Excellently structured and
logical response. Excellent
presentation, only the most
insignificant errors, suitable
for use as “model report”.
80-89%
‘Excellent’
As ‘Outstanding’ but with
some minor weaknesses or
gaps in knowledge and
understanding.
As ‘Outstanding’ but
slightly less imaginative
and with some minor gaps
in analysis and/or
conclusions.
As ‘Outstanding’ but with
some minor weaknesses in
structure, logic and/or
presentation. Quality of
reporting is very high.
70-79%
‘Very Good’
Full coverage of the task set.
Generally very good
demonstration of knowledge
and understanding but with
some modest gaps. Good
grounding in theory.
Some creative and
imaginative features. Very
good and generally
accurate analysis. Sound
conclusions. Some selfassessment.
Demonstrates
an understanding of the
broader context of the task.
Generally clear exposition.
Satisfactory structure. Very
good presentation, largely
free of grammatical and
other errors. Reporting is
professional and wellpresented.
60-69%
‘Comprehensive’
As ‘Very Good’ but with
more and/or more significant
gaps in knowledge and
understanding and some
significant gaps in grounding
As ‘Very Good’ but
analysis and conclusions
contain some minor
weaknesses, oversights
and/or inaccuracies.
As ‘Very Good’ but with
some weaknesses in
exposition and/or structure
and a few more
grammatical and other
errors.
50-59%
‘Competent’
Covers most of the task set.
Patchy knowledge and
understanding with limited
grounding in literature.
Rather limited creative and
imaginative features.
Patchy analysis containing
significant flaws. Rather
limited conclusions. No
self-assessment.
Competent exposition and
structure. Competent
presentation but some
significant presentational
and structural errors.
For example, figures may
be poorly labelled and data
tabulation may be poor.
40-49%
‘Adequate’
As ‘Competent’ but patchy
coverage of the task set and
more weaknesses and/or
omissions in knowledge and
understanding. Just meets
the threshold level.
As ‘Competent’ but
probably without much
imagination. Shows barely
adequate ability to analyse
and draw conclusions.
Just meets the threshold
level.
As ‘Competent’ but with
more weaknesses in
exposition, structure,
presentation and/or errors.
Just meets the threshold
level.
35-39%
‘Compensatable
fail’
Some parts of the set task
likely to have been omitted.
Major gaps in knowledge and
understanding. Some
significant confusion. Very
limited grounding. Falls just
short of the threshold level.
No creative or imaginative
features. Analysis and
conclusions rather limited.
Falls just short of the
threshold level.
Somewhat confused and
limited exposition.
Confused structure. Some
weaknesses in presentation
and some serious
presentational and
mathematical errors. Falls
just short of the threshold
level.
20-34%
‘Deficient’
As ‘Compensatable Fail’ but
with major omissions and/or
major gaps in knowledge and
understanding, and/or
incorrect approach towards
the experimental task Falls
substantially below the
threshold level.
As ‘Compensatable Fail’
but analysis and/or
conclusions may have been
omitted, and practical
work is substantially below
the threshold level.
Demonstrates inability to
operate or manipulate
equipment.
As ‘Compensatable Fail’
but with more serious
weaknesses in delivery of
presentation. Falls
substantially below the
threshold level.
0-20%
‘Extremely weak’
Substantial sections of the
task not covered. Knowledge
and understanding of the task
and the laboratory
environment very limited
and/or largely incorrect. No
grounding in theory.
No creative or imaginative
features. No report as suc,
just collection of notes
and/or plots. Analysis
extremely weak or
omitted. No conclusions.
Largely confused
exposition and structure.
Many serious errors in
presentation of data
Feedback:
If you have any feedback on your laboratory experience for this experiment (e.g. timing,
difficulty, clarity of script, demonstration ...etc) and suggestions to how the experiment may be
improved in the future, please write them down in the space below. This feedback is important
for future versions of this script and to enhance the laboratory process, and will not be assessed.
If you wish to provide this feedback anonymously, you may do so by detaching this page and
submitting it to the Student Support Centre (fifth floor office).
9