# ST202 Stochastic Processes

Please note that all lectures for Statistics modules taught in the 2022-23 academic year will be delivered on campus, and that the information below relates only to the hybrid teaching methods utilised in 2021-22 as a response to Coronavirus. We will update the Additional Information (linked on the right side of this page) prior to the start of the 2022/23 academic year.

Throughout the 2021-22 academic year, we will be adapting the way we teach and assess your modules in line with government guidance on social distancing and other protective measures in response to Coronavirus. Teaching will vary between online and on-campus delivery through the year, and you should read the additional information linked on the right hand side of this page for details of how this will work for this module. The contact hours shown in the module information below are superseded by the additional information. You can find out more about the University’s overall response to Coronavirus at: https://warwick.ac.uk/coronavirus.

All dates for assessments for Statistics modules, including coursework and examinations, can be found in the Statistics Assessment Handbook at http://go.warwick.ac.uk/STassessmenthandbook

# ST202-12 Stochastic Processes

21/22
Department
Statistics
Level
Nicholas Tawn
Credit value
12
Module duration
10 weeks
Assessment
Multiple
Study location
University of Warwick main campus, Coventry

##### Introductory description

This modules runs in Term 2.

This module is core for students with their home department in Statistics.
It is available as an option or unusual option for other students.

Pre-requisites:
Statistics Students: ST115 Introduction to Probability AND MA137 Mathematical Analysis
Non-Statistics Students: ST111 Probability A AND ST112 Probability B AND (MA131 Analysis I OR MA137 Mathematical Analysis)

Leads to: ST333 Applied Stochastic Processes and ST406 Applied Stochastic Processes with Advanced Topics.

##### Module aims

Loosely speaking, a stochastic or random process is any measurable phenomenon which develops randomly in time. Only the simplest models will be considered in this course, namely those where the process moves by a sequence of jumps in discrete time steps. We will discuss: Markov chains, which use the idea of conditional probability to provide a flexible and widely applicable family of random processes; random walks, which serve as fundamental building blocks for constructing other processes as well as being important in their own right; and renewal theory, which studies processes which occasionally "begin all over again." Such processes are common tools in economics, biology, psychology and operations research, so they are very useful as well as attractive and interesting theories.

The aims of this module are to introduce the idea of a stochastic process, and to show how simple probability and matrix theory can be used to build this notion into a beautiful and useful piece of applied mathematics.

##### Outline syllabus

This is an indicative module outline only to give an indication of the sort of topics that may be covered. Actual sessions held may differ.

1. Brief review of fundamental probability notions.
2. Introduction to Markov processes (Definitions, Chapman-Kolmogorov equations, notions of recurrence, transience, positive recurrence, transition probability matrices,
3. Long-run behaviour of Markov Chains, (equilibirum distributions, convergence to equilibrium)
4. Some applications.
5. Discussion of extensions to continuous settings and if time permits to non-Markov settings.
##### Learning outcomes

By the end of the module, students should be able to:

• Understand the notion of a Markov chain, and how simple ideas of conditional probability and matrices can be used to give a thorough and effective account of discrete-time Markov chains.
• Understand notions of long-time behaviour including transience, recurrence, and equilibrium.
• Be able to apply these ideas to answer basic questions in several applied situations including genetics, branching processes and random walks.

S.M. Ross, Introduction to Probability Models
G.R. Grimmett and D.R. Stirzaker, Probability and Random Processes
P.W. Jones and P. Smith, Stochastic Processes
J.R. Norris, Markov Chains

TBC

TBC

## Study time

Type Required Optional
Lectures 30 sessions of 1 hour (25%) 2 sessions of 1 hour
Tutorials 4 sessions of 1 hour (3%)
Private study 62 hours (52%)
Assessment 24 hours (20%)
Total 120 hours
##### Private study description

Weekly revision of lecture notes and materials, wider reading and practice exercises, working on problem sets and preparing for examination.

## Costs

No further costs have been identified for this module.

You do not need to pass all assessment components to pass the module.

Students can register for this module without taking any assessment.

##### Assessment group D3
Weighting Study time
Multiple Choice Quiz 1 3% 4 hours

A multiple choice quiz which will take place during the term that the module is delivered.

Multiple Choice Quiz 2 3% 4 hours

A multiple choice quiz which will take place during the term that the module is delivered.

Multiple Choice Quiz 3 4% 4 hours

A multiple choice quiz which will take place during the term that the module is delivered.

Written assignment 10% 12 hours

The assignment will contain a number of questions for which solutions and / or written responses will be required. The preparation and completion time noted below refers to the amount of time in hours that a well-prepared student who has attended lectures and carried out an appropriate amount of independent study on the material could expect to spend on this assignment. You will write your answers on paper and submit to the Statistics Support Office.

On-campus Examination 80%

The examination paper will contain four questions, of which the best marks of THREE questions will be used to calculate your grade.

~Platforms - Moodle

• Students may use a calculator
##### Assessment group R1
Weighting Study time
On-campus Examination - Resit 100%

The examination paper will contain four questions, of which the best marks of THREE questions will be used to calculate your grade.

• Students may use a calculator
##### Feedback on assessment

Answers to problems sets will be marked and returned to you in a tutorial or seminar taking place the following week when you will have the opportunity to discuss it.

Solutions and cohort level feedback will be provided for the examination.

## Courses

This module is Core for:

• Year 2 of USTA-G302 Undergraduate Data Science
• Year 2 of USTA-G304 Undergraduate Data Science (MSci)
• Year 2 of USTA-G300 Undergraduate Master of Mathematics,Operational Research,Statistics and Economics
• Year 2 of USTA-G1G3 Undergraduate Mathematics and Statistics (BSc MMathStat)
• Year 2 of USTA-GG14 Undergraduate Mathematics and Statistics (BSc)
• Year 2 of USTA-Y602 Undergraduate Mathematics,Operational Research,Statistics and Economics

This module is Option list A for:

• Year 2 of UCSA-G4G1 Undergraduate Discrete Mathematics
• Year 2 of UCSA-G4G3 Undergraduate Discrete Mathematics
• Year 2 of UMAA-G105 Undergraduate Master of Mathematics (with Intercalated Year)
• Year 2 of UMAA-G100 Undergraduate Mathematics (BSc)
• Year 2 of UMAA-G103 Undergraduate Mathematics (MMath)
• Year 2 of UMAA-G106 Undergraduate Mathematics (MMath) with Study in Europe