Skip to main content Skip to navigation

CS331 Neural Computing

CS331-15 Neural Computing

Academic year
21/22
Department
Computer Science
Level
Undergraduate Level 3
Module leader
Weiren Yu
Credit value
15
Module duration
10 weeks
Assessment
Multiple
Study location
University of Warwick main campus, Coventry
Introductory description

This module provides an introduction to the theory and implementation of neural networks and an understanding of the important computational neural network architecture and methodology. It aims to give students sufficient knowledge to enable employment or postgraduate study involving neural networks.

Module aims

This module provides an introduction to the theory and implementation of neural networks, both biological and artificial. It aims to give students sufficient knowledge to enable employment or postgraduate study involving neural networks.

Outline syllabus

This is an indicative module outline only to give an indication of the sort of topics that may be covered. Actual sessions held may differ.

  • Introduction: What Is a Neural Network; Biological Neural Networks; Basic Principles of Artificial Neural Networks; Basic Terminology and Notation; Different Types of Neural Networks; AI Tasks in Neural Networks; Pre-Stage: Creating the Network.

  • Single-Layer Perceptron: McCulloch-Pitts Neuron; Definition of Perceptron; Weights, Bias, Node, Activation Functions; Perceptron Case Study: Digital Number Recognition; Mimic Logic Operations (AND, OR, NOT); XOR Linear Inseparability Problem.

  • Multi-Layer Forward Propagation: Representation of Multi-Layer Neural Networks; Predicting Multi-Layer Neural Network Output; Common Nonlinear Activation Functions; How to Choose an Activation Function for Your Model; Forward Propagation for Deep Neural Networks; Vectorisation

  • Loss Function & Gradient Descent: Different Loss Functions (e.g., MAE, MSE, Cross Entropy Loss); 1D & 2D Forms of Gradient Descent Methods; Variations of Gradient Descent (e.g., Momentum, RMSProp, Adam); Saddle Points; Gradient Descent vs. Newton Method; Stochastic & Mini-Batch Gradient Descent

  • Backpropagation: Computation Graph; Matrix Calculus Revisited; Backpropagation in Logistic Regression; Backpropagation in Multi-Layered NNs; Vanishing Gradient Problems

  • Overfitting & Regularization: Bias and Variance; What is Regularization; How does Regularization help in Reducing Overfitting; Different Regularization Techniques (e.g., L1 and L2 Regularization, Dropout, Data Augmentation, Early Stopping)

  • Recurrent Neural Network: Sequence Model; One-hot Representation; Forward and Backward Propagations; Different Types of Recurrent Neural Networks; Bidirectional Recurrent Neural Network; Vanishing & Exploding Gradient Problems; Gated Recurrent Units (GRU); Long Short-Term Memory Networks (LSTM)

  • Making Your Own Neural Network from Scratch: The Tools You Will Need

  • Recent Advances in Neural Networks (Optional): Structural Similarity Search, Graph Embedding, Time Series Analysis

Learning outcomes

By the end of the module, students should be able to:

  • Students completing the module should be able to demonstrate: an understanding of the principles of Neural Networks and a knowledge of their main areas of application;
  • -the ability to design, implement and analyse the behaviour of simple neural networks.
Indicative reading list
  1. Michael Taylor. Make Your Own Neural Network: An In-Depth Visual Introduction for Beginners. Amazon Digital Services LLC - Kdp Print Us, 2017, ISBN: 1549869132, 9781549869136

  2. Graupe Daniel. Principles of Artificial Neural Networks: Basic Designs to Deep Learning (4th Edition). World Scientific, 2019, ISBN: 9811201242, 9789811201240

  3. James Loy. Neural Network Projects with Python: The ultimate guide to using Python to explore the true power of neural networks through six projects, Packt Publishing Ltd, 2019, ISBN: 1789133319, 9781789133318

Subject specific skills

tbc

Transferable skills

tbc

Study time

Type Required
Lectures 30 sessions of 1 hour (20%)
Private study 120 hours (80%)
Total 150 hours
Private study description

Private study, background reading and revision

Costs

No further costs have been identified for this module.

You do not need to pass all assessment components to pass the module.

Students can register for this module without taking any assessment.

Assessment group D2
Weighting Study time
assignment 20%
On-campus Examination 80%

CS331 Examination

~Platforms - AEP


  • Answerbook Pink (12 page)
  • students may use a calculator
Assessment group R1
Weighting Study time
Online Examination 100%

CS331 resit Examination

~Platforms - AEP


  • Online examination: No Answerbook required
  • students may use a calculator
Feedback on assessment

Individual written feedback on coursework

Past exam papers for CS331

Courses

This module is Optional for:

  • Year 3 of UCSA-G4G1 Undergraduate Discrete Mathematics
  • Year 3 of UCSA-G4G3 Undergraduate Discrete Mathematics
  • Year 4 of UCSA-G4G2 Undergraduate Discrete Mathematics with Intercalated Year
  • USTA-G1G3 Undergraduate Mathematics and Statistics (BSc MMathStat)
    • Year 3 of G1G3 Mathematics and Statistics (BSc MMathStat)
    • Year 4 of G1G3 Mathematics and Statistics (BSc MMathStat)
  • USTA-G1G4 Undergraduate Mathematics and Statistics (BSc MMathStat) (with Intercalated Year)
    • Year 4 of G1G4 Mathematics and Statistics (BSc MMathStat) (with Intercalated Year)
    • Year 5 of G1G4 Mathematics and Statistics (BSc MMathStat) (with Intercalated Year)

This module is Option list A for:

  • Year 3 of UCSA-G400 BSc Computing Systems
  • Year 4 of UCSA-G401 BSc Computing Systems (Intercalated Year)
  • Year 4 of UCSA-G504 MEng Computer Science (with intercalated year)
  • Year 3 of UCSA-G402 MEng Computing Systems
  • Year 4 of UCSA-G403 MEng Computing Systems (Intercalated Year)
  • Year 3 of UCSA-G500 Undergraduate Computer Science
  • Year 4 of UCSA-G502 Undergraduate Computer Science (with Intercalated Year)
  • Year 3 of UCSA-G503 Undergraduate Computer Science MEng
  • Year 3 of USTA-G302 Undergraduate Data Science
  • Year 3 of USTA-G304 Undergraduate Data Science (MSci)
  • Year 4 of USTA-G303 Undergraduate Data Science (with Intercalated Year)

This module is Option list B for:

  • Year 3 of UCSA-G406 Undergraduate Computer Systems Engineering
  • Year 3 of UCSA-G408 Undergraduate Computer Systems Engineering
  • Year 4 of UCSA-G407 Undergraduate Computer Systems Engineering (with Intercalated Year)
  • Year 4 of UCSA-G409 Undergraduate Computer Systems Engineering (with Intercalated Year)
  • Year 3 of UCSA-GN51 Undergraduate Computer and Business Studies
  • Year 4 of UCSA-GN5A Undergraduate Computer and Business Studies (with Intercalated Year)
  • Year 3 of USTA-GG14 Undergraduate Mathematics and Statistics (BSc)
  • Year 4 of USTA-GG17 Undergraduate Mathematics and Statistics (with Intercalated Year)

Further Information

Term 2

15 CATS (7.5 ECTS)

Online Material

Additional Information

Updated Module Syllabus 2020/21