In this talk we will review the fundamental discoveries that led to the practical implementation and proliferation of artificial neural networks (ANNs). We will explore the relationship between physical model systems and ANNs and how cross-fertilisation between physics and computer science produced this highly influential method. Impactful applications of ANNs in various area of physics research will be presented, including quantum mechanics, materials science, astrophysics, particle physics and biomolecular modelling.