Computer Science News
Winner of the Faculty of Science, Engineering and Medicine Post-Doctoral Research Prize 2022
Gunduz Vehbi Demirci has been awarded with the Faculty of Science, Engineering and Medicine Post-Doctoral Research Prize 2022 for his paper jointly with Prof. Hakan Ferhatosmanoglu, "Partitioning sparse deep neural networks for scalable training and inference", published in the Proceedings of the ACM International Conference on Supercomputing (ICS '21) (DOI: https://doi.org/10.1145/3447818.3460372).
Training large-scale deep learning models is notoriously difficult. Gunduz develops a highly parallel solution to scale training of sparse deep learning models, which is combined with a novel combinatorial optimisation built on a hypergraph partitioning model, reducing parallelisation overheads and achieving computational balance among processors. An end-to-end software solution is released, enabling competing with big tech companies that have access to large infrastructures and datasets.
The work is summarised in a paper accepted by the 2021 ACM International Conference on Supercomputing, which is a premier conference in high-end systems. The research output will have a great potential to bring significant practical impact in long term as developing such comprehensive solutions takes time and is typically achieved only within large groups.