New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Defense against adversarial attacks on deep learning in computer vision. Computer vision applications rely heavily on deep learning, which is highly vulnerable to being fooled by adding subtle perturbations to object/image textures that are imperceptible to humans. This project aims to develop defense mechanisms to detect and remove adversarial patterns from the input images. The project expects to advance knowledge in understanding the vulnerabilities of deep learning, and to design deep learni ....Defense against adversarial attacks on deep learning in computer vision. Computer vision applications rely heavily on deep learning, which is highly vulnerable to being fooled by adding subtle perturbations to object/image textures that are imperceptible to humans. This project aims to develop defense mechanisms to detect and remove adversarial patterns from the input images. The project expects to advance knowledge in understanding the vulnerabilities of deep learning, and to design deep learning architectures that are inherently robust. The outcomes of this project will increase the security and reliability of computer vision by detecting, reporting and nullifying such attacks and will benefit the general public and industry on many fronts.Read moreRead less
How the brain generates robust behaviour in noisy sensory environments. This project aims to investigate the origins of variability in the control of movements. This project expects to generate new knowledge in the area of sensory and motor neuroscience by determining how variability in the activity of sensory and motor neurons accounts for variability in the initiation and control of eye movements. Expected outcomes of this project include international collaboration, development of new methods ....How the brain generates robust behaviour in noisy sensory environments. This project aims to investigate the origins of variability in the control of movements. This project expects to generate new knowledge in the area of sensory and motor neuroscience by determining how variability in the activity of sensory and motor neurons accounts for variability in the initiation and control of eye movements. Expected outcomes of this project include international collaboration, development of new methods for imaging neural activity in vivo, and refinement of theories concerning the cause and implications of noise in the brain. This should provide significant benefits such as a better understanding of why our movements are variable, and whether it is desirable or possible to minimise this variability. Read moreRead less
Deep Learning that Scales. Deep learning has dramatically improved the accuracy of a breathtaking variety of tasks in AI such as image understanding and natural language processing. This project addresses fundamental bottlenecks when attempting to develop deep learning applications at scale. First, this project proposes efficient neural architecture search that is orders of magnitude faster than previously reported, abstracting away the most complex part of deep learning. Second, we will desig ....Deep Learning that Scales. Deep learning has dramatically improved the accuracy of a breathtaking variety of tasks in AI such as image understanding and natural language processing. This project addresses fundamental bottlenecks when attempting to develop deep learning applications at scale. First, this project proposes efficient neural architecture search that is orders of magnitude faster than previously reported, abstracting away the most complex part of deep learning. Second, we will design very efficient binary networks, enabling large-scale deployment of deep learning to mobile devices. Thus this project will overcome two primary limitations of deep learning generally, however, and will greatly increase its already impressive domain of practical application.Read moreRead less
Learning Robotic Navigation and Interaction from Object-based Semantic Maps. Our project aims to develop new learning algorithms that enable robots to perform high-complexity tasks that are currently impossible. Compared to existing methods that rely on low-level sensor data, we aim to achieve this by learning from a high-level graph representation of the environment that captures semantics, affordances, and geometry. The outcome would be robots capable of using human instructions to efficiently ....Learning Robotic Navigation and Interaction from Object-based Semantic Maps. Our project aims to develop new learning algorithms that enable robots to perform high-complexity tasks that are currently impossible. Compared to existing methods that rely on low-level sensor data, we aim to achieve this by learning from a high-level graph representation of the environment that captures semantics, affordances, and geometry. The outcome would be robots capable of using human instructions to efficiently learn complex interaction and navigation behaviours that transfer to unseen environments. Our research should benefit new applications in domains of economic and societal importance that are currently too complex, unsafe, and uncertain for robot assistants, such as aged care, advanced manufacturing and domestic robotics.Read moreRead less
Active Visual Navigation in an Unexplored Environment. This project will develop a new method for robotic navigation in which goals can be specified at a much higher level of abstraction than has previously been possible. This will be achieved using deep learning to make informed predictions about a scene layout, and navigating as an active observer in which the predictions informs actions. The outcome will be robotic agents capable of effective and efficient navigation and operation in previous ....Active Visual Navigation in an Unexplored Environment. This project will develop a new method for robotic navigation in which goals can be specified at a much higher level of abstraction than has previously been possible. This will be achieved using deep learning to make informed predictions about a scene layout, and navigating as an active observer in which the predictions informs actions. The outcome will be robotic agents capable of effective and efficient navigation and operation in previously unseen environments, and the ability to control such agents with more human-like instructions. Such capabilities are desirable, and in some cases essential, for autonomous robots in a variety of important application areas including automated warehousing and high-level control of autonomous vehicles. Read moreRead less
3D Vision Geometric Optimisation in Deep Learning. This project aims to develop a methodology for integrating the algorithms of 3D Vision Geometry and Optimization into the framework of Machine Learning and demonstrate the wide applicability of the new methods on a variety of challenging fundamental problems in Computer Vision. These include 3D geometric scene understanding, and estimation and prediction of human 2D/3D pose and activity. Applications of this technology are to be found in Intell ....3D Vision Geometric Optimisation in Deep Learning. This project aims to develop a methodology for integrating the algorithms of 3D Vision Geometry and Optimization into the framework of Machine Learning and demonstrate the wide applicability of the new methods on a variety of challenging fundamental problems in Computer Vision. These include 3D geometric scene understanding, and estimation and prediction of human 2D/3D pose and activity. Applications of this technology are to be found in Intelligent Transportation, Environment Monitoring, and Augmented Reality, applicable in smart-city planning and medical applications such as computer-enhanced surgery. The goal is to build Australia's competitive advantage in the forefront of ICT research and technology innovation.Read moreRead less
Emergent cues underlying the perception of shape, colour, and material . This goal of this project is to identify the information the visual system uses to extract the three-dimensional structure and material composition of objects. This project aims to generate an advanced understanding of the information that supports these perceptual abilities and to advance our understanding how this information is learned from exposure to natural scenes. The findings of this work are expected to benefit ou ....Emergent cues underlying the perception of shape, colour, and material . This goal of this project is to identify the information the visual system uses to extract the three-dimensional structure and material composition of objects. This project aims to generate an advanced understanding of the information that supports these perceptual abilities and to advance our understanding how this information is learned from exposure to natural scenes. The findings of this work are expected to benefit our understanding of the human visual system, and to provide insights into the information needed to advance the development of deep neural networks (machine learning) that exploit the same information used by humans to guide our behavior and recognize objects and materials.Read moreRead less
Perceiving and misperceiving the causes of optical structure. This project aims to understand the conditions that cause humans to misperceive the shape and surface properties of real-world materials. Most natural materials are translucent to varying degrees, but little is known about how light is transported through them or how such materials are perceived or misperceived. This project will determine the conditions and causes responsible for the misperception of material properties and shape, an ....Perceiving and misperceiving the causes of optical structure. This project aims to understand the conditions that cause humans to misperceive the shape and surface properties of real-world materials. Most natural materials are translucent to varying degrees, but little is known about how light is transported through them or how such materials are perceived or misperceived. This project will determine the conditions and causes responsible for the misperception of material properties and shape, and will offer practical information about what can be done to minimise such misperceptions. The outcomes of the project are expected to lead to new techniques for depicting and manipulating real-world translucent materials in computer graphics, virtual reality, and gaming industries.Read moreRead less
Solve it or Ignore it? The Challenge of Alignment Distortion and Creating Next Generation Automatic Facial Expression Detection. The last two decades have seen an escalating interest in automating the coding of facial expressions. Despite this keen interest, the promise of computer vision systems to accurately code facial expressions in natural circumstances remains elusive. Our interdisciplinary team will research a new paradigm to account for facial alignment distortion directly rather than ai ....Solve it or Ignore it? The Challenge of Alignment Distortion and Creating Next Generation Automatic Facial Expression Detection. The last two decades have seen an escalating interest in automating the coding of facial expressions. Despite this keen interest, the promise of computer vision systems to accurately code facial expressions in natural circumstances remains elusive. Our interdisciplinary team will research a new paradigm to account for facial alignment distortion directly rather than aiming to achieve invariance to it. The project will also research new data agnostic feature compaction capabilities to enable scalable learning on the world’s largest and challenging expression dataset available to us through international collaboration. Tackling these two major open problems will make accurate coding of facial expressions in natural environments achievable.Read moreRead less