How the brain generates robust behaviour in noisy sensory environments. This project aims to investigate the origins of variability in the control of movements. This project expects to generate new knowledge in the area of sensory and motor neuroscience by determining how variability in the activity of sensory and motor neurons accounts for variability in the initiation and control of eye movements. Expected outcomes of this project include international collaboration, development of new methods ....How the brain generates robust behaviour in noisy sensory environments. This project aims to investigate the origins of variability in the control of movements. This project expects to generate new knowledge in the area of sensory and motor neuroscience by determining how variability in the activity of sensory and motor neurons accounts for variability in the initiation and control of eye movements. Expected outcomes of this project include international collaboration, development of new methods for imaging neural activity in vivo, and refinement of theories concerning the cause and implications of noise in the brain. This should provide significant benefits such as a better understanding of why our movements are variable, and whether it is desirable or possible to minimise this variability. Read moreRead less
Learning kernel-based high-order visual representation for image retrieval. Image retrieval plays a key role in many practical applications. The recent increase of real-world applications calls for higher retrieval accuracy. This project aims to address this issue by exploring advanced visual representation that models the high-order information of image content. This project expects to generate new knowledge in the area of computer vision by developing a novel image retrieval framework. Expecte ....Learning kernel-based high-order visual representation for image retrieval. Image retrieval plays a key role in many practical applications. The recent increase of real-world applications calls for higher retrieval accuracy. This project aims to address this issue by exploring advanced visual representation that models the high-order information of image content. This project expects to generate new knowledge in the area of computer vision by developing a novel image retrieval framework. Expected outcomes include theory development on visual representation and more effective retrieval techniques. This should provide significant benefits, such as improving public information access services, facilitating environmental monitoring, and enhancing smart traffic management.Read moreRead less
Assistive micro-navigation for vision impaired people. This project aims to develop novel algorithms to transform a simple camera into a smart sensor, that can enable a vision-impaired person to navigate freely and without additional aids in a crowded area. Such a smart sensor will be endowed with the capability to detect and locate obstacles, identify the walking path, recognise objects and traffic signs and convey step-by-step instructions to the user. The project outcomes are expected to impr ....Assistive micro-navigation for vision impaired people. This project aims to develop novel algorithms to transform a simple camera into a smart sensor, that can enable a vision-impaired person to navigate freely and without additional aids in a crowded area. Such a smart sensor will be endowed with the capability to detect and locate obstacles, identify the walking path, recognise objects and traffic signs and convey step-by-step instructions to the user. The project outcomes are expected to improve the well-being and accessibility to public areas for vision-impaired people and reduce physical access disparities for this disadvantaged and vulnerable group. Furthermore, technologies developed in this project can potentially be adapted for use in related special navigation applications such as road safety, self-driving vehicles, and autonomous robots.Read moreRead less
Exploiting the Symmetry of Spatial Awareness for 21st Century Automation. This project aims to enable autonomous robotic systems to operate more robustly and more reliably in the complex, cluttered and dynamic environments found in real-world applications. Applying the latest understanding of symmetry in non-linear systems and control provides tools that can be used to develop new design methodologies for spatial awareness algorithms. The outcomes of this project should increase Australia's ca ....Exploiting the Symmetry of Spatial Awareness for 21st Century Automation. This project aims to enable autonomous robotic systems to operate more robustly and more reliably in the complex, cluttered and dynamic environments found in real-world applications. Applying the latest understanding of symmetry in non-linear systems and control provides tools that can be used to develop new design methodologies for spatial awareness algorithms. The outcomes of this project should increase Australia's capacity in high-tech systems and deliver world best open source code for spatial awareness problems to enable the next generation of automation in Australia.Read moreRead less
Precision Pollination: Data-driven enhancements to boost crop yield. The project aims to transform industrial crop pollination from an intuitive domain to one where decisions are based on sound data and best-practice principles. It proposes to achieve this modernisation of global pollination practice by developing novel technologies to operate a three-stage loop: honeybee pollination monitoring, simulation-based forecasting, and management. This is intended to ensure that the capability of honey ....Precision Pollination: Data-driven enhancements to boost crop yield. The project aims to transform industrial crop pollination from an intuitive domain to one where decisions are based on sound data and best-practice principles. It proposes to achieve this modernisation of global pollination practice by developing novel technologies to operate a three-stage loop: honeybee pollination monitoring, simulation-based forecasting, and management. This is intended to ensure that the capability of honeybees to provide essential ecosystem services is informed by transferable, standardised data acquisition and management techniques that maintain bee health and maximise pollination. The anticipated outcomes are higher fruit yields and quality, and a beneficial step-change in industry productivity and profitability.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.
Towards in-vehicle situation awareness using visual and audio sensors. This project aims to characterise driver awareness, activity and interactions with other vehicle occupants using visual and audio cues from internally mounted sensors. Road accidents cost Australia an estimated $30 billion per year and tragic loss of thousands of lives, yet the vast majority of severe vehicle crashes are linked to driver fatigue or distraction. The expected project outcomes include advanced artificial intelli ....Towards in-vehicle situation awareness using visual and audio sensors. This project aims to characterise driver awareness, activity and interactions with other vehicle occupants using visual and audio cues from internally mounted sensors. Road accidents cost Australia an estimated $30 billion per year and tragic loss of thousands of lives, yet the vast majority of severe vehicle crashes are linked to driver fatigue or distraction. The expected project outcomes include advanced artificial intelligence to infer and predict dangerous driver and passenger behaviour. This has the potential to significantly benefit society by advancing autonomous driving capabilities and reducing driver-induced accidents and fatalities, ensuring that every driver, passenger and pedestrian arrives home safely at the end of each day.Read moreRead less
New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project wil ....New Paradigms for Robust Fitting: Kernelisation and Polyhedral Search. Outliers inevitably exist in visual data due to imperfect data acquisition or preprocessing. To enable computer vision applications that can perform reliably, robust fitting algorithms are necessary to counter the biasing influence of outliers. However, current robust algorithms are unsatisfactory: they are unreliable (due to using randomisation) or too computationally costly (due to using exhaustive search). This project will develop new robust algorithms to mitigate these shortcomings. It will do so by investigating two new paradigms of kernelisation and polyhedral search, which offer unprecedented theoretical insights into the problem. The outcomes will contribute towards computer vision applications that are more practical and reliable.Read moreRead less
Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the ....Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the primary limitations of deep learning and will greatly increase its practical application to a range of industrial, cultural or health settings.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE190100539
Funder
Australian Research Council
Funding Amount
$408,000.00
Summary
Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their ....Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their early days, typically require significant expertise to use effectively. The outcomes of this project will push the boundary of vision-language research to produce a conversational intelligent agent that can be easily used in common situations across industry, transport, the medical sector, and at home.Read moreRead less