Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the ....Deep visual understanding: learning to see in an unruly world. Deep Learning has achieved incredible success at an astonishing variety of Computer Vision tasks recently. This project aims to convey this success into the challenging domain of high-level image-based reasoning. It will extend deep learning to achieve flexible semantic reasoning about the content of images based on information gleaned from the huge volumes of data available on the Internet. The project expects to overcome one of the primary limitations of deep learning and will greatly increase its practical application to a range of industrial, cultural or health settings.Read moreRead less
Added depth: automated high level image interpretation. Humans are very good at understanding the world through imagery, but computers lack this fundamental capacity because they lack experience of what they might see. This project will provide this experience by combining the large volumes of imagery on the Internet with three dimensional information generated by humans for other purposes.
Discovery Early Career Researcher Award - Grant ID: DE190100539
Funder
Australian Research Council
Funding Amount
$408,000.00
Summary
Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their ....Towards conversational vision-based Artificial Intelligence. This project aims to develop a novel learning framework, Vision-Ask-Answer-Act (V3A). This framework will allow a machine to perform a sequence of actions via a conversation with human users, based on intricate processing of not just visual input, but human-computer verbal exchanges. Artificial intelligence has great potential as a tool for economic productivity and daily tasks. Applications in cars and assistant robots, still in their early days, typically require significant expertise to use effectively. The outcomes of this project will push the boundary of vision-language research to produce a conversational intelligent agent that can be easily used in common situations across industry, transport, the medical sector, and at home.Read moreRead less
Fairness in Natural Language Processing. Natural language processing (NLP) has achieved spectacular commercial successes in recent years, and has been deployed across an ever-increasing breadth of devices and application areas. At the same time, there has been stark evidence to indicate that naively-trained models amplify biases in training data, and perform inconsistently across text relating to different demographic groupings of individuals. This project aims to systematically quantify the ext ....Fairness in Natural Language Processing. Natural language processing (NLP) has achieved spectacular commercial successes in recent years, and has been deployed across an ever-increasing breadth of devices and application areas. At the same time, there has been stark evidence to indicate that naively-trained models amplify biases in training data, and perform inconsistently across text relating to different demographic groupings of individuals. This project aims to systematically quantify the extent of such biases, and develop models that are both more socially equitable, as well as less prone to expose private data in the learned representations. In doing so, it will make NLP more accessible to new populations of users, and remove socio-technological barriers to NLP uptake.Read moreRead less
Using data mining methods to remove uncertainties in sensor data streams. This project will develop key techniques for removing uncertainties in sensor data streams and thus improve the monitoring quality of sensor networks. The expected outcomes will benefit Australia by enabling improved, lower-cost monitoring of natural resources and management of stock raising.
Extending fuzzy logic. Fuzzy logic is good for dealing with uncertain data somewhat like people do, and this technique has been used in train braking systems, computer animation etc, but can be slow for problems with large or complex data especially if the data are changing with time. The project will design efficient fuzzy logic algorithms capable of dealing with complex real world problems.
Deep Data Mining for Anomaly Prediction from Sensor Data Streams. Sensor data streams are crucial for anomaly predictions in real-life monitoring. However, balancing efficiency and accuracy in predicting anomalies with sensor streams is a great challenge; it requires new techniques that go beyond detecting anomalies and predicting trends. This project will develop a deep mining method for anomaly prediction from sensor streams; it will comprise mining algorithms at various levels - from compress ....Deep Data Mining for Anomaly Prediction from Sensor Data Streams. Sensor data streams are crucial for anomaly predictions in real-life monitoring. However, balancing efficiency and accuracy in predicting anomalies with sensor streams is a great challenge; it requires new techniques that go beyond detecting anomalies and predicting trends. This project will develop a deep mining method for anomaly prediction from sensor streams; it will comprise mining algorithms at various levels - from compressing massive raw data, to recognition of abnormal waveforms preceding anomalies, and to retrieving and summarising similar past anomalies for creating descriptions of future anomalies. The project will demonstrate our method in health/environment monitoring applications, and its adoption will save resources, money and lives.Read moreRead less
Deep analytics of non-occurring but important behaviours. This project aims to build a systematic theory for the deep analytics of complex and important occurring and non-occurring behaviours. Behaviours that should occur but do not take place, called non-occurring behaviours (NOB), are widely evident but easily overlooked, such as missed important medical treatments. While often occurring behaviours are focused, such NOB may be associated with significant effects such as a threat to health. Thi ....Deep analytics of non-occurring but important behaviours. This project aims to build a systematic theory for the deep analytics of complex and important occurring and non-occurring behaviours. Behaviours that should occur but do not take place, called non-occurring behaviours (NOB), are widely evident but easily overlooked, such as missed important medical treatments. While often occurring behaviours are focused, such NOB may be associated with significant effects such as a threat to health. This project expects to fill the knowledge gaps in representing, analysing and evaluating NOB complexities and impact, with significant benefits for the evidence-based detection, prediction and risk management of covert NOB applications and their important effects.Read moreRead less
Deep Interaction Learning in Unlabelled Big Data and Complex Systems. This project aims to effectively model intricate interactions deeply embedded in unlabelled big data and complex systems, which are often hierarchical, heterogeneous, contextual, dynamic or even contrastive. Learning such interactions is the keystone of robust data science and for realizing the value of big data but it poses significant challenges and knowledge gaps to existing data analytics and learning systems. The expected ....Deep Interaction Learning in Unlabelled Big Data and Complex Systems. This project aims to effectively model intricate interactions deeply embedded in unlabelled big data and complex systems, which are often hierarchical, heterogeneous, contextual, dynamic or even contrastive. Learning such interactions is the keystone of robust data science and for realizing the value of big data but it poses significant challenges and knowledge gaps to existing data analytics and learning systems. The expected outcomes include new-generation theories and methods for the unsupervised learning of complex interactions in real-life big data, which are anticipated to enable the intrinsic processing of big data complexities and substantially enhance Australia’s leadership in frontier data science research and applications. Read moreRead less
Knowledge discovery from data in the context of prior beliefs. This project will invent user-centric technologies for discovering knowledge from data that are distinguished by taking account of the user's beliefs, enabling more useful discoveries to be made. This project will also invent methods that identify the relative potential value of those discoveries, helping the user derive greater value from their data assets.