3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environmen ....3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environments and open up new possibilities for applications in fields such as virtual reality, architecture, and city planning. The proposed 3D diffusion models will also enhance the accuracy of computer vision tasks related to 3D scene understanding, such as object detection, tracking, and semantic segmentation.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE230101058
Funder
Australian Research Council
Funding Amount
$437,254.00
Summary
Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence. Explainability and Transparency are the key values for development and deployment of Artificial Intelligence (AI) in Australia’s AI Ethics Framework for industry and governments. This project aims to build new tools to make the central technology of AI - deep learning - transparent and explainable. Its expected outputs are novel theory-driven algorithms and unconventional foundational blocks for deep learning that will al ....Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence. Explainability and Transparency are the key values for development and deployment of Artificial Intelligence (AI) in Australia’s AI Ethics Framework for industry and governments. This project aims to build new tools to make the central technology of AI - deep learning - transparent and explainable. Its expected outputs are novel theory-driven algorithms and unconventional foundational blocks for deep learning that will allow humans to clearly interpret the reasoning process of this technology, which is currently not possible. It is expected to significantly advance our knowledge in machine intelligence and perception. Due to their fundamental nature, the project outcomes are likely to benefit industry and scientific frontiers alike.Read moreRead less
A Machine Learning Framework for Concrete Workability Estimation . Concrete is the most used construction material in Australia. The project aims to develop a system to measure the workability of concrete in transit in agitator trucks using advanced machine vision and machine learning, and provide a reliable alternative to the current practice of visually testing concrete workability by certified testers. Concrete that fails to meet workability requirements is one of the most frequent reasons fo ....A Machine Learning Framework for Concrete Workability Estimation . Concrete is the most used construction material in Australia. The project aims to develop a system to measure the workability of concrete in transit in agitator trucks using advanced machine vision and machine learning, and provide a reliable alternative to the current practice of visually testing concrete workability by certified testers. Concrete that fails to meet workability requirements is one of the most frequent reasons for rejection at construction sites, resulting in significant costs, waste, and delays. Multimodal data sources will be used to provide a reliable workability estimate in real time, enabling construction teams to identify and rectify workability issues in transit while continuously monitoring the adjustments effects.Read moreRead less
Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with thei ....Shape4D: Modelling the Spatiotemporal Deformation Patterns in 3D Shapes. This research will develop new mathematical methods and algorithms that will enable the use of population-level longitudinal studies to model the spatial and temporal deformation patterns in 3D biological objects. Using novel geometric and deep learning techniques, it will create new methods that will allow the characterization of how the 3D shape of objects deforms with ageing, disease progression and interaction with their environment, and the simulation of spatiotemporal deformations in anatomical organs. Benefits include a better understanding of growth processes, predictive models of how degenerative diseases progress and a computational framework that will assist in designing proper mitigation and intervention strategies.Read moreRead less
Tensor and Hypergraph Methods in Fitting Visual Data. This proposal will put an important class of clustering (extracting data that should fit a geometric model) on a more solid theoretical foundation. This will lead to better understanding of how to certify outcomes, efficiency, reliability etc. The type of clustering under consideration is relevant to many problems in machine learning and computer vision, as well as data mining and a wide variety of other settings.
Visual methods for advanced automation of underwater manipulation. This project will increase the autonomy of underwater robotic systems engaged in intervention and inspection tasks. Such activities are essential for the operation of subsea robotic systems used in offshore industries, scientific exploration and defence. Our approach will improve perception and situational awareness through the principled fusion of multiple navigation and camera sensors. We will use this improved scene understand ....Visual methods for advanced automation of underwater manipulation. This project will increase the autonomy of underwater robotic systems engaged in intervention and inspection tasks. Such activities are essential for the operation of subsea robotic systems used in offshore industries, scientific exploration and defence. Our approach will improve perception and situational awareness through the principled fusion of multiple navigation and camera sensors. We will use this improved scene understanding to effectively plan the motion of vehicles and manipulators through larger and more complex workspaces, enabling semi-supervised and autonomous task execution. Our project will demonstrate these capabilities in real-world deployments relevant to industry and marine science.Read moreRead less
Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world envir ....Intelligent Virtual Human Companions. This research aims to develop intelligent virtual human companions that can seemingly integrate our immediate physical environment and understand their surroundings including people’s emotions, behaviours, actions and interactions. Such a technology will be enabled by leveraging recent advances in mixed/augmented reality technologies, and by developing innovative artificial intelligence and computer vision and graphics algorithms for dynamic real-world environments. Unlike robots, the proposed technology will be low cost, readily deployable and customisable, and will not have any physical limitations or maintenance requirements. It will thus have a wide range of applications from elderly care, healthcare care to educational training.Read moreRead less
Defense against adversarial attacks on deep learning in computer vision. Computer vision applications rely heavily on deep learning, which is highly vulnerable to being fooled by adding subtle perturbations to object/image textures that are imperceptible to humans. This project aims to develop defense mechanisms to detect and remove adversarial patterns from the input images. The project expects to advance knowledge in understanding the vulnerabilities of deep learning, and to design deep learni ....Defense against adversarial attacks on deep learning in computer vision. Computer vision applications rely heavily on deep learning, which is highly vulnerable to being fooled by adding subtle perturbations to object/image textures that are imperceptible to humans. This project aims to develop defense mechanisms to detect and remove adversarial patterns from the input images. The project expects to advance knowledge in understanding the vulnerabilities of deep learning, and to design deep learning architectures that are inherently robust. The outcomes of this project will increase the security and reliability of computer vision by detecting, reporting and nullifying such attacks and will benefit the general public and industry on many fronts.Read moreRead less
Robust and Explainable 3D Computer Vision. Computer vision is increasingly relying on deep learning which is fragile, opaque and fails catastrophically without warning. This project aims to address these problems by developing new theory in graph representation of 3D geometric and image data, hierarchical graph simplification and novel modules designed specifically for deep learning over geometric graphs. Using these modules, it aims to design graph convolutional network architectures for self-s ....Robust and Explainable 3D Computer Vision. Computer vision is increasingly relying on deep learning which is fragile, opaque and fails catastrophically without warning. This project aims to address these problems by developing new theory in graph representation of 3D geometric and image data, hierarchical graph simplification and novel modules designed specifically for deep learning over geometric graphs. Using these modules, it aims to design graph convolutional network architectures for self-supervised learning that are robust to failures and provide explainable decisions for object detection and scene segmentation. The outcomes are expected to advance theory in robust deep learning and benefit 3D mapping, surveying, infrastructure monitoring, transport and robotics industries.Read moreRead less
Personalised Privacy-Preserving Network Data Publishing System . Data sharing has become a driving force for many businesses in industrial sectors. This project aims to develop a privacy preserving network data publishing system that can preserve user privacy in a personalised way while maintaining maximal utility of the published data. To make accurate privacy preservation, this project will design novel learning models to derive accurate users’ correlation and their privacy intention, develop ....Personalised Privacy-Preserving Network Data Publishing System . Data sharing has become a driving force for many businesses in industrial sectors. This project aims to develop a privacy preserving network data publishing system that can preserve user privacy in a personalised way while maintaining maximal utility of the published data. To make accurate privacy preservation, this project will design novel learning models to derive accurate users’ correlation and their privacy intention, develop efficient privacy preserving algorithms to deal with static and dynamic network data sharing. The success of this project will benefit many industries and government agencies to reduce users’ privacy breaches, avoid illegal consequences of sharing data, and enhance these service providers’ service quality.Read moreRead less