How, What and Who in Human Communication: Movement of Face and Voice. The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages ....How, What and Who in Human Communication: Movement of Face and Voice. The aim of this project is to identify the essential characteristics of tone, affect, and identity from face and voice using a combination of signal processing, biological, and behavioural techniques in order to develop a comprehensive model of auditory-visual speech processing and communication. This research will significantly improve understanding of the basis of auditory-visual perception and production in tonal languages and in affective communication, facilitate links between neurophysiological processes and auditory-visual speech processing; and contribute to applications in automatic person recognition, automatic speech recognition, text-to-speech systems, and talking head aids for the hearing impaired.Read moreRead less
Special Research Initiatives - Grant ID: SR0354596
Funder
Australian Research Council
Funding Amount
$20,000.00
Summary
Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researche ....Perception and Action in Auditory Scenes (PAAS): Neural, Behavioural, Computational and Mechanical Systems. Auditory scenes are temporal and ephemeral yet pervasively influence human life. How humans negotiate such scenes has not been solved, a fact highlighted by attempts to build machines to respond to speech, warnings etc., in real-world situations with room reverberation, different talkers, and background noise. No one discipline can solve such problems. In this network outstanding researchers from physical, medical, human, and social sciences with interests in speech, music and audition will provide insights into how humans and machines localize, recognize, interpret and produce auditory events, and advance frontier technologies, e.g., automatic speech recognition, hearing prostheses, auditory monitoring/warning systems.Read moreRead less
Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research wi ....Filters reveal what flicker conceals: temporal processing in the human visual system. I have recently discovered a new form of camouflage using 10Hz luminance flicker. This project will quantify this effect and examine the extent to which it generalises across colour and spatial dimensions and to video sequences depicting natural scenes. This information is expected to provide foundational information to technologies relating to national security that rely on visual concealment. This research will examine the extent to which filtering out these camouflaging frequencies enhances our sensitivity to low temporal frequency information. This decamouflaging aspect of my research is expected to improve the clarity of digital video-based technologies including ultrasound, educational, info-tainment and defence applicationsRead moreRead less
Reading facial expressions from real and virtual humans. This project aims to advance understanding of human emotional communication and improve human rapport with the virtual humans and avatars that are rapidly infiltrating our social world. Using two unique stimulus sets - naturalistic human expressions and highly realistic virtual faces - together with powerful genetic, experimental, and individual differences designs, the project expects to answer previously intractable questions in emotion ....Reading facial expressions from real and virtual humans. This project aims to advance understanding of human emotional communication and improve human rapport with the virtual humans and avatars that are rapidly infiltrating our social world. Using two unique stimulus sets - naturalistic human expressions and highly realistic virtual faces - together with powerful genetic, experimental, and individual differences designs, the project expects to answer previously intractable questions in emotion science, as well as deliver tangible outcomes, such as new psychological tests to better understand human social connection. This should provide significant benefits, by improving emotion communication and offering a new perspective on how artificial intelligence can best serve human social needs.
Read moreRead less
A Scalable Theory of Behavior Composition for Practical Engineering Models of Human Performance. Minimizing human error and maximizing human performance is a major design goal in safety critical systems. The development of methods for affordable human performance modeling has widespread applicability for evaluating user-system interfaces. The compositional method explored here has been shown to make accurate predictions reduce model development time by an order of magnitude. Large safety critica ....A Scalable Theory of Behavior Composition for Practical Engineering Models of Human Performance. Minimizing human error and maximizing human performance is a major design goal in safety critical systems. The development of methods for affordable human performance modeling has widespread applicability for evaluating user-system interfaces. The compositional method explored here has been shown to make accurate predictions reduce model development time by an order of magnitude. Large safety critical applications, such as military or air traffic control systems, would benefit greatly. The proposed work tests whether the compositional methods will scale to more complex domains. The work will be coordinated with Australian industry, academia, and government research efforts.Read moreRead less
Linkage Infrastructure, Equipment And Facilities - Grant ID: LE0210995
Funder
Australian Research Council
Funding Amount
$100,000.00
Summary
The Creation of an Eye Movement Recording Facility in Queensland. There are countless uses for technology that records visual behaviour; these include reading and cognitive psychology research, ergonomic design, web site usability testing, and evaluation of visual information (for example advertising or in ?virtual? environments). As such, recording eye movements has applications in pure and applied research, and in teaching demonstrations for students.
This application proposes to purchase ey ....The Creation of an Eye Movement Recording Facility in Queensland. There are countless uses for technology that records visual behaviour; these include reading and cognitive psychology research, ergonomic design, web site usability testing, and evaluation of visual information (for example advertising or in ?virtual? environments). As such, recording eye movements has applications in pure and applied research, and in teaching demonstrations for students.
This application proposes to purchase eye movement recording equipment to form a dedicated and truly collaborative facility to measure visual behaviour. The facility would be unique in Australia and would be invaluable to both further understand visual/cognitive processes and how individuals interact with their environments.Read moreRead less
Discovery Early Career Researcher Award - Grant ID: DE190100136
Funder
Australian Research Council
Funding Amount
$385,288.00
Summary
The influence of naturalistic context on visual short-term memory. This project aims to understand visual short-term memory in natural visual environments using a combination of behavioural and brain data. Visual short-term memory is thought to be critical to complex cognitive tasks such as learning and problem solving, but how low-level image context and high-level semantic information influence short-term memory is poorly understood. This project will use advanced computational image processin ....The influence of naturalistic context on visual short-term memory. This project aims to understand visual short-term memory in natural visual environments using a combination of behavioural and brain data. Visual short-term memory is thought to be critical to complex cognitive tasks such as learning and problem solving, but how low-level image context and high-level semantic information influence short-term memory is poorly understood. This project will use advanced computational image processing tools, neuro-imaging, and psychophysical experiments to provide a comprehensive analysis of short-term memory in naturalistic images. The expected outcome is a better understanding of the neural bottlenecks that limit short-term memory, and a model that predicts memory constraints in natural visual environments.Read moreRead less
How human vision separately determines object and scene motion. This project aims to enhance understanding of how people process visual scenes containing multiple moving objects of interest. The project intends to measure human visual performance to determine how the brain processes multiple motion signals simultaneously. Expected outcomes include an increased understanding of how we are able to use an evolving visual scene to distinguish between changes due to self-motion and those due to the m ....How human vision separately determines object and scene motion. This project aims to enhance understanding of how people process visual scenes containing multiple moving objects of interest. The project intends to measure human visual performance to determine how the brain processes multiple motion signals simultaneously. Expected outcomes include an increased understanding of how we are able to use an evolving visual scene to distinguish between changes due to self-motion and those due to the motion of multiple moving objects such as crowded city footpaths and busy roads. The results will improve our understanding of failures to see moving objects in challenging viewing conditions (for example, high density traffic), and inform work in the design of autonomous driving and augmented reality display systems.Read moreRead less
Peripheral and central mechanisms of sensory coding and integration. The research described in this proposal seeks to provide generic answers to fundamental questions about sensory processes, the nature of perceptual experience, and how these are subserved by the nervous system. The study of inter-sensory interactions in perception has the potential to be incorporated into the development of virtual reality-type computer-based technologies. The neurophysiology research will provide basic informa ....Peripheral and central mechanisms of sensory coding and integration. The research described in this proposal seeks to provide generic answers to fundamental questions about sensory processes, the nature of perceptual experience, and how these are subserved by the nervous system. The study of inter-sensory interactions in perception has the potential to be incorporated into the development of virtual reality-type computer-based technologies. The neurophysiology research will provide basic information that has the potential to deepen our understanding, and even enhance possible treatment, of neurological conditions that involve sensory systems.Read moreRead less
Predicting Behaviour from Brain Representations. This project aims to advance our understanding of how perceptual information is represented in the human brain and to link the structure of perceptual brain representations to human behaviour. The project plans to use complementary methods for recording brain activity (human neuroimaging and primate single-cell neurophysiology) and cutting-edge analytic techniques to generate a predictive model of behaviour based on the structure of perceptual bra ....Predicting Behaviour from Brain Representations. This project aims to advance our understanding of how perceptual information is represented in the human brain and to link the structure of perceptual brain representations to human behaviour. The project plans to use complementary methods for recording brain activity (human neuroimaging and primate single-cell neurophysiology) and cutting-edge analytic techniques to generate a predictive model of behaviour based on the structure of perceptual brain representations. It is anticipated that the results will significantly advance the field of cognitive neuroscience by providing a novel empirical framework for understanding how brain representations are predictive of behaviour.Read moreRead less