This proposal aims to investigate the ability to acoustically conform
the sound in the Experience to the environment that the device is
placing it in. All AR technologies (handheld and head-worn) currently
available have restrictions on the field of view that they have with
their ability to be aware of the room that the device is in. Whether
this is through inside-out tracking or stereo cameras capable of depth
perception. Mobile AR is able to detect surfaces and allow movement
around AR objects with the double-camera array that is included on
iPhone X and AR-ready iPads (2017). Hololens, Meta and other AR headsets
are able to detect the extent and depth of a room. Lower end mobile
devices with only one camera are still able to detect surfaces, but do
not have the same level of depth detection.
This work will investigate the efficiency and efficacy of some
capture or calibration of the space to use this data for advanced
acoustical rendering (similar to how a user must calibrate a VR setup to
ensure the external cameras ‘know’ where the headset is in space). This
type of calibration can be either stored on a mobile device to be used
for processing or a real-time geometry-based rendering algorithm can be
executed on non-tethered devices. Currently, physical rendering is only
possible with a small number of software spatialisers (such as
SteamAudio and NVIDIA).
This idea could be expanded to:
- Sonification of the world visible through the AR window
- Haptic feedback in AR / Mobile AR
- Understanding and modelling the contents in the AR window
Supervisory team:
- Dr Parisa Eslambolchilar (School of Computer Science and Informatics), eslambolchilarp@cardiff.ac.uk
- Dr Daniel Finnegan (School of Computer Science and Informatics), finnegand@cardiff.ac.uk
- Prof Dave Marshall (School of Computer Science and Informatics), marshallad@cardiff.ac.uk
What is funded
Self-Funding Students Only
Eligibility
Academic Criteria:
A 2:1 Honours undergraduate degree or a master's degree, in computing
or a related subject. Applicants with appropriate professional
experience are also considered. Degree-level mathematics (or equivalent)
is required for research in some project areas.
Applicants for whom English is not their first language must
demonstrate proficiency by obtaining an IELTS score of at least 6.5
overall, with a minimum of 6.0 in each skills component.
How to Apply
To apply please complete the online application - https://www.cardiff.ac.uk/study/postgraduate/research/programmes/program..., select the ‘self-funding’ option, and state the project title and supervisor name.