Interdisciplinary PhD scholarship in Computational Modeling of Visual Communication

This PhD project will be part of the larger VSLT project which aims to achieve a breakthrough in the computational analysis and simulation of visualcommunication, with a special focus on sign languages (SLs), in which communication is entirely visual, as well as multimodal communication, in which speech typically plays a primary role but visual cues often have an important supporting role. The highly interdisciplinary project involves researchers in computer vision and machine learning, in linguistics specialised in multimodal communication and sign language, and in computer graphics. 

The PhD project will focus onnon-manualcommunicative signals such as facial expressions, eye gaze direction, head movements, and body poses. It will create datasets rich in non-manual communicative signals both for Catalan Sign Language (LSC) and for spoken Catalan, developing machine learning based annotation, creating predictive models of the use of non-manual communicative signals and extending the generative capacity of conversational signing avatars by these means. The research may also include comparison with models of visual communicative signals in Sign Language of the Netherlands (NGT) and in spoken Dutch, in collaboration with researchers at the University of Amsterdam.

This position includes a teaching commitment load of 45 hours per academic year within engineering degrees of the UPF.

Topic: Computational analysis and simulation of non-manual communicative signals in sign languages and multimodal communication.

Requirements: 

Computer science degree or similar qualification, with interest in (computational) linguistics. Knowledge of machine learning, computer vision and 3D graphics is highly desirable. Alternative qualifications can be considered provided the candidate shows strong technological knowledge and appropriate linguistic background. Catalan/LSC knowledge is not required, but is an additional asset; otherwise, acquisition of basic proficiency in these languages will be supported by the project.

Admission in the PhD program of the Department of Information and Communication Technologies at UPF is a prerequisite to enjoy the contract.

Starting date (planned): September - October 2023 

Application deadline: Conitnuously open until a suitable candidate is found

Gross yearly salary:basic salary 1.680€/month per 12 months, to be increased in the 3rd and 4th year of the PhD, up to 2.020€/month in the final year; depending on the circumstances and qualifications of the candidate a higher salary may be negotiable.

This position is co-funded by the PhD fellowship program of the Department of Information and Communication Technologies at Universitat Pompeu Fabra (DTIC-UPF), and the María de Maeztu Strategic Research Programme at DTIC-UPF on Artificial and Natural Intelligence for ICT and beyond. Its benefits and conditions are available at: https://www.upf.edu/web/etic/predoctoral-research-contracts. 

For application or further information, contact: Josep Blat, UPF-GTI, mail:  josep.blat@upf.edu

More information about the María de Maeztu Strategic Research Programme at DTIC-UPF on Artificial and Natural Intelligence for ICT and beyond:https://www.upf.edu/web/mdm-dtic .