Visual Semantic Role Labelling
Type: Bachelor CS/EE/HMI
If you are interested please contact :
Creating graphical resources, such as 3D scenes or animations requires a good level of knowledge of 3D modelling applications and/or programming. Despite the usefulness of such resources, as in advertising, theatrical productions or education, they (the graphical resources) are difficult to create for people with low levels of computers literacy.
This is we’re we need your help to design parts of a system able to read natural language descriptions and generate 3D or VR animations from them.
You can choose to work in one of two parts of this project:
- Sentence simplification using deep learning.
That is to remove visually irrelevant tokens from a sentence and provide a shorter version easier for further processing.
- Visual semantic role labelling using deep learning
That is to assign visual roles (actor, action, object, manner, etc.) to each token in a sentence.
Basic understanding of deep learning approaches is highly recommended, but most important is an interest in natural language processing and the willingness to learn its related concepts during the research project.