Unity Developer: Creative Technologist for Care-full Design lab

The Care-full Design Lab is looking for a Creative Technologist to assist with the Polyphonic Motions and Melodic Motions research projects. This role will involve assisting with the current development of an online application, which transforms physical movements captured via webcam into collaborative artistic audiovisual outputs. The platform is co-designed with and used by artists with intellectual disability and has three key aims:

1. To create an inclusive and playful online video space for remote collaboration
2. To enable new creative and aesthetic possibilities through uses of digital media
3. To decentre standardised interactions and creatively embrace unique differences in movements, motor skills and coordination, aided by machine learning

The role will see you continue the development of our current, documented prototype. Presently, the prototype uses Unity with Agora and PoseNet to connect users via video call online and respond to their motions.  This role would suit someone with programming and software development skills in Unity across the two inter-related areas below. If you have experience in one or both areas, we encourage you to apply:

1. General development

Required: Unity Engine development experience for iOS, Android, Mac, and Windows platforms

Desirable: AR/XR, Webcam Interaction, Machine Learning, TensorFlow, PoseNet, Pose Estimation, OpenCV, AudioHelm, FMOD Experience

2. Networking / Multi-User

Required: Unity Multiplayer / Networking Development Experience, Webcam / Video Chat Development Experience, Back End User Authentication and Security Experience

Desirable: WebRTC, Heroku, Photon, Playfab, Agora Video SDK, Amazon AWS (Cognito, Kinesis, Amplify, Media Services) Experience

Key Responsibilities

• Continuing the development of the real-time browser based video experience: focusing on authentication, implementing UI assets, video scaling and further refinement of particle/shader effects
• Collaborate on design with RMIT team
• Adjust + optimise existing prototype
• Testing and evaluation
• Documentation of development + planning architecture
• Regular collaboration + communication through meetings
• Technical support as necessary – e.g. at participatory workshops with members of Fog Theatre and the RMIT Research Team

Timeframe

• Approximately 2-3 days per week (with some flexibility) for 1-2 months between August 2022 – October 2022, with a possibility for extension. This is very flexible!
• A schedule will be defined jointly at the outset of the collaboration
• Role is based in Melbourne but remote engagement in Australia could work with the right person.

Payment

Pay will be offered at the standard RMIT Research Assistant casual rate of $47.66/hr + 10% superannuation.

Application requirements 

• CV and Portfolio (sample of research and creative work)
• Cover letter describing your interest in this project and any relevant background experience
• Succinct response to the selection criteria

We welcome you to submit your application to the team:

Alan (alan.nguyen@rmit.edu.au), Kate (kate.geck@rmit.edu.au), and Jaz (jaz.hee-jeong.choi@rmit.edu.au) 

no later than 19 July 2022 6pm. Please include ‘MOTIONS Creative Technologist application’ in the email subject. 

Selection criteria

1. Demonstrated experience with programming and development in Unity.
2. Strong capacity to apply technology to creative contexts, particularly those that involve visuals, music, sound, and movement.
3. Ability to work both autonomously and collaboratively in a small team with diverse disciplines and backgrounds.
4. Demonstrated respect for working with people of diverse backgrounds and/or abilities

The Project – Melodic/Polyphonic Motions

The two interrelated projects will involve the co-design of an interactive platform for real-time kinetic audiovisual performance by artists with intellectual disability; as well as the co-creation of a movement-based performance work using this platform. Members of the RMIT Care-full Design Lab will work with artists from Fog Theatre in Melbourne. 

Melodic Motions will challenge existing technologies that demand adherence to standardised motions, and instead creatively embrace involuntary movements and unique differences in motor skills and coordination, aided by machine learning.

Polyphonic Motions will focus on enabling possibilities for real-time collaboration, further exploring participatory and engagement opportunities with diverse artists and audiences.