Procedurally Generated Mixed-Reality Storytelling

Imagine being able to describe a dream and see it come to life visually in front of you in full 3D. Imagine then being able to make changes to and produce visual art and animation that you might not be able to paint or draw yourself. This project aims to create a tool to do exactly this, allowing children to bring their stories and ideas to life by simply describing them.

Our project is a storytelling platform for children that utilises interactive technology to enhance their creativity while supporting their learning and literacy. The platform allows children to tell stories which unfold visually as they write them, allowing them to experience it in a range of media, from video and AR to immersive VR formats. It's an innovative and engaging way for children to explore their creativity and learn through interactive storytelling.

This project is designed to be inclusive from the outset, allowing stories to be told in the means and language the child is most comfortable with. By mixing visual technologies with translation and language models we can bridge communication gaps and drive storytelling in the creative industry forward.