Klemens Reckfort

Level Design - Game Programming - Game Design

Home | Events | Own | About

Speech Recognition in VR (2017)

Designing a Level Editor For Virtual Reality With Speech Recognition

Interaction with Objects in the Virtual Reality is often Realized by Controllers specifically designed for this Environment. But those Controllers have Constrained Possibilites when Complex Information or Specific Orders have to be Sent to the Machine. The Focus of this Prototype is the Realization of Complex Speech Recognition in VR on a Local Machine.


About The Game Project:

Game:

Tool for Prototyting in VR

Date:

December 2016 - February 2017

Game Engine:

Unity Engine 5

Achievements:

Building my first Project and Toolset for the Virtual Reality

Using Grammar XML and Speech Recognition

Developed a Prototype to try out New Ways for Design Processes for the VR

Nominee for the VR Industry Award at VR NOW Awards 2017

For the Speech Recognition I used the Microsoft Speech Recognition Engine on a local machine, no AI learning model is involved here.

My Tasks:

Designing and Developing the whole Project

Developing a Bachelor Thesis to Answer the Question if Speech Recognition is a Valuable Interaction Tool for the VR


Moving Objects:

Move Objects Freely or Snapping on a Grid, or just Tell them Where they shall Place Themselves.

Rotating Objects:

Rotate Objects Around any Axis Local or Globally, or just Tell them Where to Look At.

Scaling Objects:

Scale in any direction or tell the Object to Reset the Scaling.

Placing Objects:

Navigate through the Asset Folders with Speech, No More Gritty Pointing at UI in a 3D Space makes building in VR Comfortable.

Setting Makros:

Densing down Complex, Chained Orders to one Keyword makes things easier for now.

Bachelor Thesis:

Here you can Download my Bachelor Thesis I made with this Project. It is only available in German though.

Download Bachelor Thesis

Feel free to take a Look at my Projects:

2025 - Klemens Reckfort
Impressum | Datenschutz