Julian Karlbauer

Julian Karlbauer

Applied Researcher & Engineer. My research interests lie at the intersection of spatial computing, digital fabrication, and intelligent interactive systems, with a focus on empowering and augmenting unique human abilities using an applied, systems-focused, and interdisciplinary approach. Expert in XR Software Engineering, and building research prototypes for industrial scale, with experience at Siemens, Audi, and Silicon Valley startups.

Selected Projects

Industrial Spatial Interfaces

Interactive Digital Twin for Metal 3D printers enabling in-situ anomaly visualization and CAD overlays.

2023 Unity/C# Digital Twin AR Foundation

VRSketchIn

A VR sketching application using 6DoF-tracked pen and tablet devices, combining mid-air and surface sketching.

2020 OptiTrack Unity/C# 3D Authoring

MixGenXR

Fusing digital and physical spaces using 3D Generative AI for intent-aware spatial interactions.

2024 HoloLens 2 3D GenAI Unity/C# Python

Supernumerary Hands

Multi-hand interaction in XR supporting various mappings, hand-recording, and spatial placements.

2021 Meta Quest Hand Tracking Unity/C# User Studies

Generative Music

AI Research tool for Spotify analysis and generation of music using OpenAI Jukebox.

2022 Python Open Ai HPC clusters Tensorflow

Foveated Blue Light Filters

Eye-tracked filtering of blue light in VR to improve user well-being without perceptual notice.

2019 Eye-Tracking Unity/C# GLSL User Studies

XRTinkr

Algorithmically generating timber frame constructions for Tiny House concepts in XR.

2023 Algorithms Meta Quest

VRCreatIn

3D Content Authoring in VR

2024

Academic Publications

GOOGLE SCHOLAR
2024

VRCreatIn: Beyond Ideation to 3D Modeling Lighting and Texturing

T. Drey, N. Rixen, J. Karlbauer, and E. Rukzio

ACM MUM '24
2022

Analysing Digital Eye Strain in VR Head-Mounted Displays

T. Hirzle, F. Fischbach, J. Karlbauer, et al.

ACM TOCHI Journal
2020

VRSketchIn: Pen and Tablet Interaction for 3D Sketching in VR

T. Drey, J. Gugenheimer, J. Karlbauer, et al.

ACM CHI '20