work history

Current & Previous Clients

Agile Lens, Australian National University, Goethe Institute, New Art City, Anti-Eviction Mapping Project, Wild, Gray Area, Buzzfeed, Mary Mattingly, Richard Rendering

select CASE STUDIES

[ML Dialogue] LLM Dialogue, including LLM based world interactions for Richard Rendering, 2024

In this demo world, you interact with a character who need to repair her ship in order to get back home. You help her to repair her ship, talk to her, learn the situation, and ask her to help you with the task. Full demo.

[ML, Dialogue] LLM Dialogue via Inworld for Richard Rendering, 2024

In this demo world, you can see a short example of talking to one of the characters, Akira. We didn’t design any of the aesthetics or characters. We implemented the InWorld dialogue system. We also made it so that the character can go to waypoints, and that worked well with the dialogue system. We also integrated inworld and gpt4-0 so that the character can look through her camera and describe what she’s seeing (in this instance, she describes the painting).

[AI, Behavior, Robotics] Robotic Simulator for Grizzly, 2024

We created a highly complex simulation of an excavator. The excavator has ISO controls, and is able to simulate digging in the ground (via the voxel plugin). The excavator is also able to save both articulation and camera data that was used to train an imitation learning model to dig a trench autonomously.

[Music Video, Level Design, Reinforcement Learning, AI Texturing] Music Video for Artist RTyler, 2023

We created a music video for RTyler, using a combination of reinforcement agents and a reskinning with parts of our music video with stable diffusion. The video is meant to represent an advanced civilization that has radically fused biology and computation, and is able to generate all manners of creatures and agents.

[VR, Data Visualization] Climate Data Visualization VR for Australian National University, 2024

We created a VR data visualization for the Australian National University. The program visualizes “guassian splats” and allows the user-scientist to manipulate, scale, transform, rotate and explore the scan. These scans are being used to train a machine learning model to predict how much carbon sequestration different types of terrain achieve.

[VR, Level Design] Christmas Carol VR for Agile Lens, Level Studies, 2023

We created a stage set for Agile Len’s VR production of Christmas Carol by Charles Dickens. We created a Victorian London “level,” a variety of “sets” (like the Scrooge bedroom above) and also experimented with a variety of complex volumetric fog transitions.

[Level Design] Megastructure Studies for New Art City, 2020

We created a series of “megastructure studies” for New Art City, helping them to determine more about what kinds of scales of architectural space are helpful for their platform. The studies were also an advanced survey of importing grasshopper generated forms into the platform.