Story Teller
Story Teller is used to easily and rapidly lay out events within an experience. Narrations, Unity Events, and object comparisons are all easily managed through components with several variations and controls to create custom experiences.
Branching logic is supported through comparisons in values on objects, triggering different transitions as designed. Events can easily be repeated, canceled, or paused as required. This tool leverages reflection, allowing it to invoke methods on objects as well as read changing values at runtime on classes unknown to the Story Teller. This allows the tool to be independent
Puppets and Anims
The Puppet and Anim system is an alternative to animation through animators and animation clips. The overall advantage to Puppets and Anims over traditional animation is that objects can be interacted with and values altered at runtime without conflicting with baked keyframes.
Since the animation driven by anims is scoped efficiently, transforms can change hierarchies or object can be added to the hierarchy with ease.
Stage Management
Stage Management is a Unity tool which combines scene load operations and allows processes to occur before or after transitions. Stages are called to load from a component which references an asset which points to the required scenes. These stage assets also determine which scene is set to active, and can also contain a set of stage properties which can be grabbed by subscribing components.
A common use case of stage properties is to have a screen fade between scene loads. Stage properties such as “fade color”, “fade in time” and “fade out time” are grabbed by components responsible for the screen fade and applied as needed.
Prostate Cancer AR
Prostate Cancer AR is an iPad application for internal use within a company amongst sales representatives. The application incorporates an in-depth user interface along with interactive augmentations to navigate through content.
Coupled with a branded AR target, the app displays the different stages of prostate cancer and visualizes the chemical process of treatment in two pharmaceutical solutions.
Technologies used
Vuforia, Unity3D, c#
Immunopathogenesis Booth VR – Patient Experience
This is an Oculus VR experience featured for the American College of Rheumatology 2018 annual convention. The VR application served to educate and evangelize the public on the realities of certain illnesses and the cellular conditions which cause them. Participants ranging from scientists to students easily entered the experience which was divided into three submodules.
Two patient empathy experiences give users a feel of what it is like to live with rheumatoid arthritis and psoriatic arthritis. Vibrations, narrated testimonies, and the evocative storytelling unfolding in front of the users all played a part in conveying what life with these ailments. A cellular level deep dive, where the users are microscopic, is also featured to show the behavior of immune cells under the circumstances of RA and PsA. In addition to the mechanism of disease being clearly animated, users paired JAK proteins to the cellular receptors responsible for sending bad signals to the nuclei.
This suite was later converted for Oculus Quest standalone, iOS mobile with gyroscopic movements, and WebGL.
Technologies used
Meta Quest, standalone, iPad, Unity3D, c#, WebGL
LTEN Scavenger Hunt – AR mobile application
The LTEN Scavenger Hunt is an augmented reality IOS and Android application published on respective stores for participants at the LTEN Conference 2018. Responsive design and graphics optimization was a must as the application’s targets we’re as many mobile devices as possible.
Different learning techniques and adult learning principals were displayed on AR posters found through out the conference. Upon finding all of the posters, users could submit their information to a database in order to win a prize.
Technologies used
AR Kit, Unity3D, c#, SQL, XCode, ASP.Net
Internal Disease VR
This is an application for HTC Vive and Oculus VR where you travel through the intestines to view various states of diseases. The experience includes interactions such as taking pictures of disease features, answering questions, grabbing and observing objects.
The purpose of the application is for internal use at a pharmaceutical company to observe the differences in Crohn’s disease and ulcerative colitis close up. After the users encounter the effects of each disease they are asked to determine which disease a patient has based on their symptoms and experiences.
Technologies used
HTC Vive, Meta Quest, Unity3D, c#
Procedure Simulation – iPad app
This iPad app distributed internally to an organization trains sales representatives on the steps of a medical procedure involving a device.
The main menu allows for users to navigate to any part of the experience at any time. Sections can be switched to interactive or automatic play-through modes, for quizzing users or narrating through the steps required. The ability to easily jump to any portion of the application and learn a particular part made it effective and easy to use.
Technologies used
Unity3D, XCode, c#
Lymphoma VR
This Meta Quest experience built in Unity seamlessly brings players between multiple mechanism of disease simulations. The application blends post processing effects and features several interactive learning experiences.
After exploring different diseases users then explore the mechanism of action for a product and how it disrupts cellular signaling.
Technologies used
Oculus VR, Unity3D, c#, Amplify Shader Editor
Escape Room – Multiplayer VR
Escape Room VR is a multiplayer experience used for company team building and trainings. It is setup to handle remote gameplay setup with an admin page, as well as local setups at conferences and meetings. Imbedded beneath the experience is a framework of tracking to record users results when answering questions.
This product brings people together through VR to collaborate in an environment and leverage the educational benefits of gaming. Players are presented with tasks and asked to solve problems together involving questions based on product prescribing information and mechanism of action.
Technologies used
Meta Quest, Unity3D, Photon Unity Networking, Substance Designer, Amplify Shader Editor
Smart Construction VR
Smart Construction VR is an application enabling site managers of construction and digging operations to collaborate together and make virtual inspections on geospatial digital twins. This application is part of a suite of construction solutions with the ability to create industry accurate measurements against geospatial survey data gathered by drones. Realtime collaboration allows users to meet together at a virtual job site in a single multiplayer session.
Where it would be impossible for them to get eyes in the middle of a river or high in the sky, users can now virtually go where it would be too dangerous to or impossible otherwise. Smart Construction VR improves productivity, increases safety and lets site managers travel to many places in one day without leaving the office. As a construction industry wide initiative to usher in a new generation of employees, this solution additionally addresses the three challenges of earthworks being dirty, dangerous, and difficult.
This product was developed with a varying team size over the course of 3 years. In the last year when the team size reduced to me alone, I took on more product and support efforts along with engineering crucial feature development. This concluded the IP transfer through trainings, product support, and a speaking engagement at CSPI, the largest construction conference in the APAC region.
Product site
Technologies used
Meta Quest, Unreal Engine, Cesium for Unreal, Epic Online Services
Data Visualization
The Data Visualization demo is a series of interactive renderings of information for an installation space. Created with Unity 3D, the various systems all integrate with information gathered from a database and can be controlled through a web admin.
Technologies used
Unity3D, c#, JSON, SQL, ASP.Net