[← Back to work](https://cheyuwu.com/work/) Project archive2019 # Floating in the sky - VR experience ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/4430345241a6.webp) Client Self Project VR Studio | IDM NYU, New York Original date record 2019/5/1 Type VR/ AR Responsibilities Designer / Developer Contents & work details Client Self Project VR Studio | IDM NYU, New York Original date record 2019/5/1 Type VR/ AR Responsibilities Designer / Developer ## Recognition Deloitte private showcase, 2020 NYC Media Lab Exhibition, 2019 ## Project record ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/dc770c5eaa72.webp) - First person interactive story - Lonely main character grab an umbrella and fly into the sky - He found that the world is still beautiful and fill with hope. - The umbrella symbols dream - Use Sequencer to run the narrative story ## Storyboard 1. Wander on the street 2. Hold and open the umbrella 3. Fly high to the sky 4. Floating from city to country 5. Fly through the forest and birds 6. Land and pass the umbrella to another lonely person 7. A lot of colorful umbrellas floating in the night sky, symbols we should face our dream and feel free to float away to our desire imagination of life ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/b7a0d88853f0.webp) ## Interactions Looking at a point trigger certain animation and generative objects Rotate your head to see around the scenes ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/33987873a8e7.webp) I get an asset from market place that is a slum city to test for my umbrella mechanic at the mean time. ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/85538cdc14d7.webp) *Slum-City – assets in the market I found* ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/1dcbaa1149ec.webp) *Set the pawn with Camera to control the motion* ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/1dfa7ed29c34.png) *Get Serial port signal from ESP8266 then send map it to speed, send osc signals* ## Camera Control & Unreal Blueprint I create a camera on pawn and send the reference to the Umbrella Object, which contains an OSC receiver to get the value from ESP8266. The value will add local offset to the umbrella object, and for each event tick, I calculate the delta between the camera and the umbrella, let actor camera approach umbrella’s position gradually. ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/b7d2c78be5e2.png) *Use Osc Receiver to get speed value from ESP8266* ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/589714331713.png) I add a sound ball in the sky with the background track I made, it have great effect that when you approach certain height in the sky, you will heard the background track become louder and louder. Connects to the external media service when you play. [Open in a new tab ↗︎](https://www.youtube.com/embed/iT4utTc2Brg?version=3&rel=1&fs=1&autohide=2&showsearch=0&showinfo=1&iv_load_policy=1&wmode=transparent) *Current Progress – Control camera follow the motion of umbrella* ## ## Hardware Testing For the second stage, I change my sensor to pressure sensor which allows me to get a feel of holding the umbrella. I think it really have a great difference when the sensor type and hardware match the user experience. ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/6d5cad5519f5.webp) *Use Pressure sensor to control the floating movement* ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/b542d4e4f538.webp) *Use Arduino Mega breakout to transmit the sensor value to MaxMSP through serial port* ## Sound Design The sound track of this work is divided in to four sections - Wandering in the city, Doubting life, Grad the umbrella and fly into the sky and arrival at the dream land, I use String, Bell and Flute to compose a warm melody which express the feeling of the flying experience. ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/79d1f21db8b1.png) Connects to the external media service when you play. [Open in a new tab ↗︎](https://w.soundcloud.com/player/?visual=true&url=https%3A%2F%2Fapi.soundcloud.com%2Ftracks%2F615897153&show_artwork=true&maxwidth=1100&maxheight=1000&dnt=1) ## ## Update and improvement Before the showcase, I update the control module in MaxMSP, use stream and median method to make the accelerometer value smoother. The signal received from Arduino Serial, then run through a slide object, than pass through zl.stream and zl.median, then convert to proper scale, finally send into unreal to control the flying motion of the umbrella. ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/dce85d43dd1f.jpg) I also rebuilt the Mountain landscape, add beach and use the ocean project plugin to make the sea. Besides, I put several event trigger e.g. the dead whale, the tallest tree on the mountain to let users explore the world more freely. ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/9716838dd340.webp) *The Sea and the island* ![Floating in the sky - VR experience](https://cheyuwu.com/static/img/mirror/4f149788bde9.webp) *The updated and sorted blueprint of the floating umbrella* ## **Demo Video** Connects to the external media service when you play. [Open in a new tab ↗︎](https://www.youtube.com/embed/9NZl7HYUQeI) Exhibitions, research & collaborations [Contact the artist](https://cheyuwu.com/contact?work=Floating+in+the+sky+-+VR+experience&from=/project/-LeeLqyqPGuJRybr9psJ/) ## Continue through the work ![Selinko & Remy Martin APP UI Design](https://cheyuwu.com/static/img/mirror/7531d981e357.webp) 03/2015-05/2015 ### Selinko & Remy Martin APP UI Design [https://cheyuwu.com/project/0](https://cheyuwu.com/project/0) ![NCTU Interactive Christmas Tree](https://cheyuwu.com/static/img/mirror/69deb9af2b73.webp) 12/2014 ### NCTU Interactive Christmas Tree [https://cheyuwu.com/project/-L3BB7yLee5Las43HMGh](https://cheyuwu.com/project/-L3BB7yLee5Las43HMGh) ![Chang Gung Memorial Hospital 3D Animation of Graphene-based Cancer Treatment](https://cheyuwu.com/static/img/mirror/2dbfbff383eb.webp) 08/2013 ### Chang Gung Memorial Hospital 3D Animation of Graphene-based Cancer Treatment [https://cheyuwu.com/project/-L3BCgTFdd5Wbetc5KQO](https://cheyuwu.com/project/-L3BCgTFdd5Wbetc5KQO) 1 / 0