Skip to main content

Week 10/FINAL

     To finish up the 3D view I got AB's unreal file that has his Gaussian splats. in order for it to run I had to install the same version of UE5, the luma AI plug-in, as well as the Cesium for Unreal plugin. after I was able to open the file I tested the first-person controls. in the original file, the first-person character does not spawn so I duplicated the level and added a player start, then it spawned normally. then I enabled the pixel streaming plug-ins and updated the SDK driver to match the UE5.3 requirements.

    Next, I built touchscreen controls, under the miscellaneous tab when you right-click the unreal library there's a blueprint for the touchscreen, once I added that I used the basic joystick icons, this took a little bit of guesswork as you have to position icons based of off pixel coordinates, but both joysticks are roughly 135 x and - 135 y and vice versa so they sit in the bottom two corners of the screen. to make them functional you have to assign the input it's interpreting, so the bottom left joystick is set to function like a mouse, it controls the pitch and yaw of the camera. this is really simple, you can pick what controls you want the joystick to have from a drop-down menu or by tying it in. The right joystick is set to the "w" key, so viewers look around with the right, and walk that direction with the left. 

Joystick in action,  bottom left

    After it was packaged I repeated the same steps from the pixel streaming test

    windows>project>samples>pixelstreaming>webservers>get_ps_servers> signaling web server>platform scripts>cmd>run_local then back to Windows to run the batch file with the network port parameters.  I tried this at home and was able to get the touch screen working on my phone with no lagging, and was able to meet with the group to test it on multiple devices. we added a link to the Westphal icon on the map that connects to the server, which is accessible from the main website. this method can stream to any device, the packaged file runs on Windows but since this runs over wifi we were able to get the file running on an iPhone, which opens up options for the final presentation. 

Comments

Post a Comment

Popular posts from this blog

week 7/8

      The main issue we've been dealing with is connecting our Google map to a 3D view. The map does not have the same features as a Google Map as it is sort of an offshoot of Google Maps, so it has no navigation feature. additionally, the issue Jasmine has noticed is the lack of customization in the programming, she can't edit the code of the map in order to make the locations into buttons which can then be connected to the code for the 3D application.      Professor Diefenbach helped us find documentation for click events, by adding a listener to the map icons, so when an icon is clicked, there is a way to communicate that information to the 3D app. The event listen will execute code upon detecting a click, that can manipulate the 3D location, so in this instance, it will change the coordinates used in the "fly to" command. Documentation on click events here . The addition of this code requires an API key, which is explained here . since we are using the information
Post a Comment
Read more

week 5/6

      S o week 5 just wrapped up, Jasmine has the website built, but it's not live yet and so far there's no 3D navigation. Its looks like NeRFs are a no-go, so we've decided that adding a sub-screen on the main navigation that will show a 3D view along with the map.  rough thumbnail     for the 3D/realistic view I've been looking and CesiumJS, there's a tutorial on how to embed a Cesium widget onto a webpage that looks promising. ideally, the cesium widget would be connected to the Google Maps data, allowing the user to click on a location and get a view of what that area looks like. This should be achievable through cesium 3D tiles Cesium does not have a built-in street view, but I believe the effect we're looking for will be achievable with the "fly to location" option.  Alternately, google has documentation for a duel view map that shows the standard map format alongside Google Streetview. this option may be quicker as the code is already built and
Post a Comment
Read more