Jump to content
Chuc

Devblog - Out and About

Recommended Posts

Out & About

May 2, 2017

Trip to the The Tank Museum at Bovington

 
Squat_Logo.jpg
 
Hi Squaddies,
 
Do you like tanks? We like tanks.
 
While we gear up the development of more war machines, we thought we would share an insight into a new workflow we are refining. In a bid for continual improvement, we have employed photogrammetry, which is the process of recreating objects in 3D from a set of photographs.
 
By taking photographs from as many different angles as possible, software can find common points in each. Through triangulation, specialist photogrammetry software can then calculate the position of these points. Do this many, many times, and you end up with with a 'Sparse Point Cloud' vaguely defining the shape of the object photographed. Interpolating these results yields a 'Dense Point Cloud', and from this, a high-resolution 3D mesh and texture can be produced.
 
T-72_PointCloud-1.jpg
 
Development of tanks for video games is a time-consuming process. Especially if, like us, you care about accuracy. Insuring proportions, shapes and details are correct can be difficult and drawn out. This is usually done by 'eyeballing' reference imagery and matching parts to known dimensions. A lucky artist will have access to some blueprint material, but these can often be incorrect or unhelpful.
 
To alleviate this issue, we concocted a plan. A plan to ensure accuracy and reduce development time. We headed out to The Tank Museum in Bovington, UK. What awaited us here was a large array of distractions in the form of a plethora of armour. Nonetheless, we set our sights on our targets - an East German T-72M1, a Challenger 2 V5 Prototype, and a Russian T-62.
 
Our intention was to scan these tanks, with a view to replace our entire 'block out' phase of development. Blocking out is the process of establishing general proportionality in a rough model before embarking on the process of subdivision modeling. Moreover, although these are not the exact models we need, only small modifications will need to be made. A 3D scan would provide us with all of these proportions to a significant degree of accuracy, in a fraction of the time.
 
MenAtWork.jpg
 
We set up our tripods and got to work, marching up and down ladders to capture the full glory of these beasts. We shot them a good 1600 times, capturing approximately 500 images of each. DSLR cameras with wide angle lenses were essential here - allowing us to get in close and capture a lot of tank per shot. A low ISO of around 100 and an aperture above f10 also increased the image quality and thus the software's ability to track key points.
 
After a lengthy day of photography, it was time to retire back to our Airbnb, crack open a few beers and spend the night processing images and feeding them to RealityCapture. Our laptops churned away, and after a few hours, we got our results:
 
T-72_Scan-1.jpg
T-72_Scan-2.jpg
T-72M1 Scan Result
 
ChallengerII_Scan-1.jpg
ChallengerII_Scan-2.jpg
Challenger II Prototype Scan Result
 
T-62_Scan-1.jpg
T-62_Scan-2.jpg
T-62 Scan Result
 
Considering we aimed to capture the basic shapes, we were taken aback with the quality and the complexity of the results. The level of detail captured will further aid accuracy and detail replication.
 
However, we did not stop there, taking the opportunity to visit another T-72 in the workshop. We tentatively dangled our rented equipment into the maw of the tank, withdrawing a set of interior photospheres. These will provide excellent reference material and are interesting to view:
 
 
There are some considerations to be made when undertaking photogrammetry. Lighting must be consistent throughout the shoot, to aid in the software matching points. This is especially important if using the texture information in-game, so the colour and exposure remain uniform. Ideally, we would want the lighting to be entirely neutral - so not to conflict with the physically correct lighting.
 
While we were not aiming to use these models in-game but purely as a reference, we did take the opportunity to do some experimentation with neutralizing the effect of lighting in the museum. The technique, we reasoned, could be especially useful when applied to environment assets. This could be achieved by taking a high dynamic range photosphere of the museum, using a camera mounted on top of the relevant tank.
 
To accomplish this, we used a Nodal Ninja panoramic head and a 10.5mm rectangular fisheye lens. Then seven brackets were shot with 1 EV increments, in 8 different positions. This technique was then processed and stitched, ultimately producing a high dynamic range, 360 view photograph.
 
 
Using this as an environment map in 3DS Max and utilizing a photograph of a 'Chrome Ball' to correctly align it with the model, a lighting map can be baked out using the mental ray renderer. Dividing this in Photoshop, should, in theory, produce a texture map with the lighting removed.
 
This did not work for us in practice this time, but the setup did allow us to capture the T-72 interior. We identified a couple of areas of an issue with this process. Firstly, you cannot recover colour data where the exposure is too low. Secondly, artificial lights do not translate well in this manner. Shadows produced by mental ray were soft where they should have been sharp; this is likely due to reduced dynamic range and lack of directionality.
 
Properly balancing light levels, especially around the tracks and areas illuminated by spotlights, was impossible. Incorrect exposure destroys details in scans, but we found a stop-gap fix of using mixed exposure settings. Our proposed solution for future scans is to take three brackets of exposure and collapse these into 32-bit TIFF files. This will give the software a greater range of detail to work with, and tone mapping the resultant texture will yield properly exposed textures. The issue of spotlight shadows could theoretically be solved by probing the spotlight luminance individually and placing lights in 3DS Max, but this is beyond reasonable for our process.
 
Overall, our trip was a big success concerning results and experience. We are looking to return to Bovington to employ this technique again in the future. We thoroughly enjoyed our time at The Tank Museum and would like to thank them for having us. They run an excellent charity dedicated to preserving the history of these magnificent machines, along with the people who crewed them. A few of us will be visiting again in June for Tank Fest, and we hope to see some of you down there!
 
middle_separator.png
 

Vancouver Range Day


 

 
In an attempt to do more 'hands-on' research for our Animation and Game Design team, the team decided to take the opportunity to go to a local Vancouver gun range! Our very own Military Adviser and Game Designer SgtRoss was also in town, flying all the way up to Vancouver from Texas, so the experience at the range was just as enlightening as it was fun.
 
The Range Langley was the place that hosted us for the day, an indoor 25m long range that accommodated all kinds of firearms and shooting needs.
 
langley_therangelobby.jpg
rangeday2.jpg
 
We also were treated by a couple of friends of OWI, Original Project Reality Founder 'Eggman', and his friend Jan. They were kind enough to provide a lot of the firearms we would shoot during the day, as well as the ammunition.
 
rangeday1.jpg
rangeday4.jpg
Project Reality Founder 'Eggman' grinning with a SKS with the bayonet out
 
The team that was present (Chuc, Merlin, Norby and SgtRoss) got a lot of valuable first-hand experience of shooting firearms, but also discussing in-game applications and also seeing how a trained veteran expertly handle firearms. Reference material shot on the day as well as a study of the target groupings shot at various CQB ranges will provide the team with a valuable touchstone for firearms handling in Squad for the upcoming new animation system.

Offworld Out.

 

Share this post


Link to post
Share on other sites

That's some exciting stuff! Nice seeing Eggman there as well, great devblog!

 

Share this post


Link to post
Share on other sites

Love the music that was played in shooting range! Hope that devs got some good info and good fun from that experience...

Share this post


Link to post
Share on other sites

This was cool to see. Thanks for putting it together.

Share this post


Link to post
Share on other sites
Posted (edited)

Wow! Those vehicle scans are way more detailed then i could have imagined, especially the textures. Super cool. :D

Edited by Tomato-Rifle

Share this post


Link to post
Share on other sites

is there no chance of using that technology for textures? id say ground/building textures are the weakest aspect of squad atm (I accept the perf issues, but Id like to see improvement eventually) 

Share this post


Link to post
Share on other sites

oh yeah.....tanks

 

 

Share this post


Link to post
Share on other sites

Was good fun. Special thanks to my mate Janman for providing some awesome weapons.  Had a blast, could shoot 5.56 all day long, we hit a local restaurant aftwerward and had burgers and milkshakes.

 

Guns, Games, Burgers, Milkshakes. Nobody wounded. Good day in man-land :P

 

egg

Share this post


Link to post
Share on other sites
5 hours ago, IINAYDOGII said:

is there no chance of using that technology for textures? id say ground/building textures are the weakest aspect of squad atm (I accept the perf issues, but Id like to see improvement eventually) 

 

The problem is processing of this data.  When you use photogrammetry it is baking the lighting onto the material, rather than the 3D worldspace illuminating and producing AO, shadows, etc.  To get rid of this you would need to move each tank into a filtered soft ambient lit room, so that the light source isn't producing any shadows across the subject.  This devblog talked about an attempt to remove these unwanted artifacts by artificially replicating the lighting scenario and unbaking the lighting that way, but it's much harder than it sounds!

 

Awesome juicy devblog team!  I love seeing this side of game production.

Share this post


Link to post
Share on other sites
9 hours ago, IINAYDOGII said:

is there no chance of using that technology for textures? id say ground/building textures are the weakest aspect of squad atm (I accept the perf issues, but Id like to see improvement eventually) 

Yes, its possible, especially with ground stuff. We are already using photogrammetry for some objects ingame, and experimenting with other aspects too. If we get any good results, we'll do another blog.

Share this post


Link to post
Share on other sites
Posted (edited)

Pretty awesome update, loved the photogrammetry part. BTW how do you track the location and direction of the camera while taking each shot, or does the software work that bit out while stitching together all the images?

One small thing thou, Eggman isn't the founder of PR, Requiem is, Eggman joined PR at v0.2 iirc. Would however call him the founder of the modern PR gameplay with things such as deployable, logistics system etc largely coming from him :)

http://www.realitymod.com/history

http://www.realitymod.com/forum/f10-pr-bf2-general-discussion/53559-history-project-reality.html

Edited by Rhino

Share this post


Link to post
Share on other sites

Heya rhino, its all automatic, it compares the parallax differences between a series of photos and from that can triangulate where the photo was taken in 3d space. Well, thats my understanding of it anyway, as long as you set the camera up correctly, you get good results, but it takes a fair amount of trial and error to get familiar enough with the process to get really good results. Id say these were about 80% good, the models are perfect for what we want them for (a 3d blueprint) the only real letdowns were in lighting, which we couldnt do much about, and have a plan for for next time. If you want any help getting started with photogrammetry, shoot me a pm!

Share this post


Link to post
Share on other sites

Awesome cheers, might give it a shot at some point in the future.

 

Ye the lighting is a tricky one, seen examples where they re-create the environment with chrome balls included in every shot that reflect the env, but really you kinda want to drive the tank into a dark room and have artificial lighting from every angle I guess hehe.

 

Will you be using these models for a High Poly bake or just as references?

Share this post


Link to post
Share on other sites

probably just reference, but the good thing is you have a high res but triangulated part of everything in the viewport with  you, and all the photos as reference as well. And blocking out and proportions etc are a cinch.

 

As for textures, outside on a cloudy day would get you good useable results, but moving a t72 on a whim isnt the most straightforward of tasks. Something for next time tho. There is still the probability that even the textures would be better remade in substance or photoshop, and that the scanned ones might not be as good, but, if you're going to all the trouble of doing this, might as well go in with the objective of getting get the best scan you can capture, especially as these will last for years as a perfect reference.

Share this post


Link to post
Share on other sites
Rhino, please start modding for Squad



Do I hear Muttrah?

Enviado de meu XT1563 usando Tapatalk

Share this post


Link to post
Share on other sites
26 minutes ago, Zenrique said:

 


Do I hear Muttrah?

 

Don´t forget the first rule: You do not talk about Muttrah!

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×