(LINK) to the full post

LINK to the full Fringe article

4 Rules of shooting HDRs

• Lock f-stop (aperture – which controls your depth of field)
• Lock focus
• Lock white balance
• Turn off any in camera “automatic” image enhancing (i.e.: auto-contrast or auto-saturation, including sharpening)
  

LINK to the HDRLabs FAQ

Clinometer

So of all the things I always manage to forget in VFX kit bag, my inclinometer always ends first on that list. But you know what I never forget? My iPhone! Enter Clinometer, turn it on it’s side and it becomes a pretty darn accurate slope finder. I compared it to an old school analog angle finder and came out with the same results. The coolest thing about this app though is if you lay it flat the whole interface turns into a bubble level. You can lock the angle for easy transcription later but it doesn’t have the ability to save, catalogue or email readings.

HdrHelper

A common question I get as a Supe is “How many stops apart should the pics for my HDRs be?”. First of all, when gathering bracketed exposures for generating HDRs (I use Photomatix but CS4 makes ‘em too) you want to make sure you change the shutter speed not the aperture. That way the depth of field won’t vary between exposures. There is no magic number to how different each exposure should be as long as the difference is consistent and travels from almost completely blown out to nearly black. I used to take test exposures, find the high and low end and do the math on a notepad to figure out what my shutter speeds should be. In HdrHelper, enter the start and end exposures and how many pictures you want to take and presto! It figures out the rest for ya.

Jott

So if you are like me inspiration and/or panic can come at any time. You may be driving or away from our notepad and need to record a specific piece of info. What Jott does is turn your iPhone into a mini dictation machine. You just talk into it and after a few moments Jott transcribes what you said (watch out for super techy words) and lets you file the written tidbits away for later. To get started you have to sign up for there website from which you can send your notes as emails, SMS and the like. That’s the good news. The bad news is, what was previously free will now be a pay service as of February 2nd. Sign up for the free now and you still may be able to get the 10% coupon code when they start making us pay.

Dropbox

Dropbox is a web app kinda like iDisk with two large exceptions, you can use it on the iPhone and it works. Signup for an account online and you get 2GB of disk space free and little app for your desktop. The desktop app puts a folder on your system and every time you write to it Dropbox uploads the file to your site and assigns it a url where you can access it from any web browser including Safari on the iPhone. The great thing is if you put a text file, pdf, jpg or iPhone supported movie in the Dropbox folder your desktop, you can see it immediately on the iPhone side. I use a program called TaskPaper to make my todo lists. Taskpaper saves in plaintext so I just keep the file in my Dropbox folder and I always have it with me. Oh did I mention that you can share folders and files with your iPhone brethren?

Google Docs

Another web app but one that can really help you with gathering data on set. As you may know Google Docs allows you to create documents, presentations and spreadsheets via a web interface that you can then share with others. What you may not be familiar with is a document type called a form. With forms, you can set up a series of questions that you can post or email. After you fill out the form and submit it, Google posts the data from the form into a master spreadsheet. The forms show up great on the iPhone and when you come home at the end of a long day on set, all of your data is nicely timestamped and thrown into a spreadsheet for you. Here’s how it works..

• Open up your browser and make a new form from the dropdown menu in Google docs.

• Fill out the title and description of the form then add the questions you want to show up in the spreadsheet. When you are all done, click on the “Email this form” button. Open up the email on your iPhone and follow the link. Here is a screenshoot of a form I made for VFX on-set data.

• Bookmark the link and bring it up on the go when you need to enter data. When you get back to the office, you will see that Google Docs has happily created a spreadsheet for you with the same title as the form. All the data you entered into the form is now placed in the spreadsheet through the magic of technology. Like this…

• You can edit the form, email it, or embed it into a your own blog or web page from the Form menu when you are editing the spreadsheet.

This is great for gathering info anywhere and also for gathering from multiple sources at once. Anyone who has access to the form can enter data into the same spreadsheet. That way you can have multiple people entering data at the same time! Who says a VFX Supe can’t have there butt in two places at once?

LINK to the VFX Data spreadsheet used in this post (you need a Google account if you want to save yourself a copy)

The Journey Begins

The pilot for J.J. Abrams new series “Fringe” takes the viewer on a mysterious adventure through the world of fringe science. The idea being, that everything that happens in the show is just outside the realm of what we currently understand to be possible. To create this illusion the show required a series of “invisible” visual effects. Anything that happens in the course of the show has to be convincing because the dramatic source of the effects isn’t magic or some alien world but the logical extension of what we know to be true and possible. VFX Kevin Blank, took this seriously from the beginning of the show mandating to all the creative people involved that realism was the order of the day. To that end innovative workflows and techniques were developed to ensure the seamless marriage of live action and CG elements.

Digital Prosthetics

The Airplane

The show begins with a virus that infects unsuspecting airline passengers and later takes down one of the main characters. This concept posed an interesting VFX challenge. The natural methodology for this was a make-up application that created the illusion of dripping skin. However, in the climax of the sequence the writers wanted to take this idea to the very limit; thereby having a co-pilot’s melting face, accelerate to the point that his jaw actually unhinged and fell to the ground.

The bases of the effect was the done in practical make-up, with the added challenge that his particular vfx shot, of the jaw dropping itself was actually conceived after the footage on the plane was shot. Which meant that there were no tracking markers available for the movement of the face. A process dubbed “Performance Capture” was created for this shot which involved taking many 2d tracks from a high contrast version of the plate and transferring the 2d tracks from After Effects to a 3d mesh in Maya. The 3d mesh in this case being a optimized scan of one of the other actors in the show.

Once the camera track and face match move were complete dynamic motion was added to the shot. A simple facial rig was created to drop the jaw. An nCloth simulation was performed in Maya to generate correct motion for the drooping folds of flesh. Maya hair curves were used to create the motion for the sticky strands of mucus that extend from the face to hand. Texturing of jaw and mouth interior began with a projection of the plate photography that was then taken into Photoshop where detail was added. The shot was rendered in passes separating the diffuse, reflection, specular and ambient occlusion passes for reconstitution in composite. Compositing and integration was an enormous challenge for this shot. Not only did the CG elements have to blend seamlessly with the complex make-up work on the face, but the flashes of lightning illuminating the cockpit added an addition level of complexity. Extensive roto also needed to be done on the pilot’s shirt to create previously obscured background when the jaw falls away from the rest of the face. Along with all the render passes supplied by CG, a entirely additional set of renders was needed for this shot. The CG was rendered all the way through with the lightning “on” and again “off”. With two complete renders of each set-up the compositor was able to control the timing and intensity of the lightning without having to send the shot back to CG.

The Invisible Man

Later in the show, the virus that ravaged the airplane infects an FBI investigator. Luckily, he is taken to high-tech facility where the degrading of his flesh is slowed to keep him alive. As his disease progresses, the character’s skin, bones and organs get more and more transparent to the point where the view can see through his body to reveal his inner workings. Many methodologies were considered before settling on the final approach. The base of the effect was a complex make-up application by Gordon Smith. The first layer of transparence was created practically by the application of 3d tattoos, images of a medically accurate 3d model printed on silicon and glued onto the surface of the actors skin. Then veins were painted on the body followed by a translucent layer of gel to create the look of the top layer of skin. All of the internal body systems were created in 3d and integrated in composite with the actor in makeup.

The 3d effects for these shots started out with a medically accurate model of all system of the human body. This model was purchased from a vendor specializing in medical illustration and broken out into its component parts (skin, skeleton, organs, veins etc.) and re-textured for greater realism. The internal systems then needed to be deformed to conform to the skin of the model derived from the actor that was in the scene. After the model and texture was complete it needed to be matched to the moving photography with a great degree of accuracy. This was accomplished using a combination of 3d and 2d techniques. 3d camera moves were created in syntheses and refinements were made using 2d tracking points to warp the 3d image into place. The model with then lit and reflections were added using extremely high resolution HDRI panoramas of the set and all of its lighting elements. Again the 3d elements were rendered in passes, each body system (complete with animating heart, lungs and blood flow) rendered separately along with its component parts. Areas of detail were lifted from the make-up application in compositing and laid back over the CG to enhance integration and realism.

A Mechanical Arm

Another effect in the show that called for an extreme amount of interaction between CG and live action was the mechanical prosthetic arm used by the show’s villain. The script called for the actress to peel back her skin like a glove to reveal the metal and plastic underneath. The skin was a latex appliance that could be peeled off on camera and was color corrected to match the skin tone of the actress. The tracking and match moving on these shots was a particular challenge as the camera was in motion for most shots and movement of the arm needed to exactly match the motion of the actress on set. To help with the match moving, green make-up was applied to the actresses arm and tracking markers were painted onto the skin so they would not interfere with the motion of removing the skin glove.

The CG arm was designed and modeled prior to shooting making sure to reference the current level of robotic technology. The reflective surface of the arm was achieved using on set reference and by once again rendering out the 3d object split out into passes to adjust the level of secularity and reflection on a shot by shot basis.

The Dreamscape

In the story of Fringe the only way for one of the hero agents to contact her ailing partner is to ender his dreams by was of a sensory deprivation tank. This launched her into a surreal environment populated by her dreams and memories. This dreamscape was completely created in post and all of the performance footage was shot on green screen. In order to create the dreamy feel of the sequence large sweeping techocrane moves were used in combination with the actors on a turntable. This created many complex tracking issues solved mostly by BouJou however hand tracking was also used. The environment themselves were created using a combination of 3d elements and panoramic photography. Foreground and mid-ground elements were modeled and render in Maya while distant imagery was created by mapping 360 degree panoramas onto large CG spheres. The green screen plates and CG elements were color corrected together for the final integration.

Dramatic Conclusions

It took a lot of planning flawless execution to create the effects seen in the Fringe pilot. With the need for a suspension of disbelief, the science of Fringe had to come off to the viewer as real science just pushed a bit further. Using the advanced techniques available to the VFX industry today the Fringe team took the audience along on a journey that has only just begun.

LINK to Argapha’s VFX library on YouTube

A terra cotta bunny, a playboy centerfold and a Mandril. What do these things have in common you ask? If your answer was the cast list to the greatest YouTube video of all time you’d be wrong (that would be cool though). The correct answer is that these are all images used and re-used in the testing process of creating digital imagery. The folks over the unfortunately named Art Fag City have put together a post of 20 CG Image Archetypes for your browsing pleasure. Lots of good history and links here. Take a look.

[LINK] (http://www.artfagcity.com/2008/07/28/img-mgmt-20-archetypes/) to the original post (marginally NSFW because it has a naked teapot in it)

Thanks to Azathoth for the link

The video proves once and for all that CGI and Radiohead are two great tastes that taste great together. The basic idea is this, screw the cameras 86 the lights scan everything and make the whole piece out of realtime streaming data. The result is imagery so deep in the uncanny valley that it’s cool. This behind the scenes gives a great overview of the technical and creative issues involved. I love the image of Lidar scanner on a dolly. The only problem, “Ready, and, SCAN!” just doesn’t have the right ring to it.

LINK to the full video thanks to JC for the link

Ever wanted to use a really expensive super-fast modern computer to create a logo design that looks like it was airbrushed on the front of a 70′s T-shirt? Well you’re in luck! Freelance designer Harry J. Frank has posted a nice little tutorial that’s all about the chrome logo and glowing grid that floats in space for no reason (don’t forget the cheesy star filters). All you need is a couple hours of spare time a copy After Effects and an unhealthy nostalgia for electric pink and blue.

LINK to the full tutorial on graymachine.com

The Mission

Jericho tells story of small town struggling to survive in the landscape of a post apocalyptic America. In the final episode of the show’s second season, the creators wanted to give the fans something special. The VFX team worked with production to give the audience a glimpse at what the rebuilt capitol of drastically altered capital city would look like and a stunning climax that pitted the shows main character, Jake against the might of the Cheyenne air force in a dramatic aerial battle. The challenge to the VFX team was to make these important story points completely realistic. The VFX was not to detract from the story but enhance it by delivering seamless effects.

The Approach

The reveal of the capitol building under construction in the new Capitol of Cheyenne was not to be your run of the mill matte paining. The story called for a city under drastic expansion and rapid construction. Reference photography of the current city of Cheyenne could be used as a base, but new buildings as well as construction cranes, vehicles, pedestrians and construction workers would have to be added after the fact. The show’s most difficult sequence came in the form of the final aerial battle. Knowing that it would be impossible to tell the story through the use of stock or custom shot aerial photography, the visual effects team settled on a mostly CG approach. The scene called for a variety of different aircraft and many camera angles to cover the action. There was dialog between Jake and the pilots of both the Cheyenne and later the Texas planes, so plates of the actors would need to shot on green screen and combined with the CG planes and backgrounds. At one point in the battle, two of the planes are blown out of the sky by air-to-air missiles. Knowing that a photo-real explosion would be difficult to achieve by using CG alone, it was decided that scale models were to be built based on the CG planes and animatics and blown up using traditional special effects methods. Later these elements would be composited with the CG planes.

Shot Elements

Once the methodology was decided upon, the wheels were set in motion to gather all the practical elements that needed to be shot. These fell into several categories. First HDRI 360° photography of the first unit location for the reveal of the Cheyenne Capital. The HDRIs captured on set were used as a basis for the background buildings and were used as a lighting basis for the 3d elements in the matte painting. The raw photos for the panoramas composed of 38 different camera positions with nine exposures for each position.

The final shot was to be from the perspective of a hotel room 12 stories above the street so the HDRIs were taken from atop a 40 foot platform. Many elements were also gathered to create the feeling of activity in the scene. A camera was again placed on a platform to match the high vantage point of the final shot. Many passes of ground activities of civilians, military, construction workers and their vehicles were taken. To create the illusion of more extras costumes were changed multiple times and movement patterns were varied from take to take.

The aerial battle plates consisted of two main parts, the green screen photography of the actors for inside the plane cockpits and the explosion plates of the jets. The green screens were filmed on a high definition video camera with Jake (the main character) sitting inside a cut out portion of a real plane cockpit that was a close match to the model that was shot on first unit.

The glass on the cockpit windows was left in on most shots so any of the actors reflections could be lifted and used in the final composite. The pilots of the F-15 and F-16 fighter jets were also filmed against green with the intention of modeling a digital cockpit for those shots. Pivotal to the success of the green screen shoot was the animatic that was created by the VFX team and cut by Jericho editorial. This animatic was worked on with the creators of the show so that all the major action of the scene was represented in a rough 3d form. This gave the actors an excellent idea of what was happening in the scene and helped them achieve the proper eye-lines and emotional impact rather than just acting against a void.

When it came to shooting the plane explosions, great care was put into the planning and preparation of the shoot. The animatic was again used to determine the detail and placement of the plane models. A VFX shoot team was assembled consisting of a DP and his crew, a pyrotechnics team and few model makers and painters. The plane that was to be destroyed was an F-15 fighter and the fiberglass shell from a remote control plane kit was used as the base model. Four shells with a wingspan of a little over 5 feet were prepped and painted to match the markings and textures of the CG models exactly. On the day of the shoot the model planes were packed with explosive and lifted onto a 30 foot armature. Three cameras were placed at different heights that lined up to several shots in the animatic, a live switcher was used to line up the video feeds from the camera to the animatics. The three cameras rolled simultaneously on each explosion at 120 fps. The higher frame rate was used to compensate for the smaller scale of the models. All together 3 models were blown up for the shoot.

3d Techniques

Before any modeling or texturing of the 3d assets was started, an exhausting search for reference was begun. The new Capitol building under construction in Cheyenne began as model from a stock library. Pieces of the substructure and framing of the building were then created using the stock model as a guide. Then pieces of the original model were stripped away to reveal the unfinished skeleton. The construction cranes for the 3d matte painting were modeled using photo reference, along with other street props. The hero buildings were generic models that were placed in the scene with projected textures of the building matte paintings used to enhance the details.

The aerial battle sequence started with the creation of a detailed animatic which served as a master template for animation, camera movement and lighting. After editing, the stand-in planes were replaced with hi-resolution versions. Careful attention was taken to make sure that the planes were authentic. The Cessna Citation that Jake flies in the scene not only had to look real in the CG shots but be a perfect match to an aircraft shot by production taxiing on the runway in the previous scenes. Many photographs were taken of the markings and logos on the plane to make sure the match was seamless. The F-15s and F-16s also had to be extremely detailed as they were seen close-up from nearly every angle. The cockpit and pilot seat of each plane also had to be rendered and textured to accommodate the green screen footage of the pilots. A lot of photographic reference both still and moving was used ensure that the shading and behavior of light across the planes surface was highly realistic. The flags and markings of the new Air Force in the Jericho story line also had to be created and applied to the planes.

2d Techniques

Many of the compositing shots in this show made use of the tight integration between the 3d and 2d working environments. For the Cheyenne Capitol shot, a 3d track was created for the scene. 3d elements were rendered with basic lighting using the track data, then the same track data was used in the compositing software. This allowed the compositor to place elements in the scene on 3d cards and have them track perfectly with the rendered elements. It gave the artists the flexibility to paint detail directly onto the parts of the image that needed it without having to request another element to be rendered in 3d. This technique was used to great effect when building the sky environment for the aerial battle scene. The shot began with the camera created during the 3d animation process. A basic sky dome and rough 3d landscape was added to each shot and rendered. The compositors than painted over the rough landscape using stock aerial photography to add detail while maintaining the basic lighting and depth from the 3d render. The 3d camera move was also brought into compositing for the addition of photographic cloud elements placed at different distances from the camera to create the illusion of volume and depth.

To create the photographic look of the planes, a multi-pass pipeline was used. Each component of the 3d render (reflection, color, specularity, etc.) was rendered as a separate element and combined in composite to achieve the final look. Using this method, the compositors had an extreme amount of control in how the subtle lighting effects played across the surface of the ships. Perhaps the most convincing of composite effects done for the show was the explosion of the two F-15s. Since the line-up of the shot footage of the planes exploding from the VFX shoot lined up perfectly, a quick dissolve from the CG plane to model footage was all that was needed. In fact the explosion proved so effective that close-up shots of the explosion from the VFX shoot were added to the edit towards the end of the editing process. The clean-up of the explosions involved removing the rig from each shot and pulling keys from the sky behind the model. [See post to watch QuickTime movie]

Conclusion

It is rare to get to work on a Visual Effects sequence for a television show that i so pivotal to the storytelling of the episode. In the case of Jericho Episode 207, the story and visual effects were intertwined in such a way that one could not have happened without the other. Because of the tight integration between story and effects, all of the work done on the show had to be seamless. Anything out of place would distract the viewer from the emotional impact of the action. An imaginative combination of techniques both old and new were used to create scenes with an amazing degree of authenticity. The VFX team for this show worked tirelessly to make sure that the fans of the Jericho series would not be disappointed.