Public Lab Research note


Stitched panoramas from the PLOTS IR camera tool

by cfastie | May 08, 2012 18:13 08 May 18:13 | #1927 | #1927

There was not enough wind for a kite to lift my PLOTS IR cameras last week, so I walked around with the dual camera KAP rig and took synchronous pairs of normal and NIR photos. This allowed me to check the alignment of the cameras, see how focus and exposure operated, and try stitching NDVI images into panoramas.

There is more detail, more photos, video, and a 170 megapixel Gigapan of the poster at my site. A direct link to the Gigapan is here.

Some things I learned:

Camera alignment: The alignment is close, so the two images are offset by about 60 pixels (both x and y). Alignment is important because it makes rectifying the images more productive -- each pair of rectified images yields more final image when the stacked images coincide. And it can be tedious to rectify the photos, so cropping away lots of non-overlapped image is painful.

Exposure: The NIR camera needs about three times more light than the unmodified camera to make a decent exposure. I think increasing the ISO from 80 (the lowest setting on the A495) to 200 will be standard procedure for the NIR camera. With the unmodified camera at ISO 80 and 1/800 second, setting the NIR camera at ISO 200 and 1/640 second will give it 3.1 times more light at the same f-stop. For very bright scenes, even 1/800 second and ISO 200 will allow the NIR camera to make well exposed images. I was using shutter speed priority via CHDK.

Focus: The NIR camera has a harder time finding the correct focus. I tried both Normal and Infinity focus mode. Both seem to be automatic focus modes, but I think Infinity does not bother to search closer than about 10 feet. That is an important advantage, but it still results in the camera continuing to search for focus when it is time to shoot. In some situations this could cause the A495 to refuse to shoot and miss a photo. Using CHDK to fire both cameras simultaneously after a timer signals the USB port eliminates that problem because the camera shoots even if it is displaying an error due to failure to focus. So failure to focus in time will not cause missed photos, but the NIR camera will probably produce more out-of-focus shots than the normal camera. A camera with a true manual focus mode would be preferable. Although CHDK offers no menu control to lock focus, it does offer focus control via scripts. This will have to be investigated.

Stitching: I used Microsoft ICE to do the stitching. The NIR photos from the modified A495 stitch together into panoramas about as well as normal photos. The other images, all of which start with one image aligned on top of another, are harder for stitching programs to match because adjacent images might have been aligned slightly differently. The false color NDVI is very hard to stitch because it has much less detail (nearby pixels with similar values are all assigned the same color which obscures fine detail). I had to do much of that NDVI stitching manually in Photoshop.

Standard presentations of NIR and visible data

Caption: Five panoramas each stitched from five images made using the PLOTS IR camera tool. The top panorama is made with photos from the unmodified Canon A495. The second one is made with the PLOTS NIR-modified A495. The middle panel is a false color infrared (NRG) image made with NIR and visible information from both cameras. The lower two panoramas are grayscale and false color NDVI, an index computed from NIR and red values which highlights plant productivity.

The poster above can be explored in great detail at Gigapan.com. This gigapan is embedded below, but the view and the information is richer at gigapan.com.


8 Comments

Chris -- this is absolutely stunning. You should consider submitting it to the annual Gigapixel Imaging conference!

Do you think you could embed the gigapan in the research note or does it not really work?

Is this a question? Click here to post it to the Questions page.

Reply to this comment...


I will try embedding the gigapan. Gigapans are not made for small frames, so it could extend into the unused white space on the right. That might not work well, but might be worth a try. In this case, there is a lot of additional information about this effort at gigapan.com,so encouraging visits there was intended.

Reply to this comment...


you're right -- the annotations to zoom around to are great!

Reply to this comment...


How do I make the links to other sites open in a new tab? (Don't want to lead people away).

Is this a question? Click here to post it to the Questions page.

Reply to this comment...


Thanks for sharing these Chris, I have to concur with Jeff these are fabulous! What sorts of conclusions would you draw from these images? I'd be interested to see how you interpret them--did anything surprise you?

Is this a question? Click here to post it to the Questions page.

Reply to this comment...


Thanks Sara, Surprised? Yes, at how bloody long it takes to align, analyse, output, and stitch together the images for EACH panorama;]

Most of this could probably be automated in ImageJ or Fiji. Until this happens, high resolution NRG or NDVI maps of large areas might be slow to emerge.

I think my main conclusion is that the IR camera tool works. With a little bit of obsessive attention to detail, some very meaningful results will be possible.

Is this a question? Click here to post it to the Questions page.

Reply to this comment...


Excellent and inspiring research note!

Reply to this comment...


Amazing. We should apply this methods of displaying photos and IR to our photos. We use Hugin for stitching, and it works good.

Reply to this comment...


Login to comment.