Posted by: James Nash | October 27, 2008

Imaging Demo Details

Incase you hadn’t figured it already, the demo I was teasing with before the show was our “Zero shutter lag” imaging demo. We’ve posted a picture and a link to the associated Flickr stream already but I think a more detailed write-up is in order now…

Smile! You’re on camera…

We were demonstrating a camera application that could take pictures the instant you press the capture button. To date, there is always a slight delay on camera phones between the user pressing the button and the camera actually capturing the image. Since our set-up elimates this delay we’ve dubbed it “Zero shutter lag“.

To make it a bit more fun we had a few effects that could be applied to the photos such as black & white, sepia, milky and more. Some of these also worked in real-time on the camera view-finder. There were also a number of celebrity lookalikes to pose with: Posh’n’Becks*, Del boy (a character from “Only Fools and Horses” for the non-Brits reading this), Jean-Luc Picard, Austin Powers and Kylie Minogue.

The finished images could then be uploaded directly to Flickr and from there were then downloaded and displayed on the main Symbian stand (behind the coffee bar) and the ScreenPlay demo. You could also get your photo printed out onto a keyring, bottle opener or fridge magnet for added freebie goodness!

The ingredients

The demo was built on Symbian OS 9.5 and running on a Texas Instruments 3430 development board with a 3.2 mega-pixel OmniVision camera. Although they don’t look like phones, such dev boards are representative of mobile phones – same CPU, memory, peripherals etc. – but have some extra connections to help software development.

The software that enabled the zero shutter lag feature was by Scalado. By working closely with them, we have pre-integrated Scalado’s imaging solutions into Symbian OS. This means that it’s a lot quicker, cheaper and easier for Symbian OS licensees to use Scalado’s software in their products if they so desire. A great example of the Symbian Parter Network in action!

How the magic happens

You may be wondering why we haven’t had zero shutter lag before. Well, traditionally phone cameras will send a low-resolution stream of images while the viewfinder is being displayed. This is because using full-sized images for the viewfinder is prohibitively CPU and memory intensive. When the user presses the capture button the camera therefore has to switch into full-resolution mode first and this takes some time (largely because it involves re-calibration for which the camera needs to capture a few frames as reference). That’s where the delay is introduced.

Enter Scalado. They have some incredibly clever and effecient JPEG-decoding software. In fact, it’s so nippy that it allows us to use a full resolution feed from the camera for our view-finder (and that’s all running ARM-side btw). When it comes to capture time that means we already have a full sized, JPEG file that we just need to save to disk. No more switching camera modes equals no more lag!

Although our demo app didn’t do this, it wouldn’t be much of a stretch to buffer the last few seconds’ worth of camera frames so that when you capture it could present you with photos from just before you pressed the button. That way even if you were a bit late to press the button you still wouldn’t miss those once-in-a-lifetime moments! You could also implement a burst capture mode along similar lines.

With higher spec camera hardware and sufficient bandwidth on the camera connection you could up the mega-pixels quite significantly too. Scalado recons that with the CPU we were using their solution could comfortably decode up to 20 mega-pixel images. Sweet! 🙂

* Incase you were wondering: The Posh’n’Becks were the same ones that appeared on Dragon’s Den!

Advertisements

Responses

  1. […] was running on a TI OMAP 3430 development board). The gallery was populated with photos from our imaging demo. It also had a transparent incoming call dialog window that could appear to demonstrate the surface […]

  2. […] shutter lag The imaging demo instantly snaps up a brace of symbianites. No taking a pic of your kneecap any more, this will […]

  3. Great write up – and one of best demos too. You could practically feel the ecosystem love. 🙂

  4. […] Infine un video dimostrativo di un anno fa sempre su questi tipi di software, pubblicato su YouTube nel canale della Scalado. (fonte: SymbianCommunityNews, Mobinaute, SymbianSmartphoneShowBlog) […]

  5. […] demo photos Just a quicky: The Flickr user that all photos from the Symbian Imaging Demo are uploaded to is: […]

  6. What software did you use to upload to Flickr?

  7. @String Bell: We wrote the Flickr uploading feature ourselves (using Flickr’s web APIs) as part of the demo application.

  8. Do bigger viewfinder frame make viewfinder slower?
    Also, are the work done in DSP core or main CPU core ? That is is CPU load grow considerably ?

  9. @mirror2image: I’m not sure what the impact of a bigger viewfinder would be, but I suspect if there are extra overheads they would not be substantial.
    The actual decoding of the JPEG data and application were all running on the CPU (i.e. ARM) core. Our set-up did use hw-accelerated graphics (ScreenPlay) but that would only help for compositing the UI and drawing it to the screen.
    HTH

  10. […] Symbian Partner Network Videos Just a quick heads-up: There’s now a Symbian Ecosystem YouTube channel with a collection of videos showcasing members and events from the Symbian Ecosystem and also the benefits of joining the Symbian Partner Network. One video that may interest readers of this blog is the Symbian & Scalado one which shows some of the people behind the imaging demo: […]


Categories

%d bloggers like this: