Gmail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Question about processing raw images
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  7 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Floyd L. Davidson  
View profile  
 More options Nov 8, 5:28 pm
Newsgroups: rec.photo.digital
From: fl...@apaflo.com (Floyd L. Davidson)
Date: Sat, 07 Nov 2009 21:28:06 -0900
Local: Sun, Nov 8 2009 5:28 pm
Subject: Re: Question about processing raw images

Peabody <waybackNO784SPA...@yahoo.com> wrote:
>I understand that raw files are typically 12-bit or 14-bit, instead
>of the 8-bit found in jpegs.  But when you are editing raw images,
>you don't actually see the 12-bit image do you?  I mean, insn't the
>display going to show you an 8-bit picture?  So every time you make
>a change to something in the image, the software has to re-render
>the 12-bit info into an 8-bit version for the display.

>Or do I have this all wrong?

Well...  the RAW data is *never* what you look at
anyway!  It necessarily has to be interpolated to get an
image format.  The resulting image might be a JPEG, but
it could be a PPM or a TIF format too, and it could just
as easily also be the internal format for any one of a
number of image editing programs too.  Regardless of
what it is though, you are correct that it must be
converted to an RGB format to view it... and internally
some monitors are necessarily going to convert it to a
6-bit format!

--
Floyd L. Davidson <http://www.apaflo.com/floyd_davidson>
Ukpeagvik (Barrow, Alaska)              fl...@apaflo.com


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
More Info  
View profile  
 More options Nov 8, 10:55 pm
Newsgroups: rec.photo.digital
From: More Info <mi...@address.info>
Date: Sun, 08 Nov 2009 05:55:26 -0600
Local: Sun, Nov 8 2009 10:55 pm
Subject: Re: Question about processing raw images
On Sat, 07 Nov 2009 22:50:12 -0600, Peabody <waybackNO784SPA...@yahoo.com>
wrote:

>I understand that raw files are typically 12-bit or 14-bit, instead
>of the 8-bit found in jpegs.  But when you are editing raw images,
>you don't actually see the 12-bit image do you?  I mean, insn't the
>display going to show you an 8-bit picture?  So every time you make
>a change to something in the image, the software has to re-render
>the 12-bit info into an 8-bit version for the display.

>Or do I have this all wrong?

Correct. (or as someone else already noted, to bit-levels even less than 8)
When printed, reducing this even further.

12-bit and 14-bit RAW is popularized by "photographers" who must greatly
expand some tonal range in their image during editing, without introducing
large gaps in the recorded colors and intensities. Mostly because they are
nothing but lowly snapshooters dependent on auto-exposure settings, people
that don't know how to correctly expose an image in the first place. Or
because their camera is really poor at doing its own RAW to JPG
conversion--in the process it will clip most of the useful ends of the
dynamic range of the sensor (better, properly programmed cameras do not do
this). Again, proving  that they are unskilled photographers because they
don't even know how to purchase decent cameras in the first place.

This extended bit-range is important for them in editing because:

(Using exaggerated decimal values of an 8-bit tonal range, for clarity.)
You might have an important area of your image that is highly underexposed
(from poor photography skills). A large and important area of your scene
being recorded in values between 0 and 19 (out of 255 possible 8-bit
levels). In order to make that image the least bit useful the
"photographer" will try to expand that 0 to 19 value range of details to 0
to 99 in their editor to try to get the details more visible out of those
greatly underexposed areas. You would now only have 20 values representing
almost half (2/5ths) of the image's available hues and intensities. Huge
tonal gaps represented by posterized effects (bands of solid hues) in the
image. Ghastly looking unless used for special artistic effects (known as
posterizing).

This is why they applaud 12-bit and 14-bit RAW files so much. To help
compensate later for their total lack of skills at photography (wrong
exposures, wrong white-balance settings, ... on ad-infinauseum). Or in not
knowing how to purchase decent cameras that don't require access to the RAW
data, because the full sensor range is already represented in its properly
exposed JPG files.

Those who preach and worship their God-RAW only reveal their total lack of
skill and talent.


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
More Info  
View profile  
 More options Nov 9, 2:23 am
Newsgroups: rec.photo.digital
From: More Info <mi...@address.info>
Date: Sun, 08 Nov 2009 09:23:49 -0600
Local: Mon, Nov 9 2009 2:23 am
Subject: Re: Question about processing raw images
On Sun, 08 Nov 2009 08:07:30 -0600, Peabody <waybackNO746SPA...@yahoo.com>
wrote:

They are usually referred to as photosites on the sensor (some calling them
sensels, as a play on sensor+pixels), later interpolated into RBG image
pixels.

Each photosite carries a numeric value, no real color. Its number is
assigned a color value by its position on the sensor, being under one of 4
R, G, G, B filters in the Bayer array.

>  If the latter,
>then I assume there's something in the raw file format that
>tells the editing software what the color pattern is.  And
>are there different ways to do the interpolation, so that
>you get different results from different software before you
>even begin the editing?

During importing the RAW sensor data into the editor it must undergo the
transformation to an RBG image in order for you to view it. There are many
many RGGB, GBRG, etc. orders of patterns on various sensors. Some even
having 4 different colors instead of just 3 colors in a group of 4 (2
photosites per each red and blue, typical Bayer sensor).

If you would like to test various import interpolation methods to see what
they do with the RGGB data converted to RGB data, download Photoline from
www.pl32.net  and play with it during the 30 day demo period. It has 6
different RAW interpolation methods to choose from, to show you how some
are more efficient or accurate than others. (Under: File > Import > Digital
Camera RAW Data) Point it at a RAW file to open, then on the left side of
the Raw Import preview pane is a drop-down list of various interpolation
methods. I most often use the "VNG Interpolation Cubic" option, but
depending on the type of fine details in an image, others might be better
at times. Zoom in on the image so you can see the individual RGB pixels to
see how the interpolation changes with each type selected. If you have a
Gretag-Macbeth color chart to photograph, even one found on some web-page
and displayed on your monitor screen, that's a good test to see how the
interpolations handle various colors and dithering patterns for them.
Yellows and oranges seem to be problematic for some RAW interpolation
methods. If photographing a Gretag-Macbeth chart displayed on your monitor,
photograph it with the lens defocused so the screen's visible pixels don't
compound the issue, unless you'd like to see what the interpolation methods
also do to fine moire' causing details.

(Before opening any RAW files in Photoline, be sure to go to Edit > Options

> File > Raw, and set the gamma to your workspace, 2.20 if on a PC,

otherwise any RAW images will appear far too dark. Also set the Automatic
White-Point to "on" if you are using CHDK RAW files, as they don't contain
the white-point information in the RAW header.)

It depends on your purpose and needs. If you are referring to a CHDK RAW
data file (many of them being 10-bit), then you can tweak out slightly more
resolution from the RAW file by using more advanced RAW interpolation
methods and noise-reduction tools than what the camera uses to create its
own JPG file. (Every other year or so someone comes up with a slightly
better RAW interpolation mouse-trap.) The increase in resolution by using
more advanced methods than the camera uses on the RAW data is slight, but
it is observable by photographing resolution test charts or detailed
foliage. Those camera are also very good at accurately depicting the full
dynamic range of the sensor in the JPG file. But some have found that color
information at the extremes of the sensor's dynamic range is more
accurately retained in the RAW data. Where a dark red carpet in deep
shadows might look nearly black in the JPG file, by using the RAW data it
will now appear to have a more reddish hue. In either case, the improvement
is slight because of how well those cameras already interpret the RAW data
for their JPG images. For some subjects you might find that little bit
extra important, so use RAW. You'll have to compare and test it yourself to
see if RAW is even worth the bother for your style and requirements of
photography. I personally find only about 3 times per month where RAW from
my CHDK capable camera is worth the extra steps required for special
subjects. The JPGs from them are already really good.

    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
More Info  
View profile  
 More options Nov 9, 2:35 am
Newsgroups: rec.photo.digital
From: More Info <mi...@address.info>
Date: Sun, 08 Nov 2009 09:35:04 -0600
Local: Mon, Nov 9 2009 2:35 am
Subject: Re: Question about processing raw images
On Sun, 08 Nov 2009 08:07:30 -0600, Peabody <waybackNO746SPA...@yahoo.com>
wrote:

They are usually referred to as photosites on the sensor (some calling them
sensels, as a play on sensor+pixels), later interpolated into RBG image
pixels.

Each photosite carries a numeric value, no real color. Its number is
assigned a color value by its position on the sensor, being under one of 4
R, G, G, B filters in the Bayer array.

>  If the latter,
>then I assume there's something in the raw file format that
>tells the editing software what the color pattern is.  And
>are there different ways to do the interpolation, so that
>you get different results from different software before you
>even begin the editing?

During importing the RAW sensor data into the editor it must undergo the
transformation to an RBG image in order for you to view it. There are many
many RGGB, GBRG, etc. orders of patterns on various sensors. Some even
having 4 different colors instead of just 3 colors in a group of 4 (2 green
photosites per each red and blue, typical Bayer sensor).

If you would like to test various import interpolation methods to see what
they do with the RGGB data converted to RGB data, download Photoline from
www.pl32.net  and play with it during the 30 day demo period. It has 6
different RAW interpolation methods to choose from, to show you how some
are more efficient or accurate than others. (Under: File > Import > Digital
Camera RAW Data) Point it at a RAW file to open, then on the left side of
the Raw Import preview pane is a drop-down list of various interpolation
methods. I most often use the "VNG Interpolation Cubic" option, but
depending on the type of fine details in an image, others might be better
at times. Zoom in on the image so you can see the individual RGB pixels to
see how the interpolation changes with each type selected. If you have a
Gretag-Macbeth color chart to photograph, even one found on some web-page
and displayed on your monitor screen, that's a good test to see how the
interpolations handle various colors and dithering patterns for them.
Yellows and oranges seem to be problematic for some RAW interpolation
methods. If photographing a Gretag-Macbeth chart displayed on your monitor,
photograph it with the lens defocused so the screen's visible pixels don't
compound the issue, unless you'd like to see what the interpolation methods
also do to fine moire' causing details.

(Before opening any RAW files in Photoline, be sure to go to Edit > Options

> File > Raw, and set the gamma to your workspace, 2.20 if on a PC,

otherwise any RAW images will appear far too dark. Also set the Automatic
White-Point to "on" if you are using CHDK RAW files, as they don't contain
the white-point information in the RAW header.)

It depends on your purpose and needs. If you are referring to a CHDK RAW
data file (many of them being 10-bit), then you can tweak out slightly more
resolution from the RAW file by using more advanced RAW interpolation
methods and noise-reduction tools than what the camera uses to create its
own JPG file. (Every other year or so someone comes up with a slightly
better RAW interpolation mouse-trap.) The increase in resolution by using
more advanced methods than the camera uses on the RAW data is slight, but
it is observable by photographing resolution test charts or detailed
foliage. Those camera are also very good at accurately depicting the full
dynamic range of the sensor in the JPG file. But some have found that color
information at the extremes of the sensor's dynamic range is more
accurately retained in the RAW data. Where a dark red carpet in deep
shadows might look nearly black in the JPG file, by using the RAW data it
will now appear to have a more reddish hue. In either case, the improvement
is slight because of how well those cameras already interpret the RAW data
for their JPG images. For some subjects you might find that little bit
extra important, so use RAW. You'll have to compare and test it yourself to
see if RAW is even worth the bother for your style and requirements of
photography. I personally find only about 3 times per month where RAW from
my CHDK capable camera is worth the extra steps required for special
subjects. The JPGs from them are already really good.

    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Eric Stevens  
View profile  
 More options Nov 9, 9:32 am
Newsgroups: rec.photo.digital
From: Eric Stevens <eric.stev...@sum.co.nz>
Date: Mon, 09 Nov 2009 11:32:16 +1300
Local: Mon, Nov 9 2009 9:32 am
Subject: Re: Question about processing raw images
On Sun, 08 Nov 2009 05:55:26 -0600, More Info <mi...@address.info>
wrote:

At this stage the troll is beginning to spout his usual bullshit.
Think very hard about the motives he is attributing to people before
you accept them.

Eric Stevens

    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Wolfgang Weisselberg  
View profile  
 More options Nov 9, 1:01 pm
Newsgroups: rec.photo.digital
From: Wolfgang Weisselberg <ozcvgt...@sneakemail.com>
Date: Mon, 9 Nov 2009 03:01:27 +0100
Local: Mon, Nov 9 2009 1:01 pm
Subject: Re: Question about processing raw images

Peabody <waybackNO784SPA...@yahoo.com> wrote:
> I understand that raw files are typically 12-bit or 14-bit, instead
> of the 8-bit found in jpegs.

The 8-bit JPEG is a (loosely speaking) gamma-encoded value,
whereas the RAW data is linear.  Our vision is not linear,
it's much closer to how JPEG encodes data.

> But when you are editing raw images,
> you don't actually see the 12-bit image do you?

You see at least 24-bit images (3 channels at at least 8 bit,
maybe more, depends on your system and graphics card), from three
fields of sparse 12-bit (or 14-bit) data, namely the red, green and
blue photo receptor sites (which are *not* all at the same place).

> I mean, insn't the
> display going to show you an 8-bit picture?

Nope.  When the conversion tables for calibrated screens come
in, it very often has quite more bits already.

> So every time you make
> a change to something in the image, the software has to re-render
> the 12-bit info into an 8-bit version for the display.

Nope.  The software can store the pre-computed image in the
image rendering pipeline at the place before you change anything,
and just recompute the part afterwards.  But just translating
12 to 8 bit, if it would do so, is computationally very cheap
and not a problem, unlike many other operations that involve
some or many pixels surrounding the one you are actually
computing.

> Or do I have this all wrong?

You need to grab a good book or at least a knowledgeable web
site and dig in for a week or two, so you'll grasp the basics of
digital image manipulation.

-Wolfgang


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bob Larter  
View profile  
 More options Nov 9, 10:51 pm
Newsgroups: rec.photo.digital
From: Bob Larter <bobbylar...@gmail.com>
Date: Mon, 09 Nov 2009 21:51:09 +1000
Local: Mon, Nov 9 2009 10:51 pm
Subject: Re: Question about processing raw images

Peabody wrote:
> Floyd L. Davidson says...

>  > Well...  the RAW data is *never* what you look at
>  > anyway!  It necessarily has to be interpolated to get an
>  > image format.

> Let me ask about that too.  As I understand it, you've got
> this Bayer pattern screen built into the sensor, so that
> each pixel is really only registering one color.  So at some
> point, there has to be the interpolation to create for that
> pixel what the other two colors probably would have been -
> sort of a synthetic Foveon situation.

Correct.

> Has that already been done by the camera in the process of
> producing the raw file, or is the raw file really raw and
> therefore contains only one color per pixel?  If the latter,

Yes, the latter. That's an important reason for shooting RAW.

> then I assume there's something in the raw file format that
> tells the editing software what the color pattern is.

No, the pattern for any given RAW format is /usually/ programmed into
the RAW software, not the image file. (Not true for DNG though, for
example.)

>  And
> are there different ways to do the interpolation, so that
> you get different results from different software before you
> even begin the editing?

Absolutely. The de-Bayering algorithm is one of the biggest differences
between RAW converters.

>  > Regardless of what it is though, you are correct that it
>  > must be converted to an RGB format to view it... and
>  > internally some monitors are necessarily going to
>  > convert it to a 6-bit format!

> Yeah, I suspect my cheap Toshiba laptop is one of those.

You'd be correct.

> Well, I guess it's just a reminder that you just don't know
> what your pictures are going to look like to those seeing
> them on a computer.

> Anyway, I just wanted to be clear that you dont actually see
> those 14 bits of granularity while you're editing the
> picture.  You get the benefit of them being there when
> making adjustments, but at best you are actually looking
> at an 8-bit rendition of the picture.

> In my case it's only 10-bit raw, and I'm just not sure
> that's worth the bother.

It's a matter of personal preference, a lot of the time. Personally, I
shoot RAW on my elderly Canon S30 - which is also only 10 bits- & find
it gives me better tonal/colour quality than shooting JPEG.

--
    W
  . | ,. w ,   "Some people are alive only because
   \|/  \|/     it is illegal to kill them."    Perna condita delenda est
---^----^---------------------------------------------------------------


    Reply    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google