Ugly Hedgehog - Photography Forum
Home Active Topics Newest Pictures Search Login Register
Check out Advice from the Pros section of our forum.
Main Photography Discussion
Sensors and dynamic range
Page <<first <prev 7 of 8 next>
Jan 18, 2021 20:06:00   #
hjkarten Loc: San Diego, California
 
Dear Bill (bclaff),
I skimmed the Martinec article, and realized that I had read it some years ago. It is definitely worth another reading.
Many thanks,
Harvey

Reply
Jan 18, 2021 20:27:32   #
bclaff Loc: Sherborn, MA (18mi SW of Boston)
 
hjkarten wrote:
I fully agree with you about the fallacy of believing that you can extract 20 bits of data from a 14 bit device by hanging a 20 bit ADC on the readout. ...
I certainly never suggested any such idea in any of my comments. Lacking the engineering data from the SONY chip-fabrication lab, we have to assume that they also know how to evaluate chip noise and validity of bit values. If they claim it is a 14 bit sensor, we should knock off some of the accuracy of the readout and grant them 13 bits of relatively clean output. If you want to express that in EV values, I'll yield if it more readily conforms to your preferred manner of reporting the data. Please spare me a lecture on conflagrating EV and bit-depth. I'm trying to reach a point of mutual agreement.
...
regards,
Harvey
I fully agree with you about the fallacy of believ... (show quote)


You are getting closer.
There is no conflating of dynamic range (EV) and bit-depth.
Bit-depth sets an upper limit on dynamic range. Dynamic range is *never* expressed as bit-depth.
FWIW, there are many sensor specification sheets PDFs available and you'll never see dynamic range listed as bit-depth, usually as dB.
You may be making an assumption that the chip manufacturer sets bit-depth to match required dynamic range.
That is not true. There are many 16-bit sensors that are well under 16 stops of dynamic range.
And I know of several 12-bit sensors that would have higher dynamic range if they had 14-bit ADCs.

Regards

Reply
Jan 18, 2021 20:33:26   #
TriX Loc: Raleigh, NC
 
hjkarten wrote:
Dear TriX,
Many thanks for your note of clarification. My first effort to send you a reply was lost. I partially responded to your note in my latest response to bclaff.
Yes, I am fully aware of the loss of data in sensors as well as in ADCs, noise in the sensors, ADC, etc. There is always some simplification when writing postings on bulleting boards for general audiences. This discussion is probably grating on the patience of people who just want to enjoy reading about how to best improve their photos.

To address your accurate note: In my lab work I always assume the worst possible result of precision versus validity of data. I spent most of my professional life struggling with the boundary between the nominal output of a device and the valid output after accounting for noise and quantizing errors. I have spent my life fighting repeated battles with S/N. I generally lop off the values generated by the highest bit, and for my 12 bit detectors assume that the system is marginally credible for values of 10+ to 11 bits.
Thank you again for your note.
Harvey
Dear TriX, br Many thanks for your note of clarif... (show quote)


Harvey, thanks for your response. Don’t worry in the least about how grating the minute details of digitizing may be to those that just want to take images - we do it all the time, and they’re not forced to read it. We’re only beginning page 7 - we have at least another 5-6 pages to go. 🙀

Cheers,
Chris

Reply
 
 
Jan 18, 2021 21:08:00   #
Canisdirus
 
This thread is an example of why Photographers are the third-worst ppl to converse with at social gatherings...
Right behind Dentists and Accountants.

Reply
Jan 18, 2021 21:22:23   #
TriX Loc: Raleigh, NC
 
Canisdirus wrote:
This thread is an example of why Photographers are the third-worst ppl to converse with at social gatherings...
Right behind Dentists and Accountants.


And you are now part of that group

Reply
Jan 18, 2021 21:36:29   #
hjkarten Loc: San Diego, California
 
In actual practice, I have the impression that EV values are a messy combination of light transmittance of the properties of the lens at different wavelengths and diffractive state, the aperture, the efficiency of the chip, the spectral response of the sensor at different wavelengths and different intensities - especially when either at saturation with photon overflow or at very low photon number with increased shot noise , the nominal ISO chosen, properties of the ADC and those of the processor dealing with the output of the ADC. (Probably also include the software).
Dynamic Range of the system is equally messy, and the blessing of modern digital cameras is that they work as well as they do! (WHEW! That was a long sentence.)
I would have no problem using dB, but habit might prompt me to think of dB in terms of shot noise at the low end and overflow at the high end, particularly if overloading the electron well. What would be the best parameter to use to deal with dynamic range once you consider the whole process from the perspective of image processing?
How many discrete steps of brightness and at each of the different wavelengths do I have to deal with to cover my original analog input if I want an accurate representation of the original field? I can't do that calculation using EV values, and I would have to undergo all sorts of contortions to do that using dB. (I am not smart enough to even know how it can be done?) That is where digital image processing saves our hides. And that is done at the bit level. It is not simple, and is made again more difficult when you know that the final output has to be re-represented as an analogue product.

Reply
Jan 18, 2021 21:52:21   #
bclaff Loc: Sherborn, MA (18mi SW of Boston)
 
hjkarten wrote:
... (WHEW! That was a long sentence.)
I would have no problem using dB, but habit might prompt me to think of dB in terms of shot noise at the low end and overflow at the high end, ... I can't do that calculation using EV values, and I would have to undergo all sorts of contortions to do that using dB. (I am not smart enough to even know how it can be done?)...

You may not know how to do it but dB and EV are entirely interchangeable; just like feet and meters.
For a rough estimate just divide dB by 6 to get EV.

Dynamic range is simply saturation for the high value and, in the case of a pixel, read noise for the low value.
It's not any more complicated than that (and has nothing to do with photon (shot) noise).

You can take this ratio of high / low and convert it to dB or EV.
Personally I think EV makes more sense in the context of photography.

This is dynamic range at the sensor data was represented by raw (linear) data.
It doesn't map easily to dynamic range in the (perceptual not linear) final output.

Reply
Check out Bridge Camera Show Case section of our forum.
Jan 18, 2021 22:12:19   #
TriX Loc: Raleigh, NC
 
bclaff wrote:
You may not know how to do it but dB and EV are entirely interchangeable; just like feet and meters.
For a rough estimate just divide dB by 6 to get EV.

Dynamic range is simply saturation for the high value and, in the case of a pixel, read noise for the low value.
It's not any more complicated than that (and has nothing to do with photon (shot) noise).

You can take this ratio of high / low and convert it to dB or EV.
Personally I think EV makes more sense in the context of photography.

This is dynamic range at the sensor data was represented by raw (linear) data.
It doesn't map easily to dynamic range in the (perceptual not linear) final output.
You may not know how to do it but dB and EV are en... (show quote)


Yep, 1 EV = 1 bit = 6.02 dB. Question: why, for very low illuminance of the sensor, do you feel that shot noise doesn't contribute to the noise floor?

Reply
Jan 18, 2021 22:39:25   #
hjkarten Loc: San Diego, California
 
TriX wrote:
Yep, 1 EV = 1 bit = 6.02 dB. Question: why, for very low illuminance of the sensor, do you feel that shot noise doesn't contribute to the noise floor?


Hi TriX,
I certainly did not mean to suggest that. Perhaps I made a typo?
I even have a paper on the role of shot noise contributing to the noise in the retina. We argued that one of the benefits of binocular vision in nocturnal animals is that the S/N improves as function of the ^^2, and helps differentiate noise from valid signal. This was first proposed by Dan Steinman (Univ of Maryland) more than 30 years ago. The S/N enhancement probably happens at the level of the visual cortex. A similar benefit can be achieved with on chip integration or using longer dwell time between pixel readouts. But that is difficult to accomplish in the retina. Instead the two conjugate points of the two retinae do it by spatial integration and/or averaging. The first location where a single neuron receives topographical input from two corresponding points of the two retinae is at the cortex. A similar pathway is used in the analysis of stereopsis.

Aha! 1 EV = 1 bit!? = 6.02 dB
My search for that conversion drew a blank this morning.
If so, would that also mean that the Dynamic Range of the system can be directly expressed in bits. End of argument.
Many thanks. Also just got the good news that I am expected at the clinic on Wednesday morning to get my COVID vaccine.
Harvey

Reply
Jan 18, 2021 22:52:06   #
TriX Loc: Raleigh, NC
 
hjkarten wrote:
Hi TriX,
I certainly did not mean to suggest that. Perhaps I made a typo?
I even have a paper on the role of shot noise contributing to the noise in the retina. We argued that one of the benefits of binocular vision in nocturnal animals is that the S/N improves as function of the ^^2, and helps differentiate noise from valid signal. This was first proposed by Dan Steinman (Univ of Maryland) more than 30 years ago. The S/N enhancement probably happens at the level of the visual cortex. A similar benefit can be achieved with on chip integration or using longer dwell time between pixel readouts. But that is difficult to accomplish in the retina. Instead the two conjugate points of the two retinae do it by spatial integration and/or averaging. The first location where a single neuron receives topographical input from two corresponding points of the two retinae is at the cortex. A similar pathway is used in the analysis of stereopsis.

Aha! 1 EV = 1 bit!? = 6.02 dB
My search for that conversion drew a blank this morning.
If so, would that also mean that the Dynamic Range of the system can be directly expressed in bits. End of argument.
Many thanks. Also just got the good news that I am expected at the clinic on Wednesday morning to get my COVID vaccine.
Harvey
Hi TriX, br I certainly did not mean to suggest t... (show quote)


Actually, my question was directed to bclaff. My thought was that maybe the contention is that in most photographic applications, there are enough photons striking the sensor that the Poisson distribution is close to a normal distribution, but I’m waiting to hear his thoughts.

Congratulations on the vaccine - my wife’s is tomorrow, and mine is Wednesday also.

Chris

Reply
Jan 18, 2021 23:05:45   #
bclaff Loc: Sherborn, MA (18mi SW of Boston)
 
TriX wrote:
Yep, 1 EV = 1 bit = 6.02 dB. Question: why, for very low illuminance of the sensor, do you feel that shot noise doesn't contribute to the noise floor?

The noise floor is generally taken as read noise.
Read noise is noise that is present when there is no light.
If there is no light then there is no photon (shot) noise.
So the determination of EDR, pixel level dynamic range, has absolutely nothing to do with shot noise.

DxOMark print dynamic range is simply EDR that is normalized so it also has nothing to do with shot noise (which is one reason it's not that good a measure).

PhotonsToPhotos Photographic Dynamic Range (PDR) does take all forms of noise including shot noise into consideration. The low value in PDR is determined using a Signal to Noise Ratio (SNR) that takes (standard) final image size and viewing distance into consideration.

Reply
Check out Commercial and Industrial Photography section of our forum.
Jan 18, 2021 23:08:36   #
TriX Loc: Raleigh, NC
 
bclaff wrote:
The noise floor is generally taken as read noise.
Read noise is noise that is present when there is no light.
If there is no light then there is no photon (shot) noise.
So the determination of EDR, pixel level dynamic range, has absolutely nothing to do with shot noise.

DxOMark print dynamic range is simply EDR that is normalized so it also has nothing to do with shot noise (which is one reason it's not that good a measure).

PhotonsToPhotos Photographic Dynamic Range (PDR) does take all forms of noise including shot noise into consideration. The low value in PDR is determined using a Signal to Noise Ratio (SNR) that takes (standard) final image size and viewing distance into consideration.
The noise floor is generally taken as read noise. ... (show quote)


Thanks, I take your point, and I share your preference for the methodology of PhotonstoPhotos.

Cheers,
Chris

Reply
Jan 18, 2021 23:09:31   #
bclaff Loc: Sherborn, MA (18mi SW of Boston)
 
hjkarten wrote:
Hi TriX,
...

Aha! 1 EV = 1 bit!? = 6.02 dB
My search for that conversion drew a blank this morning.
If so, would that also mean that the Dynamic Range of the system can be directly expressed in bits. End of argument.
...
Harvey

So long as you are willing to use fractional bit values rather than whole numbers in which case you just saying EV another way (13.5 EV = 13.5 bits). It still is *not* the bit-depth of the ADC that establishes dynamic range only the upper limit.

Reply
Jan 18, 2021 23:11:35   #
bclaff Loc: Sherborn, MA (18mi SW of Boston)
 
TriX wrote:
... I share your preference for the methodology of PhotonstoPhotos...

Thanks for that.
You realize I'm a bit biased in that regard; right?

Reply
Jan 18, 2021 23:16:27   #
TriX Loc: Raleigh, NC
 
bclaff wrote:
Thanks for that.
You realize I'm a bit biased in that regard; right?


I didn’t when I mentioned my preference earlier in the thread (and I have many times in the past), but I do now 😎. Lots of interesting links on your page, Bill.

Cheers,
Chris

Reply
Page <<first <prev 7 of 8 next>
If you want to reply, then register here. Registration is free and your account is created instantly, so you can post right away.
Check out Software and Computer Support for Photographers section of our forum.
Main Photography Discussion
UglyHedgehog.com - Forum
Copyright 2011-2024 Ugly Hedgehog, Inc.