Click here if you are having trouble logging into the forums
Privacy Policy |
Please read our Terms
of Service | Signup and
Troubleshooting FAQ | Problems? PM a Red or a Green Gu… uh, User
yardleydobon
journeyman
Reged: 07/04/10
|
Question about Darks with an Uncooled Camera
#3903109 - 07/04/10 10:50 PM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
What is the best way to take darks for an uncooled camera?
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: yardleydobon]
#3903202 - 07/04/10 11:56 PM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Set your camera up with just the body cap on it in a garage on a cloudy night.
The garage should be at about the same ambient temp as the lights you shot or will shoot.
Use the same ISO as the lights.
Use an exposure as long as the longest lights you might shoot.
Use an interval timer set up to shoot all night long or until your camera battery dies.
Use RAW file format, same as you will use for your lights.
Shoot a set of bias frames also at the same temp and ISO as your lights. Bias should be shot at the shortest exposure your camera can produce, such as 1/8000th of a second.
Use the body cap on the camera body, and the eyepiece cover on the viewfinder. Or cover the viewfinder with black tape.
Do not put the camera in a camera bag or cover it with a jacket or towel or anything like that as it will heat up more than it should.
If you're using an external power supply for the camera for your lights, use the same supply for the darks.
Stack as many as possible to make a really good master dark frame. 64 frames are not too many.
Same with the bias frames.
Use Images Plus with automatic dark frame matching and you can shoot darks every 10 degrees F to make a master dark frame library.
With the bias frames you can scale the darks to match shorter exposures for the lights taken at the same time and ISO.
Jerry
|
yardleydobon
journeyman
Reged: 07/04/10
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3903328 - 07/05/10 01:50 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Thank you for your reply. I'm confused on how you make a master dark out of darks taken at different temperatures. When you say every 10 degrees F, I assume you mean ambient temperature, but what about the CCD heating?
Is it OK to average a bunch of dark subs taken at different temperatures together to get a master dark? Will "automatic dark frame matching" scale this master dark to whichever light it is applied?
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: yardleydobon]
#3903380 - 07/05/10 02:38 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Quote:
Thank you for your reply. I'm confused on how you make a master dark out of darks taken at different temperatures. When you say every 10 degrees F, I assume you mean ambient temperature, but what about the CCD heating?
Yes, I mean you can make a master dark for every 10 degrees F in ambient temp at the start of your exposure run.
The camera will heat up, the internal temp will go up. Don't worry about it. Just note the starting temp.
Quote:
Is it OK to average a bunch of dark subs taken at different temperatures together to get a master dark? Will "automatic dark frame matching" scale this master dark to whichever light it is applied?
No. You don't want to average darks taken at 30F and 70F starting temps.
You want to average a bunch of darks taken at the same ambient starting temp.
You want to shoot, say, 64 darks at 70F and create a master dark from them. Then shoot 64 darks at 60F and create a master dark from them. Etc, etc.
Jerry
|
yardleydobon
journeyman
Reged: 07/04/10
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3914391 - 07/11/10 12:29 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
The heating up of the CCD is still a point of confusion for me. Allow me to explain my understanding of dark frame scaling and then you can correct me if I'm wrong.
Let's assume ambient temperature is constant. I'm taking several ~5 second exposures. Since my CCD is uncooled, each new light frame will be taken at a different CCD temperature. Then if I take darks in the same session they will be at different temperatures from each other and the lights. If I average the darks together to get a master dark, then that master dark will have an equivalent temperature that is somewhere in between the lowest temp dark and the highest temp dark. If I subtract bias frames, I can scale the master dark so that it matches the dark current in a light frame. To scale the master dark I need to scale by exposure time and temperature. However, I don't know the CCD temperature of each light frame, nor the average temperature of the master dark. So this is where I'm stuck.
Also you say:
Quote:
The camera will heat up, the internal temp will go up. Don't worry about it. Just note the starting temp.
Why shouldn't I worry about the CCD temperature?
|
nitegeezer
professor emeritus
   
Reged: 11/27/07
|
Re: Question about Darks with an Uncooled Camera
[Re: yardleydobon]
#3914420 - 07/11/10 01:10 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Once you start taking successive shots, the CCD temperature will stabilize at some amount above ambient. You don't care what the absolute temperature of the CCD is, what you want is for the lights and darks to be relatively close to the same temperature. This stabilization time will vary between cameras, it depends on the thermal paths, and without a sensor right on the CCD you have no other option. If that bothers you, I will really make your day by telling you that the temperature will also vary across the CCD, and this could be a several degree differential. Again, ambient is your only reference point, and this is one that just needs to be accepted.
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: yardleydobon]
#3914507 - 07/11/10 03:20 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
I think you understand things pretty well.
But I believe that Images Plus is doing something different with automatic dark frame matching than what you think it is doing.
It is not just scaling the master dark frame the same amount for each light based on the exposure time difference. (It knows nothing about temperature differences since this data is not available in most DSLR cameras)
I believe the algorithm is looking at the noise in each individual light frame and then scaling the master dark so that the noise added from that is minimized *in each individual light frame*.
I could be wrong about this. I don't know exactly how Mike has implemented the algorithm, and it might be proprietary. You could ask Mike Unsold directly in the Images Plus forum on Yahoo.
The reason I say that you shouldn't worry about the DSLR CMOS sensor temp (almost all recent generation Nikon and Canon sensors are now CMOS and not CCD, btw) is a "real world" DSLR answer... because you usually don't know it, because it is different in every frame, because it is different in every sub dark frame, because you can't control it (unless you build a regulated cooler, and then you might as well just get a real regulated astronomical CCD camera), and because Images Plus automatic dark frame matching (when used with really good master darks and master bias frames) deals with the problem so well, you don't need to worry about it.
Jerry
|
yardleydobon
journeyman
Reged: 07/04/10
|
Re: Question about Darks with an Uncooled Camera
[Re: nitegeezer]
#3914549 - 07/11/10 04:34 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
OK, I understand. I'm thinking that taking a single dark before and/or after a light can be used to get an estimate of the temperature factor for that light. Then the cleaner master dark can be scaled by that factor without having to know what temperature the light was taken at. However, if it's necessary to take a new set of darks for every 10 degrees F, then maybe scaling like this won't be very accurate.
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: yardleydobon]
#3914560 - 07/11/10 04:58 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Taking a dark frame before/after a light is a waste of precious clear dark sky time that is better spent gathering photons in the light frame to improve the signal in the s/n ratio, which cannot be improved any other way.
Jerry
|
Fuzz
super member
Reged: 08/11/09
Loc: Silverthorne, Colorado
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3914871 - 07/11/10 10:41 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Great thread.
Jerry, I'm very new to AP (about 2 months of "real" AP on an equatorial mount). I'm hoping you can tell me if I'm doing this right:
As you suggested, on cloudy nights, I set up my camera (Canon 40D) alongside a garden variety outdoor temperature sensor and take darks through the night.
I make a note of the starting temperature. My temp sensor also saves the maximum and minimum temps. So in the morning, I make a note of the minimum temp. I have a library of darks for that temp range.
When I take lights, I make similar notes of starting and minimum temps.
When calibrating (I use DSS), I use darks from the nearest temp range to the lights. For instance, I shot M31 the other night where my starting temp was 48F and the low temp was 32F. My closest dark library was 45F-35F, so I used the darks from that set to calibrate. Is that right?
Also, I'm assuming once I create a master dark (in DSS) from the 45F-35F darks, I can just use that single master dark frame to calibrate subsequent images (with the same temp range) instead of having to create master darks every time?
Thanks! Btw, reading your website and books have saved me a lot of time from wandering the wilderness of AP.
|
yardleydobon
journeyman
Reged: 07/04/10
|
Re: Question about Darks with an Uncooled Camera
[Re: Fuzz]
#3915482 - 07/11/10 05:32 PM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Thanks, Jerry. You posted as I was composing my last post so I didn't see it. I'm going to repost what you said in the How does Automatic Dark Frame Matching work? thread.
Quote:
Taking a dark frame before/after a light is a waste of precious clear dark sky time that is better spent gathering photons in the light frame to improve the signal in the s/n ratio, which cannot be improved any other way.
But couldn't one take a short dark before and after the light and then scale that up to the much longer exposure time of the light? This way you would capture the temperature of the light without wasting time. Not sure how well this would scale. I'll try this out and look at the data in Matlab.
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: Fuzz]
#3915908 - 07/11/10 09:40 PM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Hi Fuzz,
Are you shooting your darks outside?
A temp range of 48 to 32 degrees seems like a lot for a single master dark.
I shoot inside my unheated garage and the temp is stable all night long to within a degree or two.
Once I make a master dark in Imges Plus, I use it over and over, but you have to make sure you use the same parameters for the lights, such as the white balance.
Jerry
|
Fuzz
super member
Reged: 08/11/09
Loc: Silverthorne, Colorado
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3916059 - 07/11/10 10:50 PM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Jerry, yes, I'm shooting the darks outside, right by where I have my scope setup. Over a full summer night (10pm - 4:30am), there's usually a 10F temperature change. My thinking is that since my lights, which I also take over the same period, also experience a similar 10F temperature change.
I live at 9,000 feet in the mountains. 40F temperature swings from overnight lows to daytime highs are common.
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: Fuzz]
#3916693 - 07/12/10 10:41 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
If it's the same temp drop as your lights I guess that's as good as you're going to be able to do...
Jerry
|
Fuzz
super member
Reged: 08/11/09
Loc: Silverthorne, Colorado
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3916737 - 07/12/10 11:06 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
So Jerry, when you say that you get only a 1-2F change in your darks, do you get similar 1-2F changes when you're shooting lights?
Given that I get ~10F change overnight when shooting lights, do you think I should shoot my darks at more stable temps (i.e. in an unheated garage like you)?
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: Fuzz]
#3916760 - 07/12/10 11:20 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Of course shooting throughout the year I get different temp drops on different nights. But on average, over the course of a 1-2 hour exposure run, the ambient temp usually only drops a couple of degrees for a given object.
This would usually be about the most the ambient temp in my garage would drop over the course of an entire night, so I can get a really good master dark that matches the lights for a single object.
The difference in what you are doing is that you are probably not shooting a single object over the course of an entire night, so you're not getting a drop of 16 degrees in ambient temp for the entire run of lights, but you are for your entire run of darks.
I would think that if, in fact, you shoot lights for a couple of hours, and get an ambient temp drop of 2,3,4 or 5 degrees over those couple of hours, then shooting your darks over the course of an entire night in a more stable environment would be a better match.
Jerry
|
Fuzz
super member
Reged: 08/11/09
Loc: Silverthorne, Colorado
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3916839 - 07/12/10 12:27 PM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Quote:
The difference in what you are doing is that you are probably not shooting a single object over the course of an entire night, so you're not getting a drop of 16 degrees in ambient temp for the entire run of lights, but you are for your entire run of darks.
Actually, I do usually shoot a single target through the whole night (I image from my backyard, so I set it up and go to bed).
So I do in fact get a ~10F drop for a single target. And since my darks also have a similar drop, I'm thinking it's a good match.
Sometimes when I do shoot shorter total exposures, I don't match to the master dark for the full temp drop. For instance, I imaged something the other night for only a couple of hours. Temp drop was only 44F-40F. So I did not use my 45F-35F master dark. Instead, I created another master dark using the first half of my raw dark subs (which approximates a 45F-40F drop - I know the temp drop is not linear, but that's about as good as I can get).
Does that sound okay?
Quote:
I would think that if, in fact, you shoot lights for a couple of hours, and get an ambient temp drop of 2,3,4 or 5 degrees over those couple of hours, then shooting your darks over the course of an entire night in a more stable environment would be a better match.
A question on this: let's say I shoot 5 hours of darks at a stable temp of 45F. So the tail-end of those darks have 5 hours worth of thermal noise. But say my light exposures total only 3 hours. In that case, the darks won't really match, because my darks have 0-5 hours of thermal noise, while my lights max out at 3 hours. Is that right? That's the thinking that led me to my current process -- because I'm trying to match both the temperature range and total exposure time for both my lights and darks.
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: Fuzz]
#3918342 - 07/13/10 01:32 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Quote:
Actually, I do usually shoot a single target through the whole night (I image from my backyard, so I set it up and go to bed).
If you are getting a 16 degree temp drop of the course of a night, how do you keep the images in focus all night long if you go to bed? You surely must be getting a focus shift with that kind of temperature drop. Are you using an electronic focuser with automatic temperature compensation?
Quote:
So I do in fact get a ~10F drop for a single target. And since my darks also have a similar drop, I'm thinking it's a good match.
That sounds reasonable.
Quote:
Sometimes when I do shoot shorter total exposures, I don't match to the master dark for the full temp drop. For instance, I imaged something the other night for only a couple of hours. Temp drop was only 44F-40F. So I did not use my 45F-35F master dark. Instead, I created another master dark using the first half of my raw dark subs (which approximates a 45F-40F drop - I know the temp drop is not linear, but that's about as good as I can get).
Does that sound okay?
Well, you seem to be a little fixated on the ambient temperature drop, but the camera is also heating up during an exposure run until it stabilizes after a couple of hours.
Quote:
A question on this: let's say I shoot 5 hours of darks at a stable temp of 45F. So the tail-end of those darks have 5 hours worth of thermal noise. But say my light exposures total only 3 hours. In that case, the darks won't really match, because my darks have 0-5 hours of thermal noise, while my lights max out at 3 hours. Is that right? That's the thinking that led me to my current process -- because I'm trying to match both the temperature range and total exposure time for both my lights and darks.
Ideally, you want to match the temp, but have a lot more total exposure time in the darks than in your lights.
It doesn't really make sense the say the "tail end of the darks has 5 hours of thermal noise". Each frame has its own exposure length of thermal signal based on its temperature.
I believe you may be making a common misconception confusing signal and noise.
Thermal signal is not noise. So, with 5 hours of darks you don't have 5 hours of noise. You have an average of the thermal signal for the length of each sub exposure, and you have the square root of that in noise. You actually have less noise in 5 hours worth of exposures than you do in 3 hours worth.
Using a dark frame removes thermal signal and actually adds the posisson noise associated with that signal. It is critical to understand this.
Every signal has noise associated with it. It's called photon noise, or shot noise, or poisson noise (they're all the same thing).
Shooting lights and darks are doing exactly the same thing... they are recording signal and its associated noise.
In the case of lights, they are recording object signal, sky signal, and thermal signal. Each has noise associated with their respective signals. There are also other sources of true noise involved, such as readout noise, but I'm not going into that here.
Darks are only recording thermal signal and its associated noise.
The whole purpose of stacking lights and darks is to increase the signal to noise ratio between the signal and its associated noise. You do this by averaging a bunch of frames. In an average, the signal stays the same, but the noise is then reduced by the square root of the total signal.
For example, you shoot 16 x 5min of light, or dark frames.
In a single frame you get x amount of signal and the square root of that amount of noise.
In the average stack of 16 frames, you get the same x amount of signal but only 1/4 the amount of noise (the square root of 16 frames).
If you just subtracted a single light frame, you would be removing the thermal signal, but you would be adding 4x as much true noise to the image compared to using the master dark made of 16 subs.
When you subtract a dark to remove the thermal signal from the light, you are actually adding the noise from the dark to the light. That actually increases the true noise in the light frame after calibration.
By shooting a lot of darks to make a really good dark frame, you reduce the true noise in the master dark, so less is added when the dark is subtracted from the light.
This is why you want to shoot a lot of dark sub frames to create a really good master dark.
6 hours of darks is going to produce a higher signal to noise ratio than 3 hours of darks. Less noise will be added with 6 hours of darks compared to 3 hours of darks.
Now, everything gets complicated by the fact that the internal camera temp is increasing for a couple of hours until it stabilizes, and this is different for each camera, and by the fact that, in your case, the ambient temperature is dropping by a substantial amount at the same time.
I guess you could do a complicated mathematical analysis by actually measuring each frame and then figure out which is the best way to put them together, but that is beyond my skill level, and I just don't worry about it because I have always had excellent results by using really good master darks and master biases with Images Plus automatic dark frame matching.
I don't believe DSS is using the same methodology as IP, so I can not advise you as to what is the best way to proceed in DSS.
Jerry
|
Jerry Lodriguss
Vendor
Reged: 07/19/08
Loc: Voorhees, NJ
|
Re: Question about Darks with an Uncooled Camera
[Re: yardleydobon]
#3918404 - 07/13/10 02:49 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Quote:
But couldn't one take a short dark before and after the light and then scale that up to the much longer exposure time of the light? This way you would capture the temperature of the light without wasting time. Not sure how well this would scale. I'll try this out and look at the data in Matlab.
The common wisdom is that you need to scale a dark down in time to get the best result, not up.
I think you would need to expose the darks long enough to get close to the light in time, and then you're wasting clear dark sky time.
If you had a camera that recorded the sensor temp, you could simply shoot a bias frame before and after, to record the starting and ending temp for your light frame, and then create a custom dark frame by doing the same for each individual dark frame, and only using the ones that match, and over the course of many many nights, and much work, you might be able to match each light with a good master dark. But at this point you might as well get a real astronomical CCD camera with a regulated cooler and put all of this work and effort into imaging and post-processing instead of trying to optimize calibration in a "never-will-be-perfect" world of DSLR astrophotography.
I guess some people like to dabble. I like to image. Whatever floats your boat. :-)
Thermal signal scales linearly with exposure time, but the doubling time for temp is different for different cameras.
Are you planning on writing your own code to optimize the dark frame subtraction?
Jerry
|
Fuzz
super member
Reged: 08/11/09
Loc: Silverthorne, Colorado
|
Re: Question about Darks with an Uncooled Camera
[Re: Jerry Lodriguss]
#3918594 - 07/13/10 08:37 AM
|
Edit
|
Reply
|
Quote |
Quick Reply
|
|
|
Jerry, thanks a lot for your detailed replies. This has been a great education for me. I've only started doing AP seriously this summer, so I'm always eager to learn. I've been making master darks from each night's set of darks (with a large change in temp). Based on my understanding of what you're saying, what I really should do (in order to reduce noise when removing the thermal signal) is create master darks at/around the same temp from multiple nights instead.
|
|
9 registered and 20 anonymous users are browsing this forum.
Moderator: Undermidnight, fishonkevin
Print Thread
|
Forum Permissions
You cannot start new topics
You cannot reply to topics
HTML is disabled
UBBCode is enabled
|
Thread views: 1413
|
|
|
|
|
|
|