Jump to content

  •  

CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.

Photo

Post your Pixinsight Processing Flow!

  • Please log in to reply
113 replies to this topic

#76 starhunter50

starhunter50

    Viking 1

  • *****
  • Posts: 564
  • Joined: 07 Sep 2010
  • Loc: Tilbury,Ontario 42N , 82W

Posted 29 July 2019 - 10:20 AM

true enough,   cant wait to see that module in action .

 

Mitch


  • Bcteleskier likes this

#77 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 12 August 2019 - 11:13 PM

Here is the next update to my PixInsight Process flow. Here are the changes:

 

  1. By request, marked sections that apply only to OSC camera data in itialics, and to narrowband data in bold. You will see that only a small part of the processing flow is unique to these types of data and most of the information applies to all types of data.
  2. Redid the section on processing the MasterLight frames in the linear state before combination to form the RGB image in much more detail and with section headers
  3. A new section of MUREDenoise - this is a great tool
  4. added set of images showing the process steps in MasterLight frame process.
  5. added a sections on artifacts from LRGBComination
  6. added more screenshots of sharpening and HDRMST
  7. Added a workflow outline for LRGB

Here is the link:

 

https://drive.google...zmG2F2NcqXMlUw5

 

As always comment, questions and suggestions for further content are welcome.


  • timmbottoni, Robert, okiedrifter and 12 others like this

#78 telfish

telfish

    Surveyor 1

  • *****
  • Posts: 1984
  • Joined: 17 Nov 2010
  • Loc: Adirondack Mountains NY

Posted 14 August 2019 - 08:50 AM

Thanks so much for the huge effort you have put in on this.



#79 PilotAstronomy

PilotAstronomy

    Explorer 1

  • *****
  • Posts: 97
  • Joined: 25 Sep 2017

Posted 15 August 2019 - 03:09 PM

Nice update! Thank you for taking my feedback—that little change made it make so much more sense to me what I should be doing when. The workflow at the end is helpful, too. I’ll try and find the time to run it through my latest data this weekend and let ya know if I have any more questions/feedback but I just read through it and it already answered some of my questions.



#80 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 15 August 2019 - 09:31 PM

Nice update! Thank you for taking my feedback—that little change made it make so much more sense to me what I should be doing when. The workflow at the end is helpful, too. I’ll try and find the time to run it through my latest data this weekend and let ya know if I have any more questions/feedback but I just read through it and it already answered some of my questions.

I am already working on the next update. I will be added other process flows for other options such as narrowband and OSC. I am also moving the deconvolution section up and updating it since I am now using it much more extensively and successfully. I also have some new scripts that I just added that are helpful too. I may also upload my set of process icons that go with the flow.


  • timmbottoni, starhunter50, telfish and 2 others like this

#81 starhunter50

starhunter50

    Viking 1

  • *****
  • Posts: 564
  • Joined: 07 Sep 2010
  • Loc: Tilbury,Ontario 42N , 82W

Posted 15 August 2019 - 09:33 PM

Kool cant wait...



#82 Jim Waters

Jim Waters

    Gemini

  • *****
  • Posts: 3007
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 18 August 2019 - 07:39 PM

Here's the top of the 9 page doc I created - Summary Flowchart..  It focuses on DSLR's and OSC's

 

DSLR Image Processing Master Update
Album: PixInsight
1 images
0 comments


Edited by Jim Waters, 18 August 2019 - 07:41 PM.

  • timmbottoni likes this

#83 timmbottoni

timmbottoni

    Vanguard

  • *****
  • Posts: 2217
  • Joined: 25 Aug 2005
  • Loc: W Chicago suburbs, IL USA

Posted 19 August 2019 - 07:59 PM

Here's the top of the 9 page doc I created - Summary Flowchart..  It focuses on DSLR's and OSC's

 

Where is your flowchart available for download?

 

Thanks!

 

Timm


  • starhunter50 likes this

#84 starhunter50

starhunter50

    Viking 1

  • *****
  • Posts: 564
  • Joined: 07 Sep 2010
  • Loc: Tilbury,Ontario 42N , 82W

Posted 19 August 2019 - 08:02 PM

Here's the top of the 9 page doc I created - Summary Flowchart..  It focuses on DSLR's and OSC's

 

where can we get that info? 



#85 Jim Waters

Jim Waters

    Gemini

  • *****
  • Posts: 3007
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 19 August 2019 - 08:10 PM

where can we get that info? 

Here's the draft doc.  Its being reviewed now.  Next major rev will add CosmeticCorrection and guides for determining Sigma High and Sigma Low values.

 

EDIT - feedback, good or bad is always accepted.

 

https://drive.google...HJMSlLeP_o-pFjm


Edited by Jim Waters, 19 August 2019 - 08:11 PM.

  • timmbottoni, elmiko, starhunter50 and 1 other like this

#86 niccoc1603

niccoc1603

    Ranger 4

  • -----
  • Posts: 318
  • Joined: 16 Aug 2018
  • Loc: Firenze, Italy

Posted 02 September 2019 - 12:41 AM

Here is the next update to my PixInsight Process flow. Here are the changes:

 

  1. By request, marked sections that apply only to OSC camera data in itialics, and to narrowband data in bold. You will see that only a small part of the processing flow is unique to these types of data and most of the information applies to all types of data.
  2. Redid the section on processing the MasterLight frames in the linear state before combination to form the RGB image in much more detail and with section headers
  3. A new section of MUREDenoise - this is a great tool
  4. added set of images showing the process steps in MasterLight frame process.
  5. added a sections on artifacts from LRGBComination
  6. added more screenshots of sharpening and HDRMST
  7. Added a workflow outline for LRGB

Here is the link:

 

https://drive.google...zmG2F2NcqXMlUw5

 

As always comment, questions and suggestions for further content are welcome.

Thank you for updating this excellent document

 

I see when you integrate you use MAD as Scale Estimator over the widely used/ recommended Iterative k-sigma

Can you please elaborate a bit on this?

 

For SubFrameSelector you write

 

when loading the files for the light frames into the process,
make sure that you chose the CosmeticCorrection frames and not the calibrated
frames

 

for OSC, should it be Debayered images?

 

thanks


Edited by niccoc1603, 02 September 2019 - 01:03 AM.


#87 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 02 September 2019 - 09:11 AM

Thank you for updating this excellent document

 

I see when you integrate you use MAD as Scale Estimator over the widely used/ recommended Iterative k-sigma

Can you please elaborate a bit on this?

 

For SubFrameSelector you write

 

for OSC, should it be Debayered images?

 

thanks

You can used either the iterative K-sigma or the MAD. One tutorial I used recommended MAD and the Adam Block videos has a detailed explaination of the differences. I now have gone back to the k-sigma. I do the subframeselector scoring after cosmetic correction for monochrome frames and after cosmetic correction and debayer for OSC



#88 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 07 September 2019 - 07:19 PM

Working on the next update with some improvements in stadegy for Ha blending into RBG for galaxies and some new approaches for StarMask generation that really can be very useful. The ability to create the exact mask that you need is so crucial in PI.



#89 starhunter50

starhunter50

    Viking 1

  • *****
  • Posts: 564
  • Joined: 07 Sep 2010
  • Loc: Tilbury,Ontario 42N , 82W

Posted 07 September 2019 - 08:42 PM

cant wait for that release



#90 basskep

basskep

    Explorer 1

  • -----
  • Posts: 72
  • Joined: 23 Aug 2018

Posted 17 September 2019 - 09:36 AM

Here is the next update to my PixInsight Process flow. Here are the changes:

 

  1. By request, marked sections that apply only to OSC camera data in itialics, and to narrowband data in bold. You will see that only a small part of the processing flow is unique to these types of data and most of the information applies to all types of data.
  2. Redid the section on processing the MasterLight frames in the linear state before combination to form the RGB image in much more detail and with section headers
  3. A new section of MUREDenoise - this is a great tool
  4. added set of images showing the process steps in MasterLight frame process.
  5. added a sections on artifacts from LRGBComination
  6. added more screenshots of sharpening and HDRMST
  7. Added a workflow outline for LRGB

Here is the link:

 

https://drive.google...zmG2F2NcqXMlUw5

 

As always comment, questions and suggestions for further content are welcome.

Wowww Great job ! Thanks for sharing :-)



#91 lowry_pt

lowry_pt

    Lift Off

  • *****
  • Posts: 9
  • Joined: 07 Aug 2018

Posted 05 October 2019 - 02:18 AM

What a phenomenal undertaking.  THANK you for taking the time.


  • Alfredo Beltran and starhunter50 like this

#92 starhunter50

starhunter50

    Viking 1

  • *****
  • Posts: 564
  • Joined: 07 Sep 2010
  • Loc: Tilbury,Ontario 42N , 82W

Posted 05 October 2019 - 09:38 AM

That is an understatement..  and i teach Pixinsight !!!  .. AAA+++  PDF tutorial.

 

AstroDude ...



#93 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 05 October 2019 - 02:57 PM

I am about 60% through with the next revision. I already have 106 screen captures to this point and counting. Couple of new sections coming.



#94 Jim Waters

Jim Waters

    Gemini

  • *****
  • Posts: 3007
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 05 October 2019 - 03:24 PM

I am about 60% through with the next revision. I already have 106 screen captures to this point and counting. Couple of new sections coming.

Great.

 

Can you make a clear distinction between DSLR/OSC and Mono (RGB/NB).

 

EDIT - It would also be good to list some guidelines for determining Sigma High and Low values.


Edited by Jim Waters, 05 October 2019 - 03:26 PM.


#95 Jim Waters

Jim Waters

    Gemini

  • *****
  • Posts: 3007
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 05 October 2019 - 08:37 PM

You may want to revise / update the doc for the current PI release.  I am running into processing differences.



#96 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 05 October 2019 - 10:20 PM

Great.

 

Can you make a clear distinction between DSLR/OSC and Mono (RGB/NB).

 

EDIT - It would also be good to list some guidelines for determining Sigma High and Low values.

Jim,

 

I already did this on the previous version with different fonts for these different processing methods. Choise of sigma high and low values is more of a choice than anything. I dont cut into the sigma high as some other recommend. This is pure statistics. For a normal distribution, 3 sigma is 99.7% of the distribution and should eliminate true outliers in the remaining 0.3% of the population. However, this assumes a good sized population and the population is the # of frames. If you are using a CCD with 20 minute subs and only have 5 frames, you dont really have a good population. For my CMOS images I usually have  60-300 frames and then statistics make sense. I have never fooled with this much since I think you can clearly over think it if you have lots of subframes like I have. 

 

 

You may want to revise / update the doc for the current PI release.  I am running into processing differences.

I may,  but the number of changes is not that great and I have yet to use it so it will be a while for that.


  • starhunter50 likes this

#97 niccoc1603

niccoc1603

    Ranger 4

  • -----
  • Posts: 318
  • Joined: 16 Aug 2018
  • Loc: Firenze, Italy

Posted 06 October 2019 - 11:46 AM

I am about 60% through with the next revision. I already have 106 screen captures to this point and counting. Couple of new sections coming.


It would be awesome if you could add an index, it's becoming almost a book

Also, some preliminary processing workflow charts would help

Edited by niccoc1603, 06 October 2019 - 11:47 AM.

  • starhunter50 likes this

#98 starhunter50

starhunter50

    Viking 1

  • *****
  • Posts: 564
  • Joined: 07 Sep 2010
  • Loc: Tilbury,Ontario 42N , 82W

Posted 06 October 2019 - 12:08 PM

I would Pay for this $$$



#99 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 06 October 2019 - 04:57 PM

It would be awesome if you could add an index, it's becoming almost a book

Also, some preliminary processing workflow charts would help

Process flows are already in the latest version at the end.


Edited by cfosterstars, 06 October 2019 - 04:58 PM.

  • starhunter50 and niccoc1603 like this

#100 cfosterstars

cfosterstars

    Mercury-Atlas

  • *****
  • topic starter
  • Posts: 2580
  • Joined: 05 Sep 2014
  • Loc: Austin, Texas

Posted 14 October 2019 - 10:22 PM

Just an update on status: Due to multiple requests, this latest update is taking WAY longer than I thought. I have been having to learn how to do new things in MSWord to add figure captions, TOC, and indexes and the same time as a complete and careful refresh of the all the sections as well as adding additions screen captures from sections that I had not addressed and some completely new sections. The flow is now up to 215 pages and growing with all these new features. I hope it is worth it. I have about 60% of the re-write done, but I still have to add the TOC and complete the index. I have already spent about 10 full evenings on this and it will probably be about another couple of weeks of work. The weather has been cloudy so no new data collection, but I have data sets unprocessed. Anyway I will keep you all posted.


  • AnakChan, niccoc1603 and basskep like this


CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.


Recent Topics






Cloudy Nights LLC
Cloudy Nights Sponsor: Astronomics