Jump to content

  •  

CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.

Photo

PixInsight: EZ Processing Suite - the suite for your processing needs

  • Please log in to reply
237 replies to this topic

#1 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 24 July 2020 - 06:45 PM

Hello everyone,

 

I have been coding in the past few weeks on a set of scripts which I have dubbed the EZ Processing Suite. Although it doesn't do only processing and the script collection is still small I still want to share it with you guys.

 

It's still early days and heavy under development and constantly improving. Just a few minutes ago I ported all the scripts I had to my new EZ Common Runtime 2.0 - so yeah expect things to not work 100% smoothly or break. Some scripts will require StarNet++ either running in PI or a mask generated by StarNet++ from the application.

 

Ok long story short, let me tell you what the EZ Processing Suite contains.

 

EZ Common Runtime 2.0

 

This is the base I have coded all scripts on. All scripts feature similar features (where applicable):

  • How-to use button with prerequisites and steps to apply the script effectively
  • Able to run on previews with multiple tabs to apply the results
  • Results can be applied to the whole image afterwards
  • Extensive console output of the current state and processes happening
  • Settings are stored throughout multiple sessions after applying them
  • Previews in the script respect original STF or if none applied, compute their own
  • Works on RGB and Luminance images
  • Possible to change target image and previews within the scripts

EZ Denoise

 

A script based on Jon Ristas' TGVDenoise + MultiscaleMedianTransform method. Works best in linear image state.

 

Main features:

  • Generate Masks and Processes for TGV Denoise
  • Evaluate the whole denoise process on previews and compare against the original
  • Adjust mask settings freely to find the settings that work for you
  • Does the whole denoising process for you

Screenshot with example result:

 

CwMNlw5.png

 

EZ Decon

 

A script based on OkeWoke's (a friend of mine) deconvolution method by running deconvolution without deringing and replacing the stars with an extensive star mask afterwards. Uses StarNet++.

 

Main Features:

  • Automatically generate fitting star masks with StarNet++
  • Quickly edit star masks and compare how well they cover the image
  • Automatically generate PSF for your image
  • Adjust necessary deconvolution options at will with semi-sane defaults
  • Evaluate the whole deconvolution chain over previews and compare against the original

Screenshot with star mask window and controls visible:

 

C3Bkuma.png

 

Screenshot with example result:

 

L2AMY0w.jpg

 

EZ Soft Stretch

 

A script that will use the HistogramTransformation to stretch an image to a non-linear state with automatic black point detection and reliable median calculation based off my own methods of stretching images to non-linear.

 

Main features:

  • Adjust target median and stretch aggressiveness with easy to use sliders
  • Get a live computed preview and information about your result, what you see is what you get
  • Using linear regression to calculate blackpoint based on summed histogram

Screenshot with example result:

 

paeOI4w.png

 

EZ Star Reduction

 

Utilizing StarNet++ this will generate a reliable contours mask which then uses MorphologicalTransformation to reduce star sizes reliably. Easy to use and good, not too strong results.

 

Main features:

  • Generates and adjusts a proper star mask for you
  • Simple controls that don't need much tweaking
  • Reduces stars effectively

Screenshot of the UI:

 

Lm631sR.png

 

Example result before/after

 

lR0l2Me.png

 

EZ Live Stack

 

Not really a processing addon, but it does exactly what it says. It will monitor a folder for incoming files and stack them together, giving you a good preview of what the nights' result will be.

 

Main features:

  • Can be started in the middle of any image run and will integrate everything
  • Allows the use of master calibration files for a better stack preview
  • Can export the live stack and load it in later if you want to continue with the live stacking session without restacking previously stacked files
  • This also works multi-night since it persists throughout saves
  • Will perform rudimentary basic rejection (as good as you can get I guess)

Screenshot with example stack:

 

9YUW3zL.jpg

 

And that is it so far. More is to come, more features for each script too as I know myself. If you have any ideas let me know.

If you made it this far you might be interested in actually getting it, the repo URL is https://darkarchon.i...et-box.ch:8443/

 

UPDATE: NEW REPO URL

 

To note: to report issues please come to my Discord and post it there. I am very rarely on CN and probably won't see if people post issues here. The discord link is embedded in the exit message of the scripts.

 

Thanks for reading and have clear skies!


Edited by darkarchon, 25 July 2020 - 03:00 PM.

  • StephenW, John_K, dswtan and 52 others like this

#2 Aaron_tragle

Aaron_tragle

    Viking 1

  • *****
  • Posts: 972
  • Joined: 23 Jul 2017
  • Loc: Richmond, Virginia

Posted 24 July 2020 - 08:18 PM

Can't wait to use this in my workflow, running different settings for denoise in real-time will be a game changer for me.


  • darkarchon and hkclover like this

#3 mewmartigan

mewmartigan

    Apollo

  • *****
  • Posts: 1,386
  • Joined: 02 Jul 2008
  • Loc: outside of Pittsburgh, PA

Posted 24 July 2020 - 08:27 PM

They sound neat. I will give them a try.
  • darkarchon likes this

#4 ezwheels

ezwheels

    Surveyor 1

  • *****
  • Posts: 1,591
  • Joined: 04 Jul 2017
  • Loc: Oakland, CA.

Posted 24 July 2020 - 08:40 PM

I can vouch for these scripts. They are very well designed and work extraordinary well. 


  • psandelle and darkarchon like this

#5 matthew_carlos

matthew_carlos

    Sputnik

  • -----
  • Posts: 34
  • Joined: 26 Jun 2019

Posted 24 July 2020 - 08:47 PM

Works. Very Slick. This plus Cuda Starnet ++ marriage makes it EZPZ.


  • darkarchon likes this

#6 Jim Waters

Jim Waters

    Cosmos

  • *****
  • Posts: 9,232
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 24 July 2020 - 08:48 PM

I have seen darkarchon on the NINA Discord Forum.  Is darkarchon one of the developers?


  • darkarchon likes this

#7 ezwheels

ezwheels

    Surveyor 1

  • *****
  • Posts: 1,591
  • Joined: 04 Jul 2017
  • Loc: Oakland, CA.

Posted 24 July 2020 - 09:41 PM

Yes, he is one of the devs. He is on the NINA Discord very regularly and is very generous with his time in helping everyone with NINA and processing. 


  • Aaron_tragle and darkarchon like this

#8 Jim Waters

Jim Waters

    Cosmos

  • *****
  • Posts: 9,232
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 24 July 2020 - 09:44 PM

waytogo.gif  Thanks.



#9 kisstek

kisstek

    Viking 1

  • *****
  • Posts: 696
  • Joined: 25 Jul 2018

Posted 24 July 2020 - 10:26 PM

I saw Cuiv's video on the eZ suite and was impressed enough I ran out to install it and try it out. Unfortunately, since I have a Mac, I have to wait until the next release of PixInsight to be released before I can try it.

 

And wait for NINA 1.10 to be released.

 

And wait for APT to be released with autofocus.

 

And wait for a job offer.

 

And wait for the Monsoon to end.

 

And wait. And wait. smile.gif


  • Jim Waters, David Boulanger and Baron von Smoogle like this

#10 mrszymon

mrszymon

    Lift Off

  • -----
  • Posts: 23
  • Joined: 09 Aug 2014

Posted 25 July 2020 - 03:26 AM

I saw Cuiv's video on the eZ suite and was impressed enough I ran out to install it and try it out. Unfortunately, since I have a Mac, I have to wait until the next release of PixInsight to be released before I can try it.

And wait for NINA 1.10 to be released.

And wait for APT to be released with autofocus.

And wait for a job offer.

And wait for the Monsoon to end.

And wait. And wait. smile.gif


You can use the EZ Suite with Mac at the moment. Three options:

1. Go back to an older PI version — the previous one doesn’t enforce signed libraries and can work with StarNet++

2. Remove the signature from the current PI binary. The PI folks don’t like this idea so I won’t provide instructions but it works.

3. In EZ Suite provide it with a Star Mask rather than trying to autogenerate it with StarNet++. You could use the Star Alignment process to create a mask, for example, or you could use the command line version of StarNet which works as a standalone on the Mac.

The EZ Suite is a real time saver, automating things that you were probably doing anyway and making it easy to use. I love it :-)
  • darkarchon likes this

#11 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 25 July 2020 - 08:03 AM

Update:

 

EZ Common Runtime 2.1:
- add generic doPixelMath
- Bugfix selecting empty main view locking up scripts

 

EZ Decon 0.12:
- adjust star mask with adding custom ellipses (thanks for Herbert Bornemanns GAME script)
- ellipses can be added to star mask and removed from star mask to fine tune the auto generated result

pCtyOlo.jpg


  • Jim Waters, rdmarco and calypsob like this

#12 telfish

telfish

    Mercury-Atlas

  • *****
  • Posts: 2,649
  • Joined: 17 Nov 2010
  • Loc: Adirondack Mountains NY

Posted 25 July 2020 - 08:11 AM

This looks really interesting, will download and try it out, anything that makes PI more accessible is a great thing. Many thanks for your efforts and especially keeping this public.


  • darkarchon likes this

#13 calypsob

calypsob

    Cosmos

  • *****
  • Posts: 9,018
  • Joined: 20 Apr 2013
  • Loc: Virginia

Posted 25 July 2020 - 08:39 AM

WOW I think I might be able to do an entire workflow in PIxinsight with this



#14 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 25 July 2020 - 08:42 AM

WOW I think I might be able to do an entire workflow in PIxinsight with this

You can get pretty far.

 

Here are two examples I did using almost exclusively using those scripts.

Attached Thumbnails

  • 111075709_3461617487206531_3375745780410832334_o.jpg
  • 111009801_3461616187206661_7748039431626715169_o.jpg

  • Jim Waters, psandelle, mikewayne3 and 8 others like this

#15 Dereksc

Dereksc

    Viking 1

  • *****
  • Posts: 601
  • Joined: 11 Jan 2014
  • Loc: Santa Cruz, CA

Posted 25 July 2020 - 01:25 PM

darkarchon,

 

I have been using PI for over 3 years. Even though I am familiar with a lot of PI's capabilities, I am still trying to improve my workflow (efficiency, repeatability) and quality of final image. I think EZ Processing Suite is going to give me a significant improvement in both. So far I have just used EZ Decon. I am very impressed! The tool layout and process flow is clean and logical, you have included very useful advice for using the tool. The default tool values worked well on my images and gave me a great starting point for fine tuning. The way that you track deconvolution trials with additional tabs is great - it makes the iterative process much simpler to control and keep track of.

 

This looks like it is going to be an incredible resource. Thanks for coming up with the idea, for all your time and effort in developing the scripts and for making EZ Processing Suite available to everybody.

 

Regards

 

Derek


  • deuscaput, mrszymon, PhotonHunter1 and 2 others like this

#16 santafe retiree

santafe retiree

    Apollo

  • *****
  • Posts: 1,208
  • Joined: 23 Aug 2014
  • Loc: Santa Fe, NM

Posted 25 July 2020 - 01:38 PM

Thank you for this great contribution.  Is there a graceful way to exit the script mid-process? I do not see a "Cancel" button. Cheers,  Tom  



#17 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 25 July 2020 - 01:45 PM

darkarchon,

 

I have been using PI for over 3 years. Even though I am familiar with a lot of PI's capabilities, I am still trying to improve my workflow (efficiency, repeatability) and quality of final image. I think EZ Processing Suite is going to give me a significant improvement in both. So far I have just used EZ Decon. I am very impressed! The tool layout and process flow is clean and logical, you have included very useful advice for using the tool. The default tool values worked well on my images and gave me a great starting point for fine tuning. The way that you track deconvolution trials with additional tabs is great - it makes the iterative process much simpler to control and keep track of.

 

This looks like it is going to be an incredible resource. Thanks for coming up with the idea, for all your time and effort in developing the scripts and for making EZ Processing Suite available to everybody.

 

Regards

 

Derek

Thank you very much for your kind words Derek, it means a lot to me.

 

Thank you for this great contribution.  Is there a graceful way to exit the script mid-process? I do not see a "Cancel" button. Cheers,  Tom  

Just close the script with the [x] at the top and cancel running processes. There is no cancellation of running processes currently implemented from via script-side.


Edited by darkarchon, 25 July 2020 - 01:45 PM.


#18 terry59

terry59

    Voyager 1

  • *****
  • Posts: 10,992
  • Joined: 18 Jul 2011
  • Loc: Colorado USA

Posted 25 July 2020 - 01:59 PM

Thank you very much for these. When I set things up PI advised me that the repository is unsecure and that future versions won't allow it. I assume you are aware of this



#19 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 25 July 2020 - 02:00 PM

Thank you very much for these. When I set things up PI advised me that the repository is unsecure and that future versions won't allow it. I assume you are aware of this

I'm actually not but I might migrate it to https at some point. Thanks for notifying.



#20 Jim Waters

Jim Waters

    Cosmos

  • *****
  • Posts: 9,232
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 25 July 2020 - 02:39 PM

Hi darkarchon -

 

I just got this error message when starting up PI.

 

"http://darkarchon.in...et-box.ch:8888/: Couldn't retrieve repository information (unknown reason)."



#21 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 25 July 2020 - 03:00 PM

Yes I have just migrated it to HTTPS

 

Please use https://darkarchon.i...et-box.ch:8443/ as the new repository URL


  • SeymoreStars likes this

#22 Jim Waters

Jim Waters

    Cosmos

  • *****
  • Posts: 9,232
  • Joined: 21 Oct 2007
  • Loc: Phoenix, AZ USA

Posted 25 July 2020 - 03:07 PM

Thanks darkarchon.



#23 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 89
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 25 July 2020 - 04:31 PM

Reminder: Repository URL is now https://darkarchon.i...et-box.ch:8443/

 

Update:

 

EZ Star Reduction 0.6:

- Added Adam Blocks Star De-Emphasis Mode

 

2020-07-25 23_30_42-EZ Star Reduction v0.6 © 2020 S. Dimant EZ Common Runtime v2.1.png

 

Also further update:

EZ Common Runtime 2.2:

- fix for STF not generating when view that it is being applied to has no STF set

- fix for numeric boxes (and possibly other elements) resetting their values making it impossible to type


Edited by darkarchon, 25 July 2020 - 07:28 PM.

  • Jim Waters, Dereksc, gundark and 2 others like this

#24 PhotonHunter1

PhotonHunter1

    Apollo

  • *****
  • Posts: 1,337
  • Joined: 19 Mar 2015
  • Loc: Northwest Suburbs of Chicago

Posted 25 July 2020 - 09:16 PM

Wow, this is amazing work! I echo Derek’s comments, Thank you for taking the time to develop, making this available, and keeping it public. Cannot wait to download and give it a test drive.


  • darkarchon likes this

#25 terry59

terry59

    Voyager 1

  • *****
  • Posts: 10,992
  • Joined: 18 Jul 2011
  • Loc: Colorado USA

Posted 26 July 2020 - 08:10 AM

Yes I have just migrated it to HTTPS

 

Please use https://darkarchon.i...et-box.ch:8443/ as the new repository URL

Thank you....I installed these on my desktop with the secure connection and no complaints from PI


  • darkarchon likes this


CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.


Recent Topics






Cloudy Nights LLC
Cloudy Nights Sponsor: Astronomics