Jump to content

  •  

CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.

Photo

PixInsight: EZ Processing Suite - the suite for your processing needs

  • Please log in to reply
147 replies to this topic

#26 calypsob

calypsob

    Fly Me to the Moon

  • *****
  • Posts: 6,439
  • Joined: 20 Apr 2013
  • Loc: Virginia

Posted 26 July 2020 - 08:43 AM

Reminder: Repository URL is now https://darkarchon.i...et-box.ch:8443/

 

Update:

 

EZ Star Reduction 0.6:

- Added Adam Blocks Star De-Emphasis Mode

 

attachicon.gif2020-07-25 23_30_42-EZ Star Reduction v0.6 © 2020 S. Dimant EZ Common Runtime v2.1.png

 

Also further update:

EZ Common Runtime 2.2:

- fix for STF not generating when view that it is being applied to has no STF set

- fix for numeric boxes (and possibly other elements) resetting their values making it impossible to type

will this conflict with the starnett for gpu version? 



#27 sn2006gy

sn2006gy

    Vendor - Rockchuck Summit Observatory

  • ****-
  • Vendors
  • Posts: 1,542
  • Joined: 04 May 2020
  • Loc: Austin, TX

Posted 26 July 2020 - 08:45 AM

will this conflict with the starnett for gpu version? 

No conflict. It uses your pre-installed starnet++ to begin with


  • darkarchon likes this

#28 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 26 July 2020 - 11:37 AM

Update:

 

EZ Common 2.3

- Fix color image display in the previewcontrol (should now be stretched properly)

- Fix sync view of views in previewcontrols that had sync disabled

- Various internal improvements

 

EZ Decon 0.12

- Added Background Protection checkbox

- Added Background Mask generation

- Will now allow to blend original images' background into the decon processed image which should allow you to decrease wavelets

 

2020-07-26 18_34_18-EZ Decon v0.12 © 2020 S. Dimant EZ Common Runtime v2.3.jpg


  • dghent, Jeff2011, Dereksc and 4 others like this

#29 Jeff2011

Jeff2011

    Soyuz

  • *****
  • Posts: 3,725
  • Joined: 01 Jan 2013
  • Loc: Sugar Land, TX

Posted 26 July 2020 - 01:14 PM

Very nice.  I was going to ask about background protection.

 

I have been playing around with EZ Decon and like any tool it takes a while to get used to.   Just like in the traditional deconvolution workflow, the star mask is critical.  I decided to pick a bright nebula (M17) to test it on. I did the following to the star mask created by StarNet++

 

1. STF stretch

2. Dilate

3. Binarize

4. Added about 5 ellipses to cover stars that StarNet++ missed

5. Dilate

6. Dilate

7. Convolute

 

I did not have to do many deconvolution iteration.  I did however have to do many more pixel math iterations to get the stars in the nebula to blend in well. 

Another observation is that doing deconvolution without a global deringing will allow some of the darker areas to show up better. 

 

After

EZDeconAfter.JPG

 

Before

EZDeconBefore.JPG

 

One request.  I found it tedious to add the ellipses by dragging to size the stars as stars are small. Since many of my stars were the same size, would it be possible to include the ellipse size parameters so I can easily key in the ellipse size rather than dragging ellipse tool to size.  Thanks a bunch for making this tool available.  I have not played around with the others except for the star reduction tool that worked very well.  I have been using Jon Rista's noise reduction method since he published it so I am excited about that tool too.



#30 lambermo

lambermo

    Apollo

  • -----
  • Posts: 1,108
  • Joined: 16 Jul 2007
  • Loc: .nl

Posted 26 July 2020 - 01:36 PM

Awesome work waytogo.gif

 

1 small thing :

If you made it this far you might be interested in actually getting it, the repo URL is https://darkarchon.i...et-box.ch:8443/

 

UPDATE: NEW REPO URL

The updated text shows 

https://darkarchon.internet-box.ch:8443/

but still links to

http://darkarchon.internet-box.ch:8888/

(and there is no redirect to https)



#31 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 26 July 2020 - 01:49 PM

Awesome work waytogo.gif

 

1 small thing :

The updated text shows 

https://darkarchon.internet-box.ch:8443/

but still links to

http://darkarchon.internet-box.ch:8888/

(and there is no redirect to https)

It does redirect but doesn't take the new port for some reason - but yeah I can't edit the post anymore to edit the URL. I guess it's too old by now.

 

I added the correct URL to the webpage.


Edited by darkarchon, 26 July 2020 - 03:11 PM.


#32 Daniel Beetsma

Daniel Beetsma

    Lift Off

  • -----
  • Posts: 17
  • Joined: 14 Jan 2018

Posted 26 July 2020 - 06:29 PM

Excellent set of tools. I use it for deconvolution mostly, which is very time consuming and repetitive if done by hand (and using OkeWoke's starnet++ module to put the stars back in).

Will probably not use anything else for decon anymore now with the added background masking. 

 

I'm not lazy, I like postprocessing and I'm very much a 1:1 pixelpeeper, so i don't usually jump on stuff called 'EZ'. Im not after easy, i'm after quality. But if quality goes hand in hand with easy - thats a no-brainer.

So yeah, thanks Dark ;-) Much, much better than manually selecting all those stars for the PSF file etc etc...

 



#33 John_K

John_K

    Viking 1

  • -----
  • Posts: 772
  • Joined: 28 Apr 2005
  • Loc: Melbourne, Australia

Posted 27 July 2020 - 05:33 AM

This is excellent. Thanks so much!

 

I have used it now a few times and I am still experimenting with the best combinations for my set up.

 

One comment/question I had was, is that I assume that in addition to a crop, it's advisable to do a DBE but NOT a stretch of any sort before commencing using the scrips in the Decon -> Noise Reduction - > Soft Stretch order including any type STF type stretch. This is correct right?

 

Assume that during the Soft Stretch that this is the stage that a stretch an be made or should at least an STF type stretch be made before the Soft Stretch?

 

I can really see this processing suite really evolving in the future and additional elements being added to automate a lot of the PI flows that a lot of us are using.

 

Appreciate it.

 

John K.


  • monty87 likes this

#34 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 27 July 2020 - 05:38 AM

This is excellent. Thanks so much!

 

I have used it now a few times and I am still experimenting with the best combinations for my set up.

 

One comment/question I had was, is that I assume that in addition to a crop, it's advisable to do a DBE but NOT a stretch of any sort before commencing using the scrips in the Decon -> Noise Reduction - > Soft Stretch order including any type STF type stretch. This is correct right?

 

Assume that during the Soft Stretch that this is the stage that a stretch an be made or should at least an STF type stretch be made before the Soft Stretch?

 

I can really see this processing suite really evolving in the future and additional elements being added to automate a lot of the PI flows that a lot of us are using.

 

Appreciate it.

 

John K.

Hello John, my normal workflow would be crop, DBE, PCC or color calibration + background neutralization if it's color, then EZ Decon, EZ Denoise and EZ SoftStretch. You can apply STF anytime it won't concern the scripts, as long as you don't modify the histogram itself, which a pure STF does not. I do not recommend applying a new STF after Denoise because it will show you issues that aren't really there when you use Soft Stretch. The scripts will also honor your custom STF for display during runs.

 

If you have further ideas for automation let me know.


Edited by darkarchon, 27 July 2020 - 05:42 AM.

  • John_K and SeymoreStars like this

#35 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 27 July 2020 - 07:51 AM

Update:

 

EZ Decon 0.13HF1:

- rename convolute and deconvolute to convolve and deconvolve

 

EZ Denoise 1.11HF1:

- simplify and fix using background reference for edge detection

 

EZ Live Stack 0.6:

- bugfix loading in stacks of previous nights

- will now respect filter if filter is present in file fits or xisf header when scanning for files


Edited by darkarchon, 27 July 2020 - 07:57 AM.

  • John_K, mewmartigan, BobT and 1 other like this

#36 Tayson82

Tayson82

    Mariner 2

  • -----
  • Posts: 269
  • Joined: 17 May 2018
  • Loc: Poland / Wolomin

Posted 29 July 2020 - 09:50 AM

Stars Reduction - maybe something like this????

 

 

pyrasanth

    i tried iterating on this - applying the inverted L mask, running starnet, and then extracting a new L mask and repeating for a total of 3 times and got some very nice star reduction. also if you remove the stars you can sharpen without creating ringing artifacts around the stars, and then just put the stars back with pixelmath: max(starless,stars).

 

    rob


Edited by Tayson82, 29 July 2020 - 09:51 AM.


#37 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 29 July 2020 - 10:05 AM

Stars Reduction - maybe something like this????

 

 

pyrasanth

    i tried iterating on this - applying the inverted L mask, running starnet, and then extracting a new L mask and repeating for a total of 3 times and got some very nice star reduction. also if you remove the stars you can sharpen without creating ringing artifacts around the stars, and then just put the stars back with pixelmath: max(starless,stars).

 

    rob

The "Adam Block" method implemented is very similar to this. Have you tried it?



#38 Peregrinatum

Peregrinatum

    Surveyor 1

  • *****
  • Posts: 1,736
  • Joined: 27 Dec 2018
  • Loc: South Central Valley, Ca

Posted 29 July 2020 - 10:18 AM

very good work, night king!!


  • darkarchon likes this

#39 Tayson82

Tayson82

    Mariner 2

  • -----
  • Posts: 269
  • Joined: 17 May 2018
  • Loc: Poland / Wolomin

Posted 29 July 2020 - 01:19 PM

The "Adam Block" method implemented is very similar to this. Have you tried it?

Of course I tried, so I have different experience with those two metod.

Upper very strong reduce small stars.


Edited by Tayson82, 29 July 2020 - 01:20 PM.


#40 Dynan

Dynan

    Fly Me to the Moon

  • *****
  • Posts: 5,685
  • Joined: 11 Mar 2018
  • Loc: NOLA

Posted 29 July 2020 - 03:11 PM

This is a question owing to COVID rust, and my poor memory, not having processed an image in months.

 

I have installed Starnet++ in the past. I believe I just successfuly installed this EZ Suite also.

 

EZ Suite Install.jpg

 

What I've forgotten is where do I access the scripts? Can't seem to find them in the Scripts dropdown.

 

Thanks for the help...I'm embarrassed...


  • SeymoreStars likes this

#41 mewmartigan

mewmartigan

    Apollo

  • *****
  • Posts: 1,325
  • Joined: 02 Jul 2008
  • Loc: outside of Pittsburgh, PA

Posted 29 July 2020 - 03:45 PM

Starnet is under the Process - etc drop down.

 

The EZ Suite is under Scripts.

 

EDIT: if you only just now put the link in, go to Resources and check for updates to actually download the EZ scripts.


Edited by mewmartigan, 29 July 2020 - 03:46 PM.

  • psandelle and Dynan like this

#42 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 29 July 2020 - 03:57 PM

This is a question owing to COVID rust, and my poor memory, not having processed an image in months.

 

I have installed Starnet++ in the past. I believe I just successfuly installed this EZ Suite also.

 

attachicon.gifEZ Suite Install.jpg

 

What I've forgotten is where do I access the scripts? Can't seem to find them in the Scripts dropdown.

 

Thanks for the help...I'm embarrassed...

As mewmartigan said, you need to Check for Updates under Resources -> Updates and then restart PI. Or you restart PI and it will probably prompt you to download updates.


  • psandelle and Dynan like this

#43 Dynan

Dynan

    Fly Me to the Moon

  • *****
  • Posts: 5,685
  • Joined: 11 Mar 2018
  • Loc: NOLA

Posted 29 July 2020 - 04:08 PM

Thank you both. I got them. I wasn't updating properly.

 

Thanks again!


  • mewmartigan likes this

#44 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 29 July 2020 - 05:54 PM

Update:

 

EZ Live Stack 0.7

- biggest update yet

- can now stack multiple different stacks in parallel

- can do simple RGB stacks for mono data (with R/G/B or Narrowband channels)

- can run SCNR Green on RGB stack

- each stack can now separately choose whether to ignore filters in metadata or not

- icons in tab for current stack status

- various usability improvements

 

ezlivestack-0.7-rgbstack.jpg


  • John_K, lambermo, Jim Waters and 10 others like this

#45 psandelle

psandelle

    Soyuz

  • *****
  • Posts: 3,656
  • Joined: 18 Jun 2008
  • Loc: Los Angeles

Posted 29 July 2020 - 06:18 PM

Great stuff!

 

Paul



#46 John_K

John_K

    Viking 1

  • -----
  • Posts: 772
  • Joined: 28 Apr 2005
  • Loc: Melbourne, Australia

Posted 30 July 2020 - 02:57 AM

Hello John, my normal workflow would be crop, DBE, PCC or color calibration + background neutralization if it's color, then EZ Decon, EZ Denoise and EZ SoftStretch. You can apply STF anytime it won't concern the scripts, as long as you don't modify the histogram itself, which a pure STF does not. I do not recommend applying a new STF after Denoise because it will show you issues that aren't really there when you use Soft Stretch. The scripts will also honor your custom STF for display during runs.

 

If you have further ideas for automation let me know.

I am wondering if the DBE process can be automated with a live preview. Almost like what RC Astro Gradient XTerminator does with different levels you can apply in Photoshop.

 

What do you think?



#47 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 30 July 2020 - 03:03 AM

Good idea, I'll think about it. It might be too slow, DBE is not the fastest process, especially on RGB data.

 

I will probably slow down a little bit on the EZ Processing Suite for now, I am looking to porting StarNet to C# now for easier maintainability and better performance.


Edited by darkarchon, 30 July 2020 - 03:32 AM.

  • John_K, mewmartigan, HxPI and 3 others like this

#48 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 30 July 2020 - 10:24 AM

Update

EZ Decon 0.13HF4

- fix for resizing window crashing PI

- fix for generating PSF erroring out weirdly


Edited by darkarchon, 30 July 2020 - 10:24 AM.

  • nekitmm likes this

#49 SilverLitz

SilverLitz

    Surveyor 1

  • -----
  • Posts: 1,536
  • Joined: 17 Feb 2018
  • Loc: Louisville, KY

Posted 30 July 2020 - 04:17 PM

Thanks for the addition!  A couple of comments from a PI newbie:

 

1) It would be nice for it to auto populate the image for the latest active image, with the option for the pull down. 

 

[I have big projects with way too many images to scroll through.  I have save a project with several targets on separate workspaces (so it is very easy for me copy the workflow from target to target).  I tried then deleting the older target's icons, but PI still seems to have all the images still in the project???]

 

2) I have not been able to get your nVidia Starnet++ acceleration to work.  (I am using a Z840 w/ 2x 12-core Xeons, 160GB RAM, NVMe SSDs, nVidia Quadro K4200, and PI 1.8.8.5 (x64). Starnet took over 3min.)



#50 darkarchon

darkarchon

    Explorer 1

  • *****
  • topic starter
  • Posts: 76
  • Joined: 27 Mar 2018
  • Loc: Switzerland

Posted 30 July 2020 - 04:44 PM

Hello,

 

the K4200 is pretty slow, your 2x 12 core Xeons might actually be faster than that.

 

I'll look into auto population of images where applicable. I also want to write a custom view selector that'd allow selecting files by typing. Idk when I'll get to it however.


Edited by darkarchon, 30 July 2020 - 04:45 PM.

  • SilverLitz likes this


CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.


Recent Topics






Cloudy Nights LLC
Cloudy Nights Sponsor: Astronomics