Jump to content

  •  

CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.

Photo

New free open source AI denoise framework and GUI tool - AstroDenoisePy

  • Please log in to reply
82 replies to this topic

#1 p7ayfu77

p7ayfu77

    Lift Off

  • -----
  • topic starter
  • Posts: 4
  • Joined: 25 Feb 2022

Posted 26 February 2022 - 07:05 AM

Hi all,

 

Id like to introduce a new open source tool and framework I've been working on for the last few months.

I guess pictures speaks louder than words, but a bit of the background is here: https://github.com/p...ise2Noise.ipynb

 

This was prompted by my interest in deep learning and some inspiration from the following threads:

 

* https://www.cloudyni...trophotography/
* https://www.cloudyni...se-attenuation/

 

Without further ado:

AstroDenoisePy: Before
snap1_resize.JPG

AstroDenoisePy: After

snap2_resize.JPG

 

The platform is quite versatile, allowing you to progress through to building your own denoise models from your data, or just use the GUI and a standard model I have trained with my data to denoise your images. In my testing so far even my "standard" model is very effective on other data I have not trained my models on.

 

Much more info can be found at the github repo with examples, and some background to how I got here: https://github.com/p...7/astro-csbdeep

This effort has been helped in part by friends in the Astrobiscuit community on Discord, and as such I want to thank all that have contributed with testing so far.

 

I have made an MSI distributable available here for a short period here: https://1drv.ms/f/s!...QwBOjlnhtu7_GkQ

Please note this is a small endeavour and so please be kind with requests or feedback, I will not be able to respond always.
I do hope this is useful for people.

Thanks
 

 

 


  • Rouzbeh, dswtan, okiedrifter and 22 others like this

#2 pyrasanth

pyrasanth

    Fly Me to the Moon

  • *****
  • Posts: 7,406
  • Joined: 08 Jan 2016

Posted 26 February 2022 - 08:00 AM

I'm really grateful for your efforts. I've not tested the software however your screen shot looks like its very good indeed.

 

Do images being denoised need any masks?- however some testing will reveal that need if required.

 

I'm inspired that you have shared your insight with us.

 

Thanks.



#3 scottdevine

scottdevine

    Mariner 2

  • *****
  • Posts: 267
  • Joined: 30 Jul 2021
  • Loc: St Louis, MO

Posted 26 February 2022 - 08:57 AM

What a great contribution. I’ll be sure to download and give it a try.

Thank you!

#4 Mert

Mert

    Voyager 1

  • *****
  • Posts: 11,115
  • Joined: 31 Aug 2005
  • Loc: Spain

Posted 26 February 2022 - 01:00 PM

Looks great and that's a lot of effort!

Thank you for sharing!

I downloaded and installed on my laptop but have some problem with the screen

not showing in it's total extent.

Is there some way to start the program to show correctly on a laptop, or

could the lefthand menu be scrolled?

 

CS,

Mert

 

Attached Thumbnails

  • AstroDenoisePy.jpg

  • santafe retiree likes this

#5 santafe retiree

santafe retiree

    Apollo

  • *****
  • Posts: 1,158
  • Joined: 23 Aug 2014
  • Loc: Santa Fe, NM

Posted 26 February 2022 - 01:51 PM

Looks great and that's a lot of effort!

Thank you for sharing!

I downloaded and installed on my laptop but have some problem with the screen

not showing in it's total extent.

Is there some way to start the program to show correctly on a laptop, or

could the lefthand menu be scrolled?

 

CS,

Mert

Same -- not scaling to screen resolution and no scroll bar to access entire menu section
 



#6 p7ayfu77

p7ayfu77

    Lift Off

  • -----
  • topic starter
  • Posts: 4
  • Joined: 25 Feb 2022

Posted 26 February 2022 - 04:19 PM

Looks great and that's a lot of effort!

Thank you for sharing!

I downloaded and installed on my laptop but have some problem with the screen

not showing in it's total extent.

Is there some way to start the program to show correctly on a laptop, or

could the lefthand menu be scrolled?

 

CS,

Mert

Hmm this looks like it might be a DPI issue...
Hard to investigate, but I'll take a look.
For the time being could you change ur screen DPI and see if it helps?



#7 Mert

Mert

    Voyager 1

  • *****
  • Posts: 11,115
  • Joined: 31 Aug 2005
  • Loc: Spain

Posted 26 February 2022 - 04:58 PM

Will do and let you know,
however it is a bit strange that the aplication seem to have a different resolution then my screen.

Ok, just checked but nothing helps.

My screen resolution is 1366x768 and the aplication looks like having 800x600 or alike.

 

Hope you can solve it!!

Best regards,

Mert


Edited by Mert, 26 February 2022 - 05:45 PM.


#8 avarakin

avarakin

    Mercury-Atlas

  • *****
  • Posts: 2,711
  • Joined: 13 Jul 2009
  • Loc: Parsippany NJ, USA

Posted 26 February 2022 - 08:06 PM

Looks great!

Any thoughts on integrating this into PixInsight?

Also do you think it would be possible to use AI for deconvolution/sharpening?



#9 KlausKlaus

KlausKlaus

    Mariner 2

  • -----
  • Posts: 212
  • Joined: 29 Jul 2020
  • Loc: Europe

Posted 27 February 2022 - 10:00 AM

Be careful w/ software of unknown origin…



#10 p7ayfu77

p7ayfu77

    Lift Off

  • -----
  • topic starter
  • Posts: 4
  • Joined: 25 Feb 2022

Posted 27 February 2022 - 05:31 PM

Will do and let you know,
however it is a bit strange that the aplication seem to have a different resolution then my screen.

Ok, just checked but nothing helps.

My screen resolution is 1366x768 and the aplication looks like having 800x600 or alike.

 

Hope you can solve it!!

Best regards,

Mert

I've uploaded a new version with some GUI "fixes", really just tried to make things a bit smaller to fit into 768. Hope it helps. 

Uploaded new build "0.3.2-alpha", see first post for link.
 

https://github.com/p...89936a0d0d16e88

Tidy up GUI, separate common areas by color
Add snapshots feature, comparison tool
Add support for native file open/save dialog for platform: win32
Add selector for GPU/CPU
Always save TIF as unit16
Add version to app title



#11 p7ayfu77

p7ayfu77

    Lift Off

  • -----
  • topic starter
  • Posts: 4
  • Joined: 25 Feb 2022

Posted 10 March 2022 - 03:39 PM

Uploaded latest release with a few GUI enhancements and small bug fixes.

 

Release 0.3.3-alpha and future releases can be downloaded from the GitHub releases section of the repo here:

 

https://github.com/p...sbdeep/releases

 

astrodenoisepy.JPG

 

 


  • Sheridan and Jon Rista like this

#12 Borodog

Borodog

    Voyager 1

  • *****
  • Posts: 10,591
  • Joined: 26 Oct 2020
  • Loc: St. Augustine, FL

Posted 10 March 2022 - 05:14 PM

Wow I can’t wait to try this. Thanks for developing and sharing.

#13 Manitu

Manitu

    Vostok 1

  • -----
  • Posts: 103
  • Joined: 04 Mar 2020
  • Loc: South Germany

Posted 01 May 2022 - 01:05 PM

Hi to all

 

I would like to know how I could build a denoise model and train it with data. How does this work and how can I store a model.

 

May be someone knows?

 

CS Tom



#14 Robowarrior834

Robowarrior834

    Lift Off

  • -----
  • Posts: 4
  • Joined: 06 Aug 2020

Posted 24 May 2022 - 09:07 AM

Hi p7ayfu77,

 

Thank you for the app, the only thing I noticed is that there seams to be a memory leak when using a GPU. After the Denoise the app does not free up the GPU Memory, so the next time it tries running it is bottle necked.

 

Sincerly,

Robowarrior


Edited by Robowarrior834, 24 May 2022 - 09:08 AM.


#15 starhopper-de

starhopper-de

    Sputnik

  • -----
  • Posts: 28
  • Joined: 18 Apr 2009
  • Loc: Germany, EU

Posted 12 June 2022 - 02:42 PM

Hello p7ayfu77,

 

I do not have Windows any more. I tried it with wine and a windows VM but with no success.

Is is possible to compile it for Linux? Or can I start it from a python2 or python3 shell?

Thomas


Edited by starhopper-de, 12 June 2022 - 02:47 PM.

  • Der_Pit likes this

#16 Borodog

Borodog

    Voyager 1

  • *****
  • Posts: 10,591
  • Joined: 26 Oct 2020
  • Loc: St. Augustine, FL

Posted 26 July 2022 - 07:49 PM

Bump.

 

Any tips on the settings? I can't seem to find any documentation on github.



#17 benula

benula

    Vostok 1

  • *****
  • Posts: 165
  • Joined: 27 Apr 2011
  • Loc: Stillwater, MN

Posted 17 September 2022 - 12:09 AM

I was able to get this running on linux after fixing a few things and the results absolutely blew my mind.

 

I submitted a PR to get my changes merged back, but if you want to try it in the meantime you can do:

git clone git@github.com:bgilsrud/astro-csbdeep.git

git checkout linux_fixes

 

Then read the README.md file as I added some documentation on how to run it on linux.

 

One thing that I think I learned, was that if you're denoising an image that has already been stretched then deselect the "Normalize" box.

 

Thanks p7ayfu77!!

 

-Ben


  • Tribe_Of_Dan likes this

#18 Stanty8

Stanty8

    Lift Off

  • -----
  • Posts: 18
  • Joined: 27 Jul 2022

Posted 08 November 2022 - 02:47 PM

OP, your program is amazing! Far better results than Topaz for me. Any way we can buy you a coffee, metaphorically speaking? 

 

For those who want to try it out, there's a windows MSI file here: https://github.com/p...sbdeep/releases


  • dciobota and Pikalution like this

#19 dciobota

dciobota

    Soyuz

  • *****
  • Posts: 3,735
  • Joined: 07 Aug 2007
  • Loc: No longer on this site in protest of poor site moderation

Posted 08 November 2022 - 04:41 PM

Absolutely fantastic program!  Now I finally have a Helix image I'm reasonably happy with.  Here is a sort of comparison.  The version on the left is my previous final image, and the one on the right is my new one. 

 

I processed it similarly to my previous image except I applied denoise before the post processing (the base image for both finished images was already preprocessed and stretched in APP) and was subsequently able to push the fainter regions a bit more.

 

Love this program, and I'll buy the developer a beverage of choice.  Failing that, I'd gladly put some coin in the donation box if one gets put up.  Outstanding work.

 

Helix before and after denoise.jpg



#20 Tapio

Tapio

    Cosmos

  • -----
  • Posts: 9,984
  • Joined: 24 Sep 2006
  • Loc: Tampere, Finland

Posted 09 November 2022 - 10:54 AM

Could there be a compare button to switch between original and denoised image, or a preview windows to compare ?


  • dciobota likes this

#21 dciobota

dciobota

    Soyuz

  • *****
  • Posts: 3,735
  • Joined: 07 Aug 2007
  • Loc: No longer on this site in protest of poor site moderation

Posted 09 November 2022 - 12:34 PM

Could there be a compare button to switch between original and denoised image, or a preview windows to compare ?

That's a tremendous idea.  The way I do it now is check/uncheck the denoise checkmark, but it's pretty slow.



#22 Devonshire

Devonshire

    Viking 1

  • *****
  • Posts: 662
  • Joined: 10 Mar 2017
  • Loc: S/W Ontario, Canada

Posted 09 November 2022 - 05:55 PM

I'm trying to understand where this is re: linux support for us non-python-developers.  Yes, I was in IT back in the day, but in Enterprise packageware.  Different world.  Possibly a different galaxy... :-)

 

Looking at github and trying to interpret, I *think* bgilsrud's linux changes may not have been merged back with p7ayfu77's changes.  Not sure. Also not sure about whether the GPU memory leak has been repaired.  And then there's kalgecin's astro-cssdeep, which talks about only denoising the luminance layer.

 

I'd love to take this for a spin on Mint, but it's really not clear which of these branches is best, and how to proceed from there.

 

Got advice?



#23 Manitu

Manitu

    Vostok 1

  • -----
  • Posts: 103
  • Joined: 04 Mar 2020
  • Loc: South Germany

Posted 11 November 2022 - 07:32 PM

You can compare the original and the denoised one by clickung on the eye symbol on the lower right corner. It switches back and forth very fast.


  • dciobota and drd715 like this

#24 Devonshire

Devonshire

    Viking 1

  • *****
  • Posts: 662
  • Joined: 10 Mar 2017
  • Loc: S/W Ontario, Canada

Posted 11 November 2022 - 10:25 PM

I was able to get this running on linux after fixing a few things and the results absolutely blew my mind.

 

I submitted a PR to get my changes merged back, but if you want to try it in the meantime you can do:

git clone git@github.com:bgilsrud/astro-csbdeep.git

git checkout linux_fixes

 

Then read the README.md file as I added some documentation on how to run it on linux.

 

One thing that I think I learned, was that if you're denoising an image that has already been stretched then deselect the "Normalize" box.

 

Thanks p7ayfu77!!

 

-Ben

Ben,

 

I'm having a bit of trouble with the above - stuck partway.  

 

The above git clone command assumes that you have gone through the steps to set up an account on git.  I don't have one, so it fails.  

 

Screenshot at 2022-11-11 21-12-33.png

 

I did look look up the (publickey) error, and the suggested remedies all seemed to be in the context of maybe-this-or-maybe-that, for developers who wished to check in.  I just want to download this and try it - I doubt I'd ever have a reason to check in.

 

I WAS able to find an https: solution that got me through the clone without the account setup, but I'm stuck at the next step, the "checkout linux-fixes" line.   No idea how to deal with that.  

 

Screenshot at 2022-11-11 21-59-33.png

 

Can you help?

 

Thanks!


Edited by Devonshire, 12 November 2022 - 09:36 AM.


#25 Tapio

Tapio

    Cosmos

  • -----
  • Posts: 9,984
  • Joined: 24 Sep 2006
  • Loc: Tampere, Finland

Posted 12 November 2022 - 02:35 AM

You can compare the original and the denoised one by clickung on the eye symbol on the lower right corner. It switches back and forth very fast.


Thanks for this.


CNers have asked about a donation box for Cloudy Nights over the years, so here you go. Donation is not required by any means, so please enjoy your stay.


Recent Topics






Cloudy Nights LLC
Cloudy Nights Sponsor: Astronomics