There has to be a reason for people to visit it in the first place, and then come back for second/third/fourth looks..
There's a LOT of websites out there, and a lot of astro-related homepages..
Unless you're pimping it often, the only way people will stumble across sites is by search engines or by your signature..
Everyone (myself included) wants their website to be popular and visited by lots of people, but there's a lot of competition out there..
A site has to be unique, or have something different, for people to take more than a glancing interest in it never to return.
Our websites are just a hobby - they're just for us to make ourselves feel better and give us a place to show off our passion.. there's businesses whose livelihoods depend on people coming to visit their site - so they have the same dilemma, but of course they're usually offering a product or service to sell.
My advice, don't worry about it too much - if your interest stays high, then maintain your site for your own interest and for your own little home on the internet.. If it doesn't get 1000 visitors a day, so what.
For me, my site is my place to show off my passion of astronomy. My hope is that my site will help someone out who's just getting started in astronomy, offer advice that might point them in the right direction, and maybe introduce astronomy to people who previously hadn't shown much interest.
I used to be a heavy online gamer, and was involved in many large gaming communities.. i've pimped my site on the gaming forums I belong to, and I've received a lot of positive feedback and a few gamers have even commented that my site has gotten them to look up at night every now and then..
Just that little comment there makes it worthwhile, and hopefully popularises astronomy for the masses, as WE know how great a hobby it is..