While they don't do a lot of out and out anti-God stuff, they are definately a very secular band. This song isn't totally atheist, but seems to use religion as a metaphor of something that you can lose, while finding yourself...

Losing My Religion from Out Of Time, 1991

Oh life is bigger
It's bigger than you and you are not me The things that I will go to
The distance in your eyes
Oh no I've said too much
I set it up

That's me in the corner
That's me in the spotlight
Losing my religion
Trying to keep up with you
And I don't know if I can do it
Oh no I've said too much
I haven't said enough
I thought that I heard you laughing
I thought that I heard you sing
I think I thought I saw you try

Every whisper
Every waking hour
I'm choosing my confessions
Trying to keep an eye on you
Like a hurt and blinded bull, full
Oh no I've said too much
I set it up

Consider this
Consider this hint of the century
Consider this slip
That brought me to my knees
What if all these fantasies come
Flaming to ground
And now I've said too much
I thought that I heard you laughing
I thought that I heard you sing
I think I thought I saw you try

That was just a dream
That was just a dream
That's me in the corner
That's me in the spotlight
Losing my religion
Trying to keep up with you
And I don't know if I can do it
Oh no I've said too much
I haven't said enough
I thought that I heard you laughing
I thought that I heard you sing
I think I thought I saw you try
But that was just a dream
Try, cry, why, try
That was just a dream
Just a dream, just a dream, dream