Rock collecting: when is it ethical? When isn’t it?

The answer to that is a complicated yes and no.

I was asked the question recently whether it was ethical to collect rocks. Is it immoral to gather them and take them home so that no one else can enjoy them? Can beaches be picked clean of rocks, leaving nothing behind for others to enjoy? Is the hobby of rock hounding ethical?