I've started doing this as well - and although it can be, as you pointed out, a little anxiety-provoking at first, I've come to believe that it's the best way to see a new city. I love the sometimes strange, but also wonderful little hole in the wall places you find!