Never used to putt with glasses on but bought a pair of the oakley prizm golf lenses and now I don't even think about it. I actually played 2 rounds without taking my glasses off to putt before I even realized I wasn't taking them off. I don't think they make it easier to read the green but they don't hurt either.
I wear the same and keep them on when putting. I find myself squinting if I take them off. Great lenses.
There are rounds I don't wear them at all. But once on they stay on.
The only down fall with them is the course looks significantly more brown with them on. Often my partners will mention how good the greens look and I'll have to remove my glasses to see what they see. The Oakley's prizm lenses definitely makes the dry spots stand out.