Yes, Marlow is lovely. There's lots of little thatched cottage-esque villages around the home counties (Bucks, Berks and Ox). Henley and surrounding area is a favourite of mine. Other faves include Oakley and nextdoor village called Brill. Little windy streets, beautiful view over Oxfordshire and Buckinghamshire (especially at sunset) and a Windmill on top of the hill! To top it off, it has the most apt name of any village I have come across.
My village of Wolvercote, just out of Oxford city centre is also a haven of traquility. Just over an hour from London.