This St Mary's has a lych gate outside, it also has a series of stone steps in the wall that you can use if you're feeling adventurous (I wasn't).
Apparently, the church lies within the site of a Roman fort, Canovium. I didn't see much evidence of this though.
I did manage to go inside and sit on the font. I wonder if it's Roman?