In 1881 Mary is not there and Edward has only Ann C 1857, and Clara J 1860, with him.
RG11/772,F.80, P.34 (TNA Copyright)

A few lines above at another farm is Ernest married to Julia and their children.