Stop thinking MPs working from home are 'shirking' duties, Rees-Mogg told.