Fenrig the Farmer explained that villagers need food and a warm, sheltered bed to do their best work and be happy. You can assign a spare bed to your followers by using the summoning staff and aiming it at a bed.

Assign a sheltered bed to Fenrig to proceed!