User cannot unselect answer in current matrix field