Our identification of ZBTB20 as a crucial determinant of lactotrope specification provides insight into the ontogeny of lactotropes, which will help to unravel the cellular and molecular basis for pituitary deficiency. Here, ZBTB20 is linked to pituitary deficiency.