In this study, we presented a novel model based on ESR1 signaling activity score that can predict the prognosis and endocrine therapy response of ER + /HER2- breast cancer patients from whole-slide tumor H&E staining using a convolution deep neural network. This evidence concerns the gene ESR1 and neoplasm.