In this study, we demonstrated the robustness and effectiveness of the proposed framework on three essential clinical applications, including breast cancer diagnosis and human epidermal receptor factor 2 (HER2) amplification detection on FISH and DISH slides for HER2 target therapy. Here, ERBB2 is linked to breast cancer.