A combination of cell-based and biochemical approaches reveals how oncogenic fusion protein SS18-SSX directs BAF complexes to H2AK119Ub-modified nucleosomes to remodel chromatin at cancer-specific gene targets. Here, SS18 is linked to cancer.