"No overlay" - but still displaying Default overlay

As the title says. I have chosen no overlay on all my channel point sound alerts, but it keeps displaying the Default overlay on my stream and its getting a little annoying that i can't seem to turn it off. Im reaching the point where I might just make a fully transparent picture and setting this as Overlay