I'm the same. I have passable travel Spanish, but struggle on the phone. I did make a little system for myself for when it's necessary though, just for that night or the next. I use Google Translate liberally and have a "script".
First thing:
¡Hola! Lo siento, mi español no es muy...