When French people swear do they say pardon my English?

I believe they say 'Pardon my Spanish.' The Spanish say 'Pardon my German', the Germans say 'Pardon my Italian', the Italians, say 'Pardon my Greek', and so on, and so on, and so on.........