Besides the cultural scenario, saying it to someone seems like it’d always be rude. The woman sucked.
Over the years, I've had several people say "excuse you". It's almost always someone asking me to move out of the way eventhough I'm not really in their way.
This morning, I say "excuse me" as I try to walk around a woman leaving a store so she doesn't move and I accidentally bump her. And she says "excuse you". So that's different because I initiated it, but got me thinking about this.
Anyway, I feel that's extremely rude. She certainly didn't have a rude tone, but she also didn't have an accent (seems in some cultures "excuse you" might be the standard convention). Normally, in my experience "excuse you" is reserved to chastise someone unapologetically pushing people aside.
I tend to think it doesn't take long to realize "excuse you" is rude in America. And the fact that it's almost always a women saying it....Get your ass in gear, or step aside so people can move by - I asked you nicely.