Just Nod Your Head And Smile
And no matter how big that big-ass sword is, you won't stand out in a crowd. Nobody ever crosses the street to avoid you or seems to be especially shocked or alarmed when a heavily armed gang bursts into their house during dinner, rummages through their posessions, and demands to know if they've seen a black-caped man. People can get used to anything, apparently.
# MacGyver Rule
Other than for the protagonists, your choice of weapons is not limited to the prosaic guns, clubs, or swords. Given appropriate skills, you can cut a bloody swath across the continent using gloves, combs, umbrellas, megaphones, dictionaries, sketching tablets -- you name it, you can kill with it. Even better, no matter how surreal your choice of armament, every store you pass will just happen to stock an even better model of it for a very reasonable price. Who else is running around the world killing people with an umbrella?