So I guess Jack and Indy have vaginas now...
I think if you're carrying the Cross of Coronado, a golden fertility idol, or nuclear warhead launch codes you get a pass.
I'm with Tracy, though....I would think of those more as attache's or messenger bags, not manpurses. Besides, you don't see Indiana Jones carrying that satchel around when he's off the clock...just when it's in action.
I tend to think of the manpurse as more along these lines:

smaller...more pouchlike.
Still...I think you could get away with it. I just wouldn't want the hassle of something over my shoulder all the time.
For the record, I have one of those moneyclip pocket wallets that you described, but it's wearing out and it's a tight fit for all my cards. I need to be in the market too, but ....meh...maybe I'll just do this: