Hm, never had the pleasure of owning acrylic displays, let alone drilling holes in 'em. But if you think it's not the sturdiest material around, I'd use a very small drill at first (the kind you use for drilling in metal) and drill at a high speed.
Perhaps you could also ask Potomac if it's safe to drill these displays?