I think this is the Haunted House game you mean. It was originally called Witch Witch. Then it was changed to Ghost Castle.
Yeah, that was it. The UK edition was called Haunted house when Denys Fisher put it out over there. Ones of these day's I'll have to take a pic of all the games we've been picking up. Recent additions are a vintage booby trap game and a TMNT game. I can't think of what it is offhand, I'm sure there were a few different games made.