How would you tell if you saw colours differently from everyone else?

This is one of many senarios: You and a friend are shopping. She says, "do you like this red top?" and she points to a red top (in her perspective) and you say, "That's Green!!!" and you would get curious and start asking people what colors of different things were, and they'd say a different color than what you were seeing!