A M S

Hi everyone! I've been wondering what I would do if I was accepted into a program, took the offer, but later decided that I wanted to decline and accept another program instead (hopefully this makes sense ,haha!). Is this even allowed, or do the rules for rejecting an offer after we have accepted it vary from university to university and program to program? If it is allowed, however, what are the ways we may go about doing this? Thanks so much ?