Phone Broke. Can I Simply Put My Sim Card Into Another Phone, And Use That? Do I Need To Activate It? How So?

My mobile telly broke, and I was wondering if I could just move my SIM card over to another phone, and immediately start using that. Or, will I have to go to the AT&T store and get everything activated. I have a rinkydink phone by samsung