Sometimes. Depends on the state.

When you purchase a handgun, the weapons serial number is sent to the ATF and they keep record of who owns it. That's in every state.

But in gun friendly states, rifles aren't tracked like that. They just do a simple background check and off you go. Takes about 15 minutes and most of that time is the guy selling you the gun sitting on hold.