To those who don't wear seat belts, how can you possibly properly control your car?

If you don't wear a seatbelt, and your car starts being rocked or spun, even if it's not your fault (like somebody sideswiping you). If your body is being thrown around, how do you properly reach and manipulate the steering wheel and brake and gas pedals to get your car back under control?

Shouldn't you wear your seatbelt at the least to remain in position for your car's controls?