I think making it too realistic - i.e. getting tired, passing out in heat etc will take away alot of the fun.
I think the realism should be restricted to the environment and vehicle physics.
Maybe some destructible buildings, which of course get rebuilt when you next visit the place.
And please no deserts.........please.