Often people quote :
- "Familiarity breeds contempt"
- "Distance make the heart grow fonder"
What I have noticed in practice is that, initially you do miss a person, but with time, you learn to live on your own and there comes a time when you actually prefer it!
Once the person is back, you resent not being able to 'do your thing'
On the other end, the more you get to know a person, the more you are able to appreciate them, quite the opposite of contempt!