Movie about a guys childhood

Its been 10 years or so since ive seen it so my memory may be ruff. It was a movie i believe it was based off a book about a guys childhood where he lived with his mom and they moved alot. And they move to this town where the boy becomes friends with a girl and the boy and the mom end up moving and the guy returns as an adult and visits his childhood home and finds out the girl had died and he meets her son

I believe it was based in the 50s. It probley woukdve been around 05 or 06 when i saw it on tv