Old movie where rich boy moves to a castle

1950 - 1990 movie about a boy moving into a castle where he is confused about what is happening to the maids. When he finds out he has sex with them. Very likely french

Could it be Chaleurs (1971)?