Olivier was the son of unknown parents. The date and place of his birth have not been found.
His wife was Belle-Assez de Thouars. They were married, but the date and place have not been found. They had no known children.