Milon was the son of unknown parents. The date and place of his birth have not been found.
His wife was Charlotte d'Aunoy. They were married, but the date and place have not been found. Their two known children were Suzanne (c1470-1510) and Étienne (?-1527).