He had married before 1711 Rachel, daughter of Thomas Baynton, of Little Charfield, Wilts, who outlived her husband eight years.

There was a son, Evelyn, who succeeded to the peerage.
(ii.) Lady Mary, the subject of this memoir.
(iii.) Lady Frances, who in 1714 became the second wife of John Erskine, sixth or eleventh Earl of Mar; and (iv.) Lady Evelyn, who married John, second Baron, and afterwards first Earl Gower, and died in June, 1727.
In the winter of 1697, when Lady Mary was eight years old, her mother died.

After this, the little girl was allowed to run rather wild.

Lord Kingston was very much a man about town and a gallant, and was too greatly occupied with his affairs and his parliamentary duties, which took him often from home, to concern himself about her education.

In fact, before her mother's death, it would seem that Lady Mary spent months at her grandmother's, Mrs.Elizabeth Pierrepont, at her house at West Dean.