He had married Rachel, daughter of Thomas Baynton, of Little Chalfield, Wiltshire, by whom he had one son, named Evelyn, after his grandfather, whom he succeeded in 1726 as the second Duke of Kingston.
The career of Evelyn was undistinguished.

Born in 1711, his aunt, Lady Mary, said of him at the age of fifteen: "The Duke of Kingston has hitherto had so ill an education, 'tis hard to make any judgment of him; he has his spirit, but I fear will never have his father's sense.

As young gentlemen go, 'tis possible he may make a good figure among them." Than which it would be unkind to say anything more cutting.

Of course, honours came to him.

He was created Knight of the Garter in 1741, in which year he was appointed a Lord of the Bedchamber.