Lady Byron goes on:-- 'On acquainting him with the state of the case, and with Lord Byron's desire that I should leave London, Dr.Baillie thought my absence might be advisable as an experiment, assuming the fact of mental derangement; for Dr.Baillie, not having had access to Lord Byron, could not pronounce an opinion on that point.

He enjoined, that, in correspondence with Lord Byron, I should avoid all but light and soothing topics.

Under these impressions, I left London, determined to follow the advice given me by Dr.Baillie.

Whatever might have been the nature of Lord Byron's treatment of me from the time of my marriage, yet, supposing him to have been in a state of mental alienation, it was not for me, nor for any person of common humanity, to manifest at that moment a sense of injury.' It appears, then, that the domestic situation in Byron's house at the time of his wife's expulsion was one so grave as to call for family counsel; for Lady Byron, generally accurate, speaks in the plural number.
'His nearest relatives' certainly includes Mrs.Leigh.

'His family' includes more.