His openly- expressed disappointment made him popular again.

The rough country people could not have understood silent and dignified regret at the failure of his plans, but they sympathized with a man who swore at his ill success--sympathized, even while they chuckled over his discomfiture.
Mr.Brooke, the retired tradesman, did not cease blaming him for not succeeding, and for swearing.

"But what could you expect from a sailor ?" Mr.Brooke asked, even in my lady's hearing; though he might have known Captain James was my lady's own personal choice, from the old friendship Mr.Urian had always shown for him.

I think it was this speech of the Birmingham baker's that made my lady determine to stand by Captain James, and encourage him to try again.

For she would not allow that her choice had been an unwise one, at the bidding (as it were) of a dissenting tradesman; the only person in the neighbourhood, too, who had flaunted about in coloured clothes, when all the world was in mourning for my lady's only son.
Captain James would have thrown the agency up at once, if my lady had not felt herself bound to justify the wisdom of her choice, by urging him to stay.