They take a vow of chastity, but it does not mean that they will renounce women altogether, they renounce marriage only.

Their chastity, and therefore chastity in general, is violated only by marriage; yet I observe that marriage is one of your sacraments.

Therefore, those knights of Malta promise not to give way to lustful incontinence in the only case in which God might forgive it, but they reserve the license of being lustful unlawfully as often as they please, and whenever an opportunity may offer itself; and that immoral, illicit license is granted to them to such an extent, that they are allowed to acknowledge legally a child which can be born to them only through a double crime! The most revolting part of it all is that these children of crime, who are of course perfectly innocent themselves, are called natural children, as if children born in wedlock came into the world in an unnatural manner! In one word, my dear son, the vow of chastity is so much opposed to Divine precepts and to human nature that it can be agreeable neither to God nor to society, nor to those who pledge themselves to keep it, and being in such opposition to every divine and human law, it must be a crime." He enquired for the second time whether I was married; I replied in the negative, and added that I had no idea of ever getting married.
"What!" he exclaimed; "I must then believe that you are not a perfect man, or that you intend to work out your own damnation; unless you should tell me that you are a Christian only outwardly." "I am a man in the very strongest sense of the word, and I am a true Christian.

I must even confess that I adore women, and that I have not the slightest idea of depriving myself of the most delightful of all pleasures." "According to your religion, damnation awaits you." "I feel certain of the contrary, because, when we confess our sins, our priests are compelled to give us absolution." "I know it, but you must agree with me that it is absurd to suppose that God will forgive a crime which you would, perhaps, not commit, if you did not think that, after confession, a priest, a man like you, will give you absolution.

God forgives only the repenting sinner." "No doubt of it, and confession supposes repentance; without it, absolution has no effect." "Is onanism a crime amongst you ?" "Yes, even greater than lustful and illegitimate copulation." "I was aware of it, and it has always caused me great surprise, for the legislator who enacts a law, the execution of which is impossible, is a fool.