Quoted from The Norton Anthology of English Literature, Seventh Edition;Volume 2:
"Often as a result of female initiative rather than his own, Byron entered into a sequence of liaisons with ladies of fashion. One of these, the flamboyant and eccentric young Lady Caroline Lamb, caused him so much distress by her persuit and public tantrums that Byron turned for relief to marriage with Annabella Milbanke, who was in every way Lady Caroline's opposite, for she was naive, unworldly, intellectual (with a special passion for mathematics), and not a little priggish. This ill-starred marriage produced a daughter (Augusta Ada) and many scenes in which Byron, goaded by financial difficulties, behaved so frantically that his wife suspected his sanity; after only one year of marriage, the union ended in a legal separation. The final blow came when Lady Byron discovered her husband's incestuous relations with his half-sister, Augusta Leigh. The two had been raised apart, so that they were almost strangers when they met as adults. Byron's affection for his sister, however guilty, was genuine and endured all through his life. This affair proved a delicious morsel even to the jaded palate of the dissolute Regency society."