Family
Sir Charles Augustus FitzRoy married, firstly, Lady Mary Lennox (15 August 1790 – 7 December 1847), first-born child of Charles Lennox, 4th Duke of Richmond, on 11 March 1820. They had four children:
Captain Augustus Charles Lennox FitzRoy (20 September 1821 – 11 September 1855)
Mary Caroline FitzRoy (20 December 1823 – 22 November 1895) married Admiral Hon. Keith Stewart, son of The Earl of Galloway
Louisa Wilhelmina Stewart (1847–1938), married Kyrle Alfred Chapman, son of David Barclay Chapman and Maria Chatfield, did not have issue
Caroline Ethel Gertrude Stewart (1851–1947), married Canon Mark James, son of Philip James and Susan Georgiana Ryder, daughter of Granville Ryder, and had issue
Edith Stewart (died 1875), married Colonel Edward St. Aubyn, son of Sir Edward St. Aubyn, 1st Baronet and Emma Knollys, and had issue
Blanche Caroline Stewart (died 1927), married Admiral Sir William Shaw-Stewart, son of Admiral Sir Houston Shaw-Stewart and Martha Miller, and had issue
Ellinor Sydney Stewart (died 1901), married Spencer Chapman, son of David Chapman and Maria Chatfield, and had issue
Hilda Eugenia Stewart (died 1959), married Arthur Rhuven Guest, son of Arthur Edward Guest and Adeline Mary Chapman, and had issue
George Henry FitzRoy (13 September 1826 – 8 July 1868)
Commander Arthur George FitzRoy (20 March 1827 – 9 January 1861)
Lady Mary died from a carriage accident in Parramatta Park, outside Government House, in 1847. Within a year of her death, rumours were circulated about the colony of New South Wales about FitzRoy's 'womanising' ways. In 1850, FitzRoy made a visit to Berrima, to inspect the Fitzroy Iron Works. The Governor stayed at the Surveyor General's Inn, operated by former boxing champion Edward "Ned" Chalker (sometimes Charker). Ned's step-daughter, Mary Ann Chalker, who was 18 at the time, worked there. Nine months later, she gave birth to a son, named Charles Augustus FitzRoy, after his father, the Governor. This boy was later adopted by ex-convict John Fitzsimons and his family.
Charles Augustus FitzRoy Fitzsimons (9 November 1850 – 19 July 1921)
Sir Charles Augustus FitzRoy married, secondly (after his return to England), Margaret Gordon, on 11 December 1855. There was no issue from this marriage.
