The Ashbrooks originated in Ireland with estates in Kilkenney and Castle Durrow. In 1751 Henry Flower was created 1st Viscount Ashbrook
Henry Jeffrey Flower became 4th Viscount Ashbrook in 1802 after the death of his elder brother, William. He married Deborah Susannah Freind, only daughter of the Rev. William Maximilian Freind and granddaughter of Thomas Walker.
Their son, Henry Jeffrey, 5th Viscount Ashbrook, officially changed his name to Walker in 1827 and then married Frances Robinson, daughter of Sir John Robinson, Bart. in 1828
George Richard Walker acted as agent for Henry Jeffry Viscount Ashbrook from 1836-1845