Until 1361 the estate which became the manor of BROOK formed part of the capital manor of Westbury. In 1216 when Ralph de Beauchamp had the wardship of Walter Pavely this property was described as Westbury and Brook, and in 1256 Brook was named as one of the five estates, or townships, which composed Walter Pavely's manor of Westbury. Brook was possibly the principal residence of the Pavely family in the 14th century, for Reynold Pavely is styled 'of Brook'.
Brook was assigned to John St. Lo for his three daughters on the death of Sir John Pavely in 1361, but on the second partition of Sir John's estates in 1368 the manor was allotted to his daughter Joan, wife of Ralph Cheyney. Sir Ralph Cheyney died in 1400 holding the manor in right of his wife, and in 1402 his son, Sir William Cheyney, settled it upon himself and his wife Cecily. Cecily outlived her husband and their eldest son, Edmund, who had married Alice, daughter and coheir of Sir Humphrey Stafford of Southwick (d. 1442), and on Cecily's death in 1430–1 her heirs were the three daughters of Edmund, Elizabeth, Cecily, and Anne. The younger Cecily died shortly after her grandmother, and the manor was eventually assigned to Anne, who married Sir John Willoughby. In 1461 a general pardon was granted to Sir John, who was presumably a Lancastrian, for all offences and all forfeitures of lands. His son Robert also forfeited his lands for his adherence to the Lancastrian cause, and in 1485 Brook was granted to Edward Ratcliffe for his services against the rebels.
Robert Willoughby's estates were restored to him by Henry VII, under whom he held high office, including those of lord steward and admiral of the fleet, and by whom he was created in 1491 Baron Willoughby de Broke. Brook was presumably the chief residence of Lord Willoughby de Broke and, according to Leland, he rebuilt the house there. On his death in 1502 the manor passed to his son, Robert. Robert died in 1521 leaving no son, and Brook was settled upon his daughters by his second wife, Dorothy Grey. They were Anne, later wife of Charles Blount, Lord Mountjoy (d. 1544), and Elizabeth, later wife of John Paulet, Marquess of Winchester (d. 1576). A claim to the manor by Sir Anthony Willoughby of Goreley (Hants) was unsuccessful and in 1542 Anthony released his claim to Charles Blount and John Paulet. Charles Blount, Lord Mountjoy, died in 1544. His wife, Anne, then married Richard Broke, and after his death she apparently married Sir John Bonham, for in 1574 as Anne Bonham, widow, she alienated her life interest in her moiety of the manor to John Pavy and John Goldwell. In 1596–7 Lord Mountjoy (d. 1606), grandson of Anne, and William, Marquess of Winchester (d. 1598), son and heir of Elizabeth Paulet, obtained permission by Act of Parliament to divide the property which had come to them from Robert Willoughby, and Brook was allotted to Lord Mountjoy. On the death of Anne Bonham in 1582 the park at Brook had been disparked and made into several grounds and portions. Closes called Rush Lanes, Oxen Leaze, and Bushy Leaze, comprising 45 a., were conveyed in 1599 by Lord Mountjoy to Sir James Ley and thereafter descended as the capital manor. Another part of the manor was conveyed in 1599 by Lord Mountjoy to Sir Edward Hungerford, and at Sir Edward's death in 1607 this estate was called the manor of Brook. The exact extent of the estate is not known, but it seems to have excluded Brook House and included Brook Farm, 'Storadge and Dowesfield', three fulling mills, a grain mill, and Brook Marsh, as well as land and common of pasture in the surrounding hamlets and townships. ( It passed in the Hungerford family until 1684 when Sir Edward Hungerford sold it, apparently with the exception of Storridge Pastures, to Sir Stephen Fox. Between 1692 and 1698 Sir Stephen's son, Charles, conveyed it to Robert, Lord Lexinton. From Lord Lexinton it passed in c. 1718 to Sir Edward Desbouverie and descended in the Bouverie family of Longford Castle. In 1785 Jacob Pleydell-Bouverie, Earl of Radnor, sold much of the property to Gaisford Gibbs and John Gawen. The same yeare Brook Farm was conveyed to Thomas Phipps of Chalford (d. 1792), who was already lessee of Brook Mill, a grist and fulling mill. In 1794 Phipps's executors sold the Brook Farm estate, comprising some 150 a., to William Aldridge Ballard of Bratton. After Ballard's death Brook Farm was sold in 1803 by his executors to Thomas Henry Hele Phipps of Leighton House (d. 1841).
Storridge Pastures (see above), comprising 160 a., passed in 1688 from Sir Edward Hungerford to John Hall of Bradford, and descended with Hall's other Wiltshire estates to the Duke of Kingston. In about 1745 Evelyn, Duke of Kingston, sold the estate to Thomas Phipps (d. 1792), who on the marriage of his son, Thomas Hele Phipps (d. 1790), with Penelope Clutterbuck in 1788 made over the property as part of her marriage settlement. On Penelope's death in 1830 Storridge Pastures passed to her son Thomas Henry Hele Phipps of Leighton House (d. 1841).
In 1599 Brook House with some land adjoining was sold by Lord Mountjoy to William Jones of Edington. The estate comprised some 280 a. at this time, of which 58 a. were leased to Peter Polden, and 63 a. to Sir James Ley. William was succeeded by his son Sefton Jones, whose granddaughters Anne, wife of Peter Whatley of London, and Elizabeth, wife of Henry Long, styled of Brook, sold the estate in 1651 to Nicholas Greene of Brook, who already had a life interest in the estate by his marriage with the widow of Sefton Jones. Part of the estate was settled in 1662 by Nicholas Greene upon his son, another Nicholas. Nicholas the younger died c. 1688 and his son, Richard Greene, sold the house and estate in 1689 to Edward Lisle of the Middle Temple, London. From Lisle it was purchased in 1693 by Stephen Blatch of Westbury. Blatch died childless and left Brook House by his will dated 1718 to his brother John Blatch. From John Blatch it passed to Richard Tuck of Rowdford whose mother was an aunt of the brothers Stephen and John Blatch. In 1758, after the death of Richard Tuck, the house, together with the adjoining Lodgewood Farm, was sold to Henry Hele, of Salisbury. Hele's daughter and heir, Jane, brought the house into the Phipps family on her marriage to Thomas Phipps of Chalford and after his death in 1792 it passed to her grandson Thomas Henry Hele Phipps (d. 1841), who also acquired the Brook Farm estate in 1803 and Storridge Pastures in 1830.
When Leland visited Brook House in c. 1541 part of a much older manor house was still to be seen, but the main building was that newly erected, according to him, by the 1st Lord Willoughby de Broke (d. 1502). The windows, Leland remarked, were full of rudders, which he suggested were Lord Willoughby de Broke's badge as admiral of the fleet. The park he described as fair, although not large, and with a great number of fine-grained oaks. Aubrey, writing just over a hundred years later, described the house as very large and stately. The hall, which was large and open at that time, contained, according to him, very old windows with the coat of arms of the Pavelys. Other shields of arms were then to be seen in windows in the 'canopie chamber', the dining room, the parlour, and the chapel. Aubrey also records a tradition that Edward III was at Brook, and that a bridge there, called Kingbridge, was built at the time. In 1872 it was said that only one wing survived of the 'newly erected' house which Leland saw.
In 1960 this wing, which may well have been built in the late 15th century by Lord Willoughby de Broke (d. 1502), as suggested by Leland, was used as a farm building and formed one side of a farmyard. It is a two-storied structure of 7 bays with stone-rubble walls with freestone dressings. The west gable-end and south side have stepped buttresses. On the south side there are 3 moulded stone doorways with arched heads and several two-light windows with uncusped arched lights. The range was always two-storied and the upper floor consisted of at least 3 rooms, each of which had an external door in the north wall. The central room has a blocked stone fireplace. The open roof of the wing is of the arch-braced collarbeam type with 3 tiers of wind braces. At right angles to this wing, at its east end, a farmhouse was built in the 17th century, probably soon after Aubrey's visit (see above). It is built of stone-rubble with mullioned and transomed windows, and has a steeply pitched roof covered with stone slates. Early-19thcentury Gothic windows have been inserted in its east front. The medieval hall, part of which Leland saw, was probably demolished at the time of the building of the farmhouse, but at the junction of the house with the late-15th-century wing, a short length of steeply pitched roof may have formed part of this earlier hall. A fire at this point in 1958 has destroyed the old roof timbers.
The 4½ hides held by William Scudet in Westbury in 1086 possibly lay partly in Dilton and partly in Bratton. It was probably this estate, then comprising 4 carucates, which in 1210–12 William Dauntsey held in chief, in Bratton and Dilton by the serjeanty of keeping the king's larder. William died c. 1221 and was succeeded by his son Richard, who held 4½ hides in Bratton and Dilton in 1236 and 1242 in chief by service in the king's army. By 1250 Richard Dauntsey had alienated a number of holdings in Bratton and Dilton to various persons, but on his death that yeare 4 carucates in those places passed to his heir, Richard, aged twelve. Richard (II) died c. 1266 and the wardship of his heir, Giles, was granted to William de Aete. In 1288–9 the manor of DILTON was in the possession of Richard Dauntsey (III), possibly a brother of Giles, and identical with the Richard, son of Richard Dauntsey, who died in 1315 holding the manor of Dilton. This he held by the service of ½ knight's fee, and the payment of 10 marks annually to the castle guard of Old Salisbury. Richard (III)'s son, Richard (IV), died holding the manors of Bratton and Dilton in 1348 and was succeeded by his grandson, John Dauntsey. On John's death in 1355 the manor, at this time called of Dilton only, together with one carucate in Bratton, passed to his brother William, and William appears to have been succeeded before 1362 by another brother Walter. Walter died seised of the manor of Dilton in 1369, leaving as his heirs his sister, Margaret, wife of Sir Ralph Norton, and his nephew John St. Manifee, son of his sister Joan. St. Manifee conveyed his share in the manor to trustees for Sir Ralph and Margaret. Maud, wife of Thomas de Cantesangre, and presumably widow of Walter Dauntsey, held a life interest in a third of each share. In 1380 the entire manor was conveyed to the Rector and Bonhommes of Edington. In the following yeare the rector regranted to Sir Ralph Norton and Margaret and their issue their share in the manor with reversion to Edington. Margaret died childless in 1388 and the manor thus reverted to the Bonhommes, and formed part of the property of that community until the Dissolution.
In 1540 the manor was granted to John Bush, probably brother of Paul Bush, the last Rector of Edington. John's son, another John, mortgaged it in 1566 for £500 to Jerome Hawley, who ten years later entered into possession. Hawley then sold the manor in 1587 to Sir Walter Hungerford. It descended in the Hungerford family until 1684 when Sir Edward Hungerford sold it to Sir Stephen Fox. In 1689 Fox conveyed it to two persons, presumably trustees for Thomas Phipps and Bridget his wife, who were in possession of the manor in 1693. Thomas Phipps died c. 1715 and in 1721–2 his son, also called Thomas (d. 1724), conveyed the manor to Paul Phipps of Chalford (d. 1722), and to Paul's sons John (d. 1739), and Thomas (d. 1747). It passed from Paul's son Thomas (d. 1747) to his son, another Thomas, who devised it in 1792 to his younger grandson, Charles Lewis Phipps. Charles Lewis Phipps styled himself of Dilton Court after the house which he built on the estate. From Charles Lewis, who died without issue in 1862, the estate passed to his nephew Paul Phipps. Paul Phipps sold it to a cousin, Charles Paul Phipps, who also acquired Chalcot House and died in 1880. From then on the Dilton Court estate followed the same descent as Chalcot House which became the residence of this branch of the Phipps family. Dilton Court later came to be called Chalcot Home Farm.