Named from a house on Malone Road, first recorded in 1858. Referring to Windsor Castle in Berkshire, England, this forms part of a group of names in South Belfast with royal associations including: Adelaide, Kensington, Chelsea, Marlborough, Osborne, Sandringham, Balmoral, and Braemar.
Windsor Avenue was approved in 1864 (BCM).