The Rossetter family (James, his wife Ella and daughters, Caroline and Ella) arrived in Eau Gallie, Florida in 1902. Mr. James Wadsworth Rossetter purchased the property (on which the current configuration of Rossetter House now stands) in 1904. The Rossetter House is restored as it stood in 1908. The property was first settled by Eau Gallie pioneer John Houston and his family in 1859. 

Caroline (Carrie) and Ella Rossetter donated their family home and collection of Victorian antiques to the Rossetter House Foundation to preserve the home and contents as a monument to Eau Gallie's past.