Griswold graduated from Albany Academy and attended Union College for one year. Tutoring jobs afforded him the opportunity to spend time in the South. At the end of his employment as a tutor, he remained in the southeast to do research in Charleston, Beaufort, and Georgetown in South Carolina and Savannah, Georgia. His wife Anne Thomas Griswold (1902-1996) was from Augusta, Georgia.