Associated with the Black Mountain poets, Williams was inspired by the visual arts, music, and the natural world; he experimented with found poetry and at times illustrated his work. His interests included civil rights, Appalachia and the Appalachian Trail, folk arts, and avant-garde poetry.
Through the relatively obscure but highly influential Jargon Press, Williams promoted the writings of such poets as Denise Levertov, Lorine Niedecker, Basil Bunting, Robert Creeley, Charles Olson, and Louis Zukofsky, as well as the art of outsider artists such as Thornton Dial and Howard Finster. Williams’s publishing selections for Jargon extended to Ernest Mickler’s 1987 bestseller, White Trash Cooking.
Williams lived in Scaly Mountain, North Carolina, and spent part of each year in England.