Poems by the Wayside: Written During More Than Forty Year (1883)

A scriptural, ecclesiastical, and historical view of slavery, from the days of the patriarch Abraham to the nineteenth century, addressed to the Right Rev. Alonzo Potter.

The American Citizen: His Rights and Duties, According to the Spirit of the Constitution of the United States

Essay on Gothic Architecture: With Various Plans and Drawings for Churches

The Law of Ritualism: Examined in Its Relation to the Word of God, to the Primitive Church, to the Church of England, and to the Protestant Episcopal Church in the United States

The Primitive Church: Compared with the Protestant Episcopal Church of the Present Day (1835)

Carols, Hymns, and Songs (1872)

Sixteen Lectures on the Causes, Principles, and Results, of the British Reformation

The History Of The Church, In Verse: Composed For The Use Of Bible-Classes, Schools, And Families, In The Protestant Episcopal Church (1866)

Carols, Hymns, and Songs (Classic Reprint)