A gifted novelist, Graves published The Festoon, a collection of Epigrams in 1765, The Spiritual Quixote; or, The Summer's Ramble of Mr. Geoffry Wildgoose in 1773 and Columella; or, The Distressed Anchoret in 1779. Senilities; or, Solitary Amusements: in Prose and Verse appeared in 1801. Other publications by the author include Euphrosyne; or, Amusements on the Road of Life (1776); Eugenius; or, Anecdotes of the Golden Vale, an Embellished Narrative of Real Facts (1785); Lucubrations: Consisting of Essays, Reveries etc. in Prose and Verse (1786); Recollections of some Particulars in the Life of Recollections of Some Particulars in the Life of the Late William Shenstone, Esq. in a Series of Letters from an Intimate Friend of His to----Esq. F. R. S. (1788); Plexippus, or the Aspiring Plebeian (1790); The Reveries of Solitude; Consisting of Essays in Prose, a New Translation of the Muscipula, and Original Pieces in Verse (1793); The Coalition; or, The Opera Rehears'd: A Comedy in Three Acts (1794); The Farmer's Son: A Moral Tale Inscribed to Mrs. Hannah More by the Rev. P. P. M. A. (1795); and The Invalid, with the obvious Means of enjoying Long Life, by a Nonagenarian (1804). Also proficient in Latin, Greek, and several modern languages, Graves translated Galateo; or, A Treatise on Politeness and Delicacy of Manners, from the Italian of Monsig. Giovanni De La Casa (1774), Goethe's Sorrows of Werther(1779), probably from a French version, Fénelon's Fleurettes, Containing an Ode on Solitude (1784), Herodian, The Heir Apparent; or, The Life of Commodus, Translated from the Greek (1789), The Meditations of the Emperor Marcus Aurelius Antoninus: A New Translation, with a Life, Notes Etc. (1792), and Hiero on the Condition of Royalty: A Conversation from the Greek of Xenophon (1793).