Oliver was guest principal viola with the Orchestra of the Age of Enlightenment at Schloss Esterhazy in Eisenstadt (where the composer Haydn lived and worked) and performed at the BBC Proms and the Edinburgh Festival with Sir John Eliot Gardiner and the Orchestre Revolutionnaire et Romantique. He has recorded a CD of Handel arias with Classical Opera and the tenor Alan Clayton, and performed and recorded J.S.Bach and C.P.E Bach Magnificats as principal viola with the baroque orchestra, Arcangelo.