Herefordshire Council is to bid for Heritage Lottery funding towards creating a public viewing facility to better display the Roman remains discovered at The Prospect in Ross.
Works are also to continue to rebuild the listed wall which will mean a wellingtonia tree will have to be removed. This tree will, however, be replaced as part of a conservation plan for the area.
Councillor John Jarvis, Herefordshire Council's cabinet member for the environment and strategic housing, said: "The form and structure of the Prospect requires the collapsed retaining wall to be reinstated and this will either lead to the destruction of the archaeological remains or the removal of the wellingtonia.
"While no-one likes to remove an established tree it can, unlike the archaeological find, be replaced by another mature tree and the wellingtonia was not a part of the original park as laid out by John Kyrle, "the father of Ross".
"The archaeological find, however, is of considerable importance nationally and would add significantly to the heritage value of this prominent site and attract more visitors which can only be good for the future prospects of the town," he added.
The archaeological find was discovered during works to repair a listed wall following its partial collapse. Excavations revealed the foundations of a square building with thick masonry walls and an internal circular plan with dished clay floor and central post-hole.
There is good evidence that the remains are Roman in origin, with pottery found dating from the 2nd century AD and later.