I used Polyurethane, not true varnish.
I'll try some OO steel wool first and see how it looks next weekend. I'll post pictures eventually... Thanks guys!
With Poly you can definitely recoat after sanding with a lower gloss finish. Sanding alone could make it better but it's very difficult in my opinion without the scratch patterns showing through the finish unless you use a really fine grit which tends to make it shine more.
^^^ Wood Jedi.