Sorry I'm late on posting this topic -
My feeling with a 4-5 year old clover plot - maybe on the down side - is "you have money in the bank" - I mean Nitrogen in the soil. As a manager on my property - I'm most likely planting corn or maybe soybeans if corn isn't a good option for some reason.
If the plot has been really good as a clover plot - maybe I go back to it even after one year- but You have to take advantage of the free N - and also rid a good plot of Excess N - for the next clover planting.
In my experience - a good clover plot - makes for a good corn plot. The soil will be good - and you already know the location is good by the use you've seen. Other planting options are out there - but corn is a great N user and a fall/winter attractant like no other.
My 2 cents.
FH