Bravo 1 with Gaffrig Shifter Question
 

I have a 2003 PowerQuest Legend with Bravo 1 and Gaffrig shifter. Upon starting the engine it shifts into F/N/R just fine (a little stiff but probably normal). After running for a while in F, it tends to be a little tough to pull it back into N. However, once it goes back into N and I shift into F and then back into N, it is smooth. It's only tough to shift from F to N after it has been in gear for a while. It has never stuck though but just trying to be proactive. Is this normal? Any signs that I have something potentially wrong? Thanks.