Yes, it's perfectly acceptable to take your fish with you.

Short answer is that they don't want fish left on the bank of a high use area.