In my experience, the VMware View Agent is to be upgraded after VMware View Composer, Connection, and Security servers are upgraded. It's okay to have lower Agents, but not greater. If your servers are View 5.1.3, then your View Agent should be 5.1.3 or lower.
I find that View Clients, however, can often be a higher version than the servers or agents.