I have done something similar to this but I have used 2 action buttons, in your case one called Follow and one called Unfollow and then you can use the display rules in the table cell to show the appropriate button.
Here is the follow action button display rules:
Here is the follow action rules:
Here is the unfollow display rules:
Here is the unfollow action rules:
