I registered you in the gym. You are GREAT in all those physical activities. But you hate it!!! You even have fun for several minutes, but for some reason you do not like it. I stopped taking you there.

I cannot decide whether it is because  you do not like to listen to your instructor (to make a circle with other children, or line up for ladder or….), or is it because you are not comfortable when other kids are there running around.

In the swimming pool, we have a similar story. You LOVE water and the swimming pool. But you just want to sit in the shallow section and play with toys as you wish. You do not like to listen to your instructor.

It seems that you are not comfortable with specific places. I think you do not feel safe, and get uncomfortable. But who knows. You might have other reasons.