I don't know too much about York's Kin program but based on what I've seen from other programs, there's a course called "Biomechanics" which will require some physics knowledge. In some universities, that is a mandatory course.
I'm pretty sure all BSc. Kin programs requires you to take a math course first year and if you haven't taken grade 12 calculus, you'll have to take an equivalent first year.
I would worry too much though because after first year, you'll be done with the math/physics courses if you don't want to take it anymore.
I didn't take grade 12 Physics either because I'm not too much of a Physics person. I do love math though.
McMaster Kinesiology Class of 2016