I think the issue with the physical thing is that after the exertions of last week and no time to recuperate (other than 1st class flight) his body might be vulnerable to injury if he's not feeling fully fit. So for instance yesterday Peter Fleming thought he should play and go for it but not if he has any physical niggles because of this greater vulnerability to injury at a key time.
That's one of the reasons why I wasn't happy about him playing in Toronto, and unfortunately I've been proved right. Andy said himself that a sudden change of surface is hard on the body at the best of times.
Also I do think he should have given himself time to enjoy his Olympic win and simply not played here. So what if he'd been fined? He can afford it, and winning a gold medal is something very few top sportsmen and women achieve during their careers.