The end of the season is the most common and appropriate time. Presentations at end-of-season events, final training sessions, or club award nights give the gift a public moment that acknowledges the coach's contribution.
Other appropriate moments: cup finals (win or lose), coaching milestones (10 years with the club), or when a coach is stepping down. Individual thank-yous after particularly impactful seasons are also welcome.