If you have staff that are leaving, and you'd like to keep them permanently on your schedule up to their departure date, you can tell OnCall not to include them in the schedule from a specific day.

Go to the work-preferences calendar for the person who will be leaving. Go to the month where the person leaves and right click on the last day the person is with you. Choose Quit on this day.