Inner Council

The Inner Council consisted of the Lord or Lady President, the Lord or Lady Chancellor, and the Castellan. (DW: The Deadly Assassin, The Five Doctors)

If the other two members of the Inner Council were in agreement they could overrule the Lord President, an event which happened, when, against President Borusa's wishes the Castellan and Chancellor Flavia voted to summon the Master to Gallifrey. (DW: The Five Doctors)

In The End of Time, the President is seen to preside over a small group of Time Lords who advise him, as well as a large number referred to as the High Council. It is possible that this small group is the Inner Council, but there is nothing on screen to suggest this.