Mr Baker accused Mrs May and other Conservatives of failing to work across party lines.
His fellow Liberal Democrat, Lynne Featherstone, has been appointed to replace him.
David Cameron said he had worked with Theresa May for nine years, and that she was an ”incredibly effective minister and administrator”.