Fiery Economic Freedom Fighters (EFF) leader Julius Malema on Tuesday apologized to former presidents Thabo Mbeki and Nelson Mandela for helping to bring President Jacob Zuma to power, before he led a walkout of his MPs from the National Assembly.

Participating in the debate on Zuma’s State of the Nation address, Malema acknowledged that he had “led the charge for the removal of President Mbeki” and admitted this was a mistake.

“We were misled by this man,” Malema said, referring to Zuma, who had allegedly told him he was not prepared to work with Mbeki.

After declaring that Zuma should now be removed as president, Malema led a walkout of his fellow EFF MPs from the House.

“I’m leaving. I can’t sit to debate… you are an illegitimate president. Bye-bye,” said Malema as his parting shot.