Ben Carson said he plans to leave his position as Secretary for Housing and Urban Development (HUD) at the end of President Trump’s first term

Monday, Carson made the announcement during an interview with Newsmax TV’s John Gizzi stating his desire to return to the private sector.

“I will certainly finish out this term,” explained the Republican was appointed to the post following his own failed presidential bid in 2016.

READ MORE: Ben Carson removes anti-discrimination language from HUD’s mission statement

Yet when he was pressed on whether he would be interested in serving during a possible second Trump term, Carson admitted, “I would be interested in returning to the private sector, because I think you have just as much influence — maybe more — there.”

The 67-year-old was also very candid when asked about former Trump lawyer Michael Cohen telling Congress that Trump is a racist.

“I think Cohen is trying to ingratiate himself to the people who hate Trump,” he opined. “I’ve never seen anything that even remotely would remind me of racists, and believe me, I recognize a racist when I see them.”

READ MORE: Ben Carson’s HUD is lax on enforcing fair housing laws

Carson has received harsh criticism from Democrats for downsizing the department’s efforts to fight housing discrimination after postponing the implementation of the Affirmatively Furthering Fair Housing Rule which was approved during the Obama years.

“I don’t have any problem with affirmative action or integration — I have no problem with that at all,” Carson said during his Senate confirmation hearing in 2017. “But I do have a problem with people on high dictating it when they have no idea what’s going on in an area.”

READ MORE: HUD lawyers warned Ben Carson of possible ethics violation involving son

The former neurosurgeon also attracted early criticism in the role after emails showed he and his wife ordered a $31,000 dining room set to redecorate his office.

Federal law prohibits the head of a department spending more than $5,000 on refurnishing an office without getting advance approval from Congress. While Carson and HUD officials offered contradictory explanations for the order, the purchase was ultimately canceled after the price tag became public .