Ratings for Steve Harvey‘s new talk show, “Steve,” are low, and sources close to production believe it’s because of backlash over Harvey’s meeting with Donald Trump after he was elected president.

According to the Daily Mail, Harvey’s new show, which premiered on Sept. 5, has been on the struggle bus when it comes to ratings, and Harvey and his team believe it’s because his Black audience has abandoned him after the Trump meeting back in January.

President-elect Donald Trump and television personality Steve Harvey speak to reporters after their meeting at Trump Tower, Jan. 13, 2017 in New York City.  (Photo by Drew Angerer/Getty Images)

“This is the moment his brand took a hit. He had been through a few scandals before – the divorces, the Miss Universe Pageant and the Asian joke gone bad – but he had never faced the wrath of his core audience before, middle-aged African Americans,” a source said.

–Steve Harvey says he regrets meeting with Trump–

“And unfortunately for Steve, he was too arrogant to realize the weight of his mistake and never made amends to his loyal followers for it.”

Now, Harvey is desperately distancing himself from Trump, saying on his radio show, “Meeting with Donald Trump was the worst mistake of my life.”

However, one source in production suggested that the problem isn’t just that there’s a backlash because of the Trump meeting: people simply don’t like the show.

“People just hate the show. He wanted to do a late-night feel for the show, but he’s on a big stage with a desk and a lot of open space and nothing about the show is engaging or warm. People just aren’t into it at all,” a source told the Daily Mail.