Jesse Williams is reportedly battling his estranged wife Aryn Drake-Lee over custody of their two children, accusing her of restricting his time with them despite being an active father.

According to theJasmineBRAND, Williams is currently contesting for joint custody of their daughter, Sadie, and son, Maceo. In legal documents, the Grey’s Anatomy star says despite efforts made to see his children, Drake-Lee has not been cooperative.

“Aryn restricts my time with the children and decides when, and for how long I may have them. She has rejected, without any reason, each and every request I have made to have the children sleepover at my residence,” Williams wrote. “On the few days that I have the children, Aryn has insisted that my time with the children be limited during the week to approximately two-and-a-half hours per day, despite my requests for more time, including overnights with the children.”

In response to Williams’ accusations, Drake-Lee’s attorney wrote the following:

Protecting the privacy and well-being of their children is of paramount importance to Aryn Drake-Lee Williams. It is unfortunate that Mr. Williams has chosen to draw public attention to this difficult time and transition for their family. Aryn is solely interested in the best interests of their children, supporting a healthy relationship with both parents, and protecting the children’s privacy. Therefore, she will not comment any further on Mr. Williams’ unilateral and unfortunate public allegations.

Williams filed for divorce in April after five years of marriage.