Recent legal documents from the Superior Court of Los Angeles have indicated that Williams, 36, claims that "Aryn uses the fact that I work to support our family to marginalize me as a parent.

"I am in my 9th year on Grey's Anatomy. The structure and demands of my work schedule are the same as they were when we married and when we decided to have our wonderful children. Working full time did not keep me from being a doting parent then and it should not now. When Grey's is on hiatus (approximately April through late July), it is still my responsibility to earn an income, provide for our family and further my career," the documents said.

"Despite Aryn's refusal to recognize the time, effort and strategy required to be a self-employed professional in my line(s) of work, and her attempt to paint my work as purely recreational, all of the trips she listed in her Declaration generate the income used to support our family. I am always trying to work more efficiently so that I can free up as much time as possible to be an even more present parent to Sadie and Maceo," Williams' documents state.

According to the star, "My hard work has allowed Aryn the incredible privilege of being a stay-at-home mom, with a full-time nanny, able to be with our children when she wants. She is now punishing me for providing that privilege."

But Drake-Lee is reportedly objecting to Williams' posting photos of their kids on social media and in a statement to PEOPLE, her attorney said, "Aryn continues to work tirelessly to maintain Mr. Williams' bond with their children and it is important to remember that his allegations are one-sided. It is a shame that Mr. Williams has chosen to place the children and his family's transition in the public domain."