"Some stuff was said," said Young, who took a 4-0 lead before exiting in straight sets (7-5, 6-4, 6-4).
The second-ranked American said he was responding to comments from a spectator, but acknowledged that it affected his performance.
For all our our 2014 U.S. Open coverage, including updated draws and video, go to our tournament page.
"It was kind of annoying. It was like something about, 'Go ahead and cry to your mother again.’ It made me pretty mad. So I said shut up. It wasn’t beneficial," said Young. "And I was down 5-6, all that combination wasn’t great."
The defeat could see Young, currently ranked No. 47, fall from the Top 50 in the rankings.