Loan forward Alex MacDonald claimed the 14th-minute winner after his shot deflected off marker Anthony Straker and looped over goalkeeper Jamie Young.
"I have got to look at the bigger picture and what I am asking my players to do," Holdsworth said. "We have dominated that game, hit the post twice and on another day we would be walking away with three points. To walk away with nothing just shows that you don't always get what you deserve.
"To give Plymouth credit, they defended for their lives, but I have got to look at my team and say I am very proud of their performances.
"If it was a practice ground game, I would be walking away saying 'what a great session we have just had' and I have got every right to be delighted with a lot of things but sometimes you don't always get what you deserve and this is that day.
"We have got to stay confident, believe in what we are doing and playing the right way and we will get what we deserve."
Any reproduction, publication or redistribution of this material without the written agreement of 365 Media Group is strictly forbidden.