Virgo, trying to forge a career in the media following his retirement, said the Millers were destined for the drop this season after he watched them in their defeat at Brighton earlier this month.
In a column for the Football League Paper, the 32-year-old said: "You come up on the crest of a wave, fight tooth and nail to stay up. Then the adrenaline wears off.
"Promoted clubs always seem to suffer from second season syndrome – and for Rotherham that spells bad news.
"The Millers stayed up by the skin of their teeth last year and, having watched them lose 2-1 at Brighton this week, I’m not optimistic of a repeat.
"And even at this early stage in the season, they seem to be going away from home and putting everybody behind the ball, just trying to stay in games.
"Making things untidy, getting physical and going for the smash and grab is fine every now and then, but you’ll get found out over 46 matches.
"But the biggest thing for me is the opposition. When you look around the Championship, who is bad enough to save them?
"There’s no crisis club like Blackpool. No fallen giant like Wigan, struggling to shift players on Premier League wages.
"Given that Rotherham haven’t improved – and Evans was saying after the match that the funds won’t be there to invest in quality this season – I just don’t see how they can finish above three other teams.
"In short, then, they’ve lost their best player, they struggle to score, they concede bad goals and confidence is shot. I can only see it ending one way."
The Millers have kick-started their season since then, winning back-to-back games for the first time at this level under Evans and the Millers boss was not quick to forget those words from Virgo.
Evans called him a "numpty" after last weekend's win over Cardiff - a comment which mistakenly got construed as an attack on the fans - and he picked up the baton again his side's superb success at Birmingham.
"You’ve got people like Adam Virgo who wants
to watch his words, saying that we’re going to be relegated and that I
shouldn’t be here,” he said.
“If that’s based on someone watching us for
five or six games or it comes from someone who’s won a game as a manager, then
you’d accept that, wouldn’t you?
"Not from someone who’s awful as a pundit on
the television.”
Being the subject of criticism is nothing new to Evans and he is often vilified by opposition fans, sections of the media and - at times this season - his own supporters.
His side are constantly written off, with Virgo's comments the tip of the iceberg in terms of the doom mongering the Millers have to face.
The Scot admits the criticism does hurt but has vowed to carry on regardless.
"We’re
pushing water uphill here at different times, but what we’ve got here is a
fantastic chemistry in that we want to win from the chairman down to myself and
the players," Evans said.
"Everyone in life has got feelings. My
players have got feelings,” he said.
“Let
the knockers continue and we’ll just continue to try to prove the doubters wrong,
as we’ve done for the last three and a half years.”
