Stimson told BBC Radio Kent: "He's not liked, let's not hide away from it - probably like myself.
"But he's like me, he has a big heart. They won't beat him, they won't drive him out because he's bigger than that."
He added: "I hope the supporters get behind him.
"A bit of encouragement for certain players won't do them any harm at all.
"I know it might be difficult for some people to give certain players encouragement but it would be nice if everyone was judged fairly."
Miller, a former Ipswich Town trainee, followed Stimson to Gillingham from Stevenage Borough in November 2007.
It had looked like Miller's Gills career was over when he was sent out on loan to Dagenham and Redbridge earlier this season, but he has now fought his way back into Stimson's first choice XI.
Source: BBC Sport
Source: BBC Sport