Scally calls Gills fans 'scumbags'
The Gills chairman also claims the club would collapse without him at the helm, saying the club's bankers are putting their faith in him personally, rather than the club itself.
"If I went tomorrow the club would collapse," he told the KM.
"The bank are backing me, not the club. The restructuring that I've spent years working on gives the club the opportunity to bounce back again. The bank are very confident in the job I'm doing.
"I'm feeling very unhappy by it all at the minute. If it wasn't for the backing of the bank, the staff and other people then I would have walked out on Saturday night.
"I've not done it because it would mean letting down the bank and the people who do believe in what I'm doing.
"My wife and my friends say to me, why do I bother when I'm letting it get me in such a state? I'm finding it harder to answer that.
"On Saturday I was sat on a plane and I was leaving behind my family again all for the sake of the football club and those scumbags who abused me for 75 minutes on Saturday. I have to ask myself why? I wanted to get off the plane at one stage and turn around.
"I said when I first came here I'll only stay as long as the fans want me and if they don't then I'll go."