My #ABCofPunk D is for The Damned. I wasn't their biggest fan, Captain Sensible's bass, even for a lover of the instrument like me, was just too much. But let's not forget, they released New Rose several weeks before The Sex Pistols' Anarchy in the UK; so it is widely claimed that this was the first punk record in the UK.
Grimly Fiendish however, came very much later in 1984, it's a bit more pop than punk, not so bassy either, but has the sense of 'Goth' about it. I expect the band still roll up every year to Whitley Bay for the Goth festival/weekend and doubt that Captain Sensible is anything but.
I didn't see them live, but didn't think you'd let me get away with The Dolls... for the New York Dolls under D.