Thanks for bringing the comic to my attention in the first place! I agree that the concept sounds so wild that I have to have it. That bat-family-detective inspired itch got me scratching until I dug into the credits. I vaguely remembered a buddy had a Batman Noir edition of something but didn't confirm until today that I didn't imagine it and it was the Noir edition of The Dark Knight Returns (which I guess is right at home for Frank Miller).
The TDKR Noir was pretty cool too! I think color does a lot to sell the scope of the world, stories, uniforms, etc., but seeing just the pencils and ink makes the art really stand out in a different way.
My best guess is the Tales to Tremble By scary story collections:
Each story had some creepy art by Gordon Laite:
A lot of this fits with your descriptions from the best of my recollection.
Edit: Removed paragraph about potential third scary story series containing spider egg story, just realized that one was from Scary Stories to Tell in the Dark 3, so Tales to Tremble By and its sequel is my only guess here.