In 2004 Billy formed the band Cardboard Vampyres alongside Jerry Cantrell of Alice in Chains. Also in the band were vocalist John Corabi (Mötley Crüe), drummer Josh Howser and bassist Chris Wyse who later joined The Cult. This is a press photo from the period.