The surviving members of Nirvana played a surprise concert at Saint Vitus, a small bar in Brooklyn, NY, following their induction into the Rock and Roll Hall of Fame on Thursday night.

According to the New York Post, only 250 friends and insiders were invited to the secret show.

Dave Grohl, Krist Novoselic, and Pat Smear performed a full set of Nirvana songs with Rock Hall performers Joan Jett, Kim Gordon of Sonic Youth and Annie Clark (AKA St. Vincent) once again contributing vocals.

Read more: New York Post