Two of the biggest music stars of their generation linked up last night — and performed at none other than a 650-person club in New York City!

Footage of the “Bloody Mary” musician, 37, singing alongside the band featuringMick Jagger,Keith RichardsandRonnie Woodsurfaced onsocial mediafollowing their performance.

The Rolling Stones and Lady Gaga perform in New York City on Oct. 19, 2023.Kevin Mazur/Getty

Mick Jagger and Lady Gaga perform during The Rolling Stones surprise set in celebration of their new album

Kevin Mazur/Getty

With her hair in a blonde shag and styled in a glitzy, asymmetrical black-and-red jumpsuit and matching scarf, the Grammy winnerchanneled a ‘70s rocker look. Her edgy prowess came out in the performance, too, as she delivered powerhouse vocals throughout the gospel-inspired rock song.

Lady Gaga and The Rolling Stones perform in New York City on Oct. 19, 2023.Kevin Mazur/Getty

Ronnie Wood, Lady Gaga, Mick Jagger, Steve Jordan and Keith Richards perform during The Rolling Stones surprise set in celebration of their new album

TheA Star Is Bornactress and Jagger, 80, had a playful back and forth, facing each other as they took turns wailing, “Oh yeah!” before ending the performance together at the front of the stage in an embrace.

It was a full circle moment for Gaga: In 2008, she celebrated the release of her debut album withThe FameBall event at the same venue, back when it was known as Highline Ballroom.

The Rolling Stones perform in New York City on Oct 19, 2023.Kevin Mazur/Getty

Mick Jagger and Lady Gaga perform during The Rolling Stones surprise set in celebration of their new album

Gaga’s appearance was among the many highlights of the special concert. The rock icons also played “Shattered,” “Angry,” “Whole Wide World,” “Tumbling Dice,” “Bite My Head Off” and “Jumpin’ Jack Flash,” giving as much energy throughout the humble club gig as they would at a stadium show.

A handful of famous fans came out to support the band includingChris Rock,Christie Brinkley,Christy Turlington Burns,Dan Reynolds,Daniel Craig,Dianna Agron,Ed Burns,Elvis Costello,Jimmy Fallon,Jemima Kirke,Keegan-Michael Key,Mary Kate Olsen,Minka Kelly,Questlove,Rachel Weisz,Taylor HillandTrevor Noah.

Before Gaga joined the rockers for the finale, she watched the show from the side stage, dancing along to the set.

The Rolling Stones perform in New York City on Oct. 19, 2023.Kevin Mazur/Getty

Ronnie Wood, Steve Jordan, Mick Jagger and Keith Richards perform during The Rolling Stones surprise set in celebration of their new album

On Friday, The Rolling Stones releasedHackney Diamonds. It marks their first album since 2005’sA Bigger Bangand their first release without drummer Charlie Watts, whodied in August 2021at the age of 80.

The 12-track record features several collaborations, in addition to “Sweet Sounds of Heaven,” which also seesStevie Wonderjoining the band and the “Hold My Hand” singer.Paul McCartneyassists them on bass on “Bit My Head Off,” andElton Johnprovides keys on “Get Close” and “Live By The Sword.”

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

Jagger previouslyopened up about working with theChromaticastarin an interview withZane Loweon Apple Music 1.

“She’s a really great singer, and I’d never heard her sing quite that style before,” the Rock and Roll Hall of Famer said.

He explained the recording was done “live in the room,” and shared, “That was a great experience, her just coming in the room and her just opening up and seeing her bits and feeling her way and then getting more confident.”

The Stones frontman continued, “And then we came back and then did some extra parts that we hadn’t done on the day and then we did some tidying up and we were just in the overdub room, really face-to-face, getting them really tight, the parts really tight, and then being slightly competitive and screaming.”

source: people.com