Does anyone remember this show that was on Nickelodeon in the late 80's and early 90's?

Yes I do

Kind of like talk show for kids with Celebrity guests that would show clips from the movie or TV show they were in?

I can't remember everything about it, just the fact they showed a clip from a Freddy movie that freaked me out as a kid on one show and I remember a girl wearing a basketball hat from the intro

Not much help, but I remember it

yeah, i remember it. once they had one of the girls on from just the 10 of us, and she was actually in her mid-twenties but played a teenager and everyone thought it was pretty crazy. and once they had mark summers on. there might have been a boy named bj on it that i thought was cute, but that might have been a different show.

BJ was on Don't Just Sit There. The earlier episodes but then he disapeared. I remember there were 3 main hosts. Matt(who I had a crush on), Alie, and Wendy. Will Friedle was on the show for a while.
They had a band who also would participate in the sketch comedy they did as well.