There are too many awkward silences.
With first-date jitters, it's natural to have some uncomfortable pauses here and there. But if you two are struggling to fill the silence, it could mean you don't have enough common interests. If that's not the case, and it really is just nerves that are getting the best of you, don't be afraid to let them know. They'll probably be relieved that it's not because you don't want to be there.