Re: date him just for the experience?
You're already talking about rejecting him when you haven't even gone out with him! Can you just suspend judgement, not call it anything but 'time together' and see how it goes?
People who have that 'instant attraction' to someone usually aren't responding to them (they don't know them yet, really), they're responding to their own fantasy about them. Those don't last long, anyway, b/c they're not based in reality! The best relationships start off slow. There's nothing here to back away from, but because there's nothing obviously exciting about it doesn't mean you're necessarily wasting your time, either.
See what happens.