It doesn't affect it in any major way, in fact lots of teens have erratic sleep schedules and grow fine!
As far as how you feel, your moods, and how good of a sleep you're getting, it does matter when you go to sleep - you should get the reccomended hours of sleep and
you should stay on a schedule, such as go to bed at 10 and wake up at 8. It's less stressful and you get a better night's sleep
But no, there's nothing to worry about man, it doesn't affect your growth in any major way.