It doesn't have to. For some guys, it doesn't. Remember the disease: EPID
Every penis is different. K well it's not a disease ;P but they're different so yours just might not go down. Mine doesn't go all the way down either when I get hard.