you just need to spend more time memorizing it,
it could be your method of memorizing?
just take 1 section till you remember it, then move to the next
as for not hearing all the notes, usually it's possible to figure it out by listening and reading the tab, kinda working it out simply using logic to take a stab at how those bits are played...
and yes it all improves the more you do it