there is no "problem" with the fretboard, it is just played, I don't think it possible to get the dirt out of the fret board in those areas, Either a new fretboard it you want it to look new, nice, and uniform or keep it the way it is and have it look like a played classic, I'd say leave it.
Those frets look damn near flat, so a refret my be in your guitar's future.