Over time, the sun can make your matte paint look dull and dusty, and it'll be harder to keep clean because dirt sticks to it easily.
To protect it, I'd recommend getting a professional ceramic coating. This will keep your paint looking good and help it stay cleaner, all without making it shiny...