You can download the svg (file/export), and check the in to a git repository.
What you can not do is put an ongoing versioning into a repository automatically and directly from penpot. (It would not make a lot of sense for various reasons on how visual /behavioral design differs from code and how git works best with hand written, line-based code)
I do think it would be interesting to have the possibility of a GitHub/GitLab connection for version control. Yes, regarding the “line-based-ness” it wouldn’t be as nice as normal code, but I do think it would still be useful!
Are there any planes for this kind of integration? E.g. draw.io has it too and is in many ways more similar to Penpot than you would think at first.