The idea of “getting AIs to program themselves” is a good one even if it’s not very specific. I think on current trends the way this is going to happen is to have language models write Python and C++ code to improve themselves and other AI programs.
I’ve been using GitHub CoPilot to write Argos Translate unit tests and will hopefully do more with it as it’s capabilities improve.