Recursive AI self-improvement raises questions about autonomy, accountability, purpose and what it means to improve itself.