Give external parties the right to interface electronically
Give external parties the right to interface electronically with any government or mainly public system unless it can be shown to create substantial, irrevocable harm. Champion the right fiercely and punish unjustified refusals with fines.
Your starting list of projects should include patient-owned health records, council fault reporting services and train ticket sales databases. All are currently unacceptably closed to innovation from the outside, and obscurity allows dubious practices of all kinds to thrive.