Governments should perhaps even have a separate organisation with expert IT consultants that are specialists on various systems commonly used in government organisations.
Lets say that the Tax department has a normal internal IT department that does most of the work but they can bring in comparably cheap help from the government IT consultant organisation for very specific needs.
The government is absolutely big enough that it could be worth it.