Tech – Data Engineer: Build & Automate WOG ICT Spend Data Pipeline

How much does the Singapore Government spend on Infocomm Technology and Smart Systems (ICT&SS), and how can data from different sources be brought together reliably to support analysis and decision-making? In this project, you will help BUILD AND PRODUCTIONISE AND END-TO-END DATA PIPELINE that automates the processing of Whole-of-Government (WOG) ICT&SS expenditure data. Working on Databricks, you will transform data from multiple government sources into consistent, analysis-ready datasets that can be reliably reproduced for future data cycles. The project brings together three key data sources: 1. ICT&SS non-manpower expenditure data from the Accountant-General's Department (AGD); 2. ICT&SS manpower expenditure data from the Public Service Division (PSD); and 3. GovTech's annual poll of government agencies on their overall ICT&SS expenditure. You will work on defined data-engineering tasks covering data collation, cleaning, mapping, transformation, consolidation, reconciliation and validation. A key challenge is dealing with the complexity of real-world datasets from different sources and designing configurable, reusable processing rules instead of relying on one-off scripts and manual processing. Depending on your progress and interests, you may also have opportunities to investigate data inconsistencies, propose improvements to configuration rules and templates, determine suitable transformation approaches, improve the pipeline, and develop a Databricks Genie dashboard for exploration and analysis. This is a LIVE GOVTECH PROJECT RATHER THAN A STANDALONE INTERSHIP EXERCISE. The pipeline will be used to process and test the 2025 expenditure datasets during the internship. The resulting data will support comparison between AGD/PSD expenditure records and GovTech's annual poll, informing policy analysis and reporting to the Ministry of Digital Development and Information (MDDI). It will also help government agencies benchmark their ICT&SS expenditure against agencies of similar size. You will work closely with a GovTech data engineer who previously joined the department as an intern, with guidance and regular code reviews from the team. An Assistant Director will supervise the project and lead business engagements with AGD and PSD. You will also have opportunities to collaborate with colleagues across GovTech, AGD and PSD, as well as GovTech's CIO Office for Databricks expertise. The internship requires a minimum full-time commitment of 3 months. Longer internships, including 6-month attachments, are welcome where candidates' availability permits and can be discussed during the interview.