Data Engineer - SC Cleared at Department for Business, Energy & Industrial Strategy, London/Remote, 6 Months, £Contract Rate

The Department for Energy Security and Net Zero (DESNZ) is focused on the energy portfolio from the former Department for Business, Energy and Industrial Strategy (BEIS).The responsibilities for the Department for Energy Security & Net Zero are:Delivering security of energy supply.Ensuring properly functioning energy markets.Encouraging greater energy efficiency.Seizing the opportunities of net zero to lead the world in new green industries.We encourage our colleagues to be bold, be collaborative, be inclusive and to be big on learning. If you want to take part in meaningful work that makes an impact in the UK as well as abroad, then look no further than the Department for Energy Security and Net Zero.The Department of Energy and Net Zero has a secure analytic platform for its Analytical community. The platform sits on the Azure Public Cloud and is supported by a small Internal team.The team also provides a data engineering service to the users.

 

The role here is to build automated pipelines data can clean, transformed and stored in the best place for our users to access. The data engineer will work with the team Lead Data Engineer.As a Data Engineer, your main responsibilities will be:Recognising the opportunities to reuse existing data flowsAnalysing problems and experimenting with possible solutions to find the underlying causes of issues or discrepancies to identify problems and to assist in the development of innovative solutionsAnalysing and reporting test activities and results, supporting data engineers and stakeholders on data analysis issuesLead the build of data streaming systems, designing and implementing a data streaming service, including the development of new data models and ETL processesEnsuring the successful delivery of completed data loads for customers, Data Engineers and Data Scientists, troubleshooting where required.Optimise the code to ensure processes perform optimallyDesigning, building and testing data products and solutions that are complex or large scale, through full development, test and deployment lifecyclesLead work on database management, applying concepts and principles of data modelling and producing relevant and varied data models across multiple subject areas and providing guidance on how to use themEssential:SC Clearance is an essential requirement for this role, as a minimum you must be eligible and willing to undergo these checks.Strong Data Engineering experience.Experience of working with Azure.Programming skills (Pyspark, Python, R etc.)Version Control experience.Desirable:Public Sector experience.Data Catalogue experience.Model Development and CICD Deployment experience.Experience of Azure ML or Open AI.

 

Please be aware that this role can only be worked within the UK and not Overseas.Disability Confident As a member of the Disability Confident Scheme, DESNZ guarantees to interview all candidates who have a disability and who meet all the essential criteria for the vacancy. In cases where we have a high volume of candidates who have a disability who meet all the essential criteria, we will interview the best candidates from within that group. This scheme encourages candidates with a disability and/or neurodivergence to apply.In applying for this role, you acknowledge the following this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different.