Lead Data Engineer / Long Term Project / Spark
Zenith People
BB73BL
Contract
£650/day
BB73BL
Posted: 19/09/2023
Are you interested in more IT jobs?
Apply on Partner SiteInside IR35
Fully Remote Role
Sponsorship not offered
Are you a seasoned Azure Data Engineer with a passion for cutting-edge technology and a drive for operational excellence? Our client, a prominent player in the finance industry, is seeking a talented Azure Data Engineer to join their dedicated engineering team within the Non-Standard Entities Product Area (NSE PA) of the IFRS Global Finance Transformation Programme.
Company Overview: Our client, a major entity, is responsible for the finance integration of all special-case legal entities globally, including new acquisitions and joint ventures. Leveraging Azure technologies such as Databricks, Data Factory, and Data Lake (Delta Lake), the NSE PA excels in extracting, loading, and transforming data from diverse source systems to deliver it seamlessly into my client's state-of-the-art global finance platform built on SAP FPSL.
Key Qualifications:
Must-Have Skills:
* 3+ years of experience in data engineering application development using Spark, preferably in an enterprise environment on Microsoft Azure.
* 5+ years of experience in building enterprise big data/data engineering applications using continuous integration tools like Azure DevOps.
* Strong Databricks and Spark expertise, with the ability to mentor and guide others.
* Proficiency in Python/PySpark and SQL (Spark SQL).
* Git version control.
* Strong understanding of reusable software design patterns.
* Experience in Azure Data Factory, Azure Data Lake, Azure Log Analytics, Azure KeyVault, and Git.
* Proven track record in designing and implementing production-grade solutions.
* Commitment to delivering high-quality code with a focus on simplicity, performance, maintainability, and scalability.
* Practical experience in applying an agile way of working and DevOps methodologies.
* Excellent analytical and conceptual skills to understand complex technology stacks and their dependencies.
Nice-to-Have Skills (Or Willingness to Learn):
* Enterprise system integration experience.
* Knowledge of insurance practices.
* Background in finance & accounting or actuarial principles
Or check similar jobs