Data Engineer

We're looking for Data Engineer to join a high-impact transformation project focused on building a fully automated, SOX-governed financial reporting pipeline that integrates an Azure Databricks Lakehouse environment with Workday General Ledger.

This is a unique opportunity to work alongside industry experts, gain deep exposure to enterprise-scale Databricks architecture, and contribute to the delivery of a mission-critical financial data platform.

What You'll Be Doing

• Design, develop, and optimize production-grade ETL pipelines using Azure Databricks, PySpark, and Python


• Build and manage Delta Lake structures and Unity Catalog governance frameworks


• Develop Bronze, Silver, and Gold Lakehouse data pipelines with clear lineage and auditability


• Implement financial data transformation logic, KPI-to-GL mappings, and reconciliation processes


• Create automated data quality frameworks including validation, completeness checks, duplicate detection, and threshold controls


• Build REST and SOAP API integrations with robust error handling and monitoring


• Implement SOX-compliant controls, audit trails, approval workflows, and governance processes


• Support testing, UAT, reconciliation activities, and production monitoring


• Develop operational dashboards and reporting layers supporting Finance and business stakeholders


• Produce technical documentation, runbooks, and handover materials for long-term operational success

Required Skills & Experience:

Bachelor's Degree in Computer Science, Data Engineering, Information Technology, Mathematics, or a related field

3+ years of experience in Data Engineering or Analytics Engineering

• Hands-on experience with:


• Azure Databricks


• Databricks Workflows


• Delta Lake


• Unity Catalog


• PySpark


• Python


• SQL

Experience working with:

• Azure Data Lake Storage Gen2 (ADLS)


• Azure Key Vault


• Azure Data Warehouse environments


• API integrations (REST/SOAP)

Strong understanding of Lakehouse architecture and Bronze/Silver/Gold data modeling

Experience building production-ready ETL pipelines and data quality frameworks

Excellent documentation and communication skills

We're looking for professionals who:

?? Take ownership and drive delivery

?? Bridge technical and business conversations effectively

?? Learn quickly in fast-paced environments

?? Have exceptional attention to detail

?? Thrive in collaborative, cross-functional teams

?? Understand governance, compliance, and financial reporting requirements