Pyspark developer - 100% remote - £615 inside IR35

Location United Kingdom
Discipline: Software Engineering
Job type: Contract
Salary: £615 inside IR35
Contact name: Liam Scott

Contact email: liam@exalto-consulting.com
Job ref: 841192b
Published: about 11 hours ago
Startdate: ASAP
Pyspark developer- 100% remote - £615 inside IR35

Exalto consulting are currently recruiting for a contract Pyspark developer this is an inside IR35 contract role paying £615 per day, 100% remote working and initial contract until end of 2025 

Key Duties and Responsibilities 
  • Develop and optimise PySpark batch pipelines that process Parquet data and use Delta Lake for all IO, applying validation, enrichment, and billing calculation logic directly in PySpark code.
  • Build reliable PySpark jobs that read/write Delta tables on ADLS Gen2.
  • Integrate with orchestrators (ADF or Container App Orchestrator) and CI/CD pipelines (GitHub Actions)
  • Operate securely within private-network Azure environments (Managed Identity, RBAC, Private Endpoints).
  • PySpark with Delta Lake (structured APIs, MERGE, schema evolution).
  • Solid knowledge of Azure Synapse Spark pools or Databricks, ADLS Gen2, and Azure SQL.
  • Familiarity with ADF orchestration and containerised Spark workloads.
If you have the above experience and are looking for a new contract role please send your CV for immediate consideration as our client are looking for someone to hire ASAP 

Pyspark developer - 100% remote - £615 inside IR35