PySpark Engineer + Palantir – Fully Remote
Digital nomads. Work from anywhereCompany: BPX
We are looking for an experienced PySpark Engineer to join a project focused on migrating and developing ETL/ELT processes within Palantir Foundry, which will serve as the organisation’s primary data lake platform.
Key information
* Start date: 1 October 2026
* Initial duration: Q4 2026, with a possible extension into 2027
* Engagement: Full-time
* Contract: B2B
* Location: Fully remote
* Methodology: Scrum with three-week sprints
Responsibilities
* Designing, developing and optimising ETL/ELT pipelines using PySpark and Python
* Building end-to-end data flows from source systems to data lake structures
* Migrating existing data processes to Palantir Foundry
* Developing scalable and reliable data engineering solutions
* Monitoring and improving pipeline performance
* Ensuring data quality and processing reliability
* Creating and maintaining technical documentation
* Estimating tasks and delivering assigned tickets on time
* Collaborating with data engineers, architects and business stakeholders in an international Scrum team
Requirements
* Commercial experience with PySpark and Python
* Strong background in data engineering
* Hands-on experience designing, developing and optimising ETL/ELT pipelines
* Experience building data flows from source systems to data lake environments
* Good understanding of distributed data processing
* Experience working with data lake platforms
* Ability to create clear technical and code documentation
* Experience working in Scrum teams
* Familiarity with Azure DevOps and/or Jira
* Experience using Confluence
* English proficiency allowing effective collaboration in an international environment
* Ability to work independently and take ownership of assigned tasks
Nice to have
* Hands-on experience with Palantir Foundry
* Experience migrating data pipelines between platforms
* Previous involvement in large-scale data lake transformation projects
What we offer
* A fully remote B2B engagement
* Full-time participation in an international data transformation project
* The opportunity to work with modern Big Data technologies and Palantir Foundry
* Potential contract extension into 2027
* Collaboration with an experienced, international project team