Data Quality Automation Tester
Компания: Timspark
Локация: EU
Формат работы: Удаленно
Зарплата: 30$ gross per hour
Role Responsibilities
- Develop and maintain automated test scripts in Databricks (Python, PySpark, SQL)
- Validate JSON messages (AMQP) for structure, completeness, and accuracy
- Implement data quality checks (schema validation, range checks, anomaly detection)
- Validate end-to-end data flow from SCADA systems through AMQP into Databricks
- Verify data transformation logic and ensure compliance with business rules
- Store and document test results in Azure services (Data Lake, Blob Storage, Azure SQL)
- Create dashboards/reports in Grafana or Databricks notebooks
- Integrate automated tests into CI/CD pipelines using Azure DevOps
- Collaborate with Data Engineers, SCADA specialists, and Cloud teams
- Document test cases, procedures, and results
Must-Haves
- Strong hands-on experience with Databricks, PySpark, Python
- Proficiency in handling JSON messages
- Solid knowledge of Azure services (Data Lake, Blob Storage, Functions)
- Proven experience in automated testing in cloud environments
- Familiarity with CI/CD, ideally Azure DevOps
Nice-to-Have
- Understanding of SCADA systems and renewable energy data flows
- Experience with AMQP protocols
- Knowledge of telemetry / SCADA industry standards (e.g., OPC)
- SQL experience
Duration: 12 months+
Откликнуться: @svidinskaya
