Java/Scala Data Engineer
8allocateMain responsibilities and activities:
- Build services/features/libraries that serve as definitive examples for new engineers and makes major contributions to library code or core services
- Design low-risk Spark process and write effective complex Spark jobs (data processes, aggregations, pipeline)
- Design low-risk APIs and write complex asynchronous, highly parallel low latency APIs and processes
- Work as part of Agile team to maintain, improve, monitor Adthena's data collection processes using Java and Scala
- Write high quality, extensible and testable code by applying good engineering practices (TDD, SOLID) using.
- Understand and apply modern technologies, data structures, and design patterns to solve real problems efficiently
- Support TA and Data Science team to help deliver and productions their backlog/prototypes
- Take ownership and pride in the products we build and always make sure they are of the highest standard
- Be empathetic towards team members and customers
You will fit if you:
- Commercial experience developing Spark Jobs using Scala
- Commercial experience using Java and Scala (Python nice to have)
- Experience in data processing using traditional and distributed systems (Hadoop, Spark, AWS - S3)
- Experience designing data models and data warehouses.
- Experience in SQL, NoSQL database management systems (PostgreSQL and Cassandra)
- Commercial experience using messaging technologies (RabbitMQ, Kafka)
- Experience using orchestration software (Chef, Puppet, Ansible, Salt)
- Confident with building complex ETL workflows (Luigi, Airflow)
- Good knowledge of working cloud technologies (AWS)
- Good knowledge using monitoring software (ELK stack)
- Motivated problem-solving skills, ability to bring ideas forward and adapt solutions to complex challenges
About the project:
A market leader in developing Competitive Intelligence for AdTech Search.
Application teams develop unparalleled technologies that help clients understand their paid and organic search landscape and improve campaign performance.
As a Data Engineer, you will be working across our entire stack, so a real passion to drive the product and technology forward is something that we value. Your responsibilities will include helping with a vision for the future architecture of this complex data system, adding innovative ideas that use the latest cutting-edge technology. You will work closely with Web and Data Science teams to deliver user-centric solutions to our customers and become an expert in developing high-quality technical solutions.
The stack of a project:
- Languages: Java, Scala, JavaScript (React, Backbone), SQL, and scripting using Bash and Python
- Frameworks: DropWizard, React, Akka, and Play Framework (Scala)
- Databases: PostgreSQL, AWS(S3), Redshift, Redis, MongoDB, Cassandra
- Technologies: RabbitMQ (messaging), Quartz scheduling, Docker and Kubernetes, Maven
- CI/CD: TeamCity, Jenkins
- Source Control: Git (GitHub)
- Other Tools: IntelliJ IDEA, Jira, Grafana
Why choose us?
- “Family and Friends”. We are no longer a start-up, but still, have a family atmosphere in our supportive and spirited team, who are all working together on the same goal.
- “Just break down all barriers and find a better way”. Every day you’ll meet with interesting and challenging (international) projects that are covering industries from commercial aviation to fintech (different technologies, different products).
- “Hungry for learning”. You will get a lot of chances for career advancement and the development of new skills, opportunities for mentorship, or learning from more experienced colleagues.
Benefits from 8allocate:
- You’ll work in a supportive and spirited team of professionals.
- Corporate events, holidays, and team buildings for your joy.
- Training and development: we have a huge library (about 500 books!) and a budget for your professional development.
- English courses.
- People-oriented management without bureaucracy.
- Paid vacation and sick leaves.
- Relocation program: if you are from another city and want to move to Kyiv, we will be happy to help you!