Big Data Engineer

The Offer- Work within a company with a solid track record of success- Flexible working options- Great work environment- High compensation according to your technical skills- Democratic management style & friendly environment- Professional and personal growthThe JobYour responsibilities will include :- Manage data quality and integrity- Assist with building tools and technology to ensure that downstream customers can have faith in the data they're consuming- Cross-functional work with the Data Science or Content Engineering teams to troubleshoot, process, or optimize business-critical pipelines- Work with Core Platform to implement better processing jobs for scaling the consumption of streaming data setsThe Profile- 5+ years of experience in data engineering creating or managing end-to-end data pipelines on large complex datasets.- Experience in developing scalable software using big data technologies (e.g. Hadoop, Spark, Hive, Flink, Samza, Storm, Elasticsearch, Druid, Cassandra, etc).- Expertise in Scala- Fluency with at least one dialect of SQL- Level of English : Upper-Intermediate- Experience with Streaming platforms, typically based around Kafka- Strong grasp of AWS data platform services and their strengths / weaknesses- Strong experience using Jira, Slack, JetBrains IDEs, Git, GitLab, GitHub, Docker, Jenkins, Terraform- Experience using DataBricksThe EmployerOur client is a one-stop custom software development company headquartered in sunny Florida with development centers in Ukraine, Kazakhstan, Israel, and Poland.