Job Description : We are seeking a skilled Data Engineer with expertise in Pyspark and Spark SQL to join our team. The ideal candidate will have a strong focus on translating Pyspark pipelines into Spark SQL and porting them to DBT (https : / / www.getdbt.com). As a Data Engineer, you will be responsible for building, testing, and deploying analytical models using SQL, Python, and Databricks.Roles and Responsibilities : ? Leverage existing data pipelines and staged datasets to build and maintain data transformations for Analytics Models.- Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. ? Translate Pyspark pipelines into Spark SQL and ensure smooth integration with DBT.- Develop and implement data quality checks to ensure accuracy and reliability of analytical models. ? Write efficient SQL and Python code to perform data transformations and calculations.- Test and validate analytical models to ensure they meet business requirements and performance standards. ? Deploy analytical models into production environments, monitoring their performance and making necessary optimizations.- Collaborate with Data Scientists and Analysts to understand their data needs and provide support in data preparation and feature engineering.- Stay up to date with industry trends and best practices in data engineering and analytics. Qualifications : ? Bachelor's degree in Computer Science, Engineering, or a related field plus 5+ years of experience as Data Engineer.- Proven experience in building and maintaining data transformation pipelines using Pyspark and Spark SQL. ? Strong proficiency in SQL and Python programming languages.ValueLabs is an IT Service company, focusing on Technology innovation and problem solving.We started operations in Costa Rica in 2020, and have recently expanded our opportunities to all LatAm.We are hiring for long-term positions with all the legal working benefits. As a Data Engineer, you will work as an individual contributor alongside with our VL & client teams distributed in US, India & LatAm.- Experience with Databricks or similar big data processing platforms. ? Solid understanding of data modeling principles and ETL processes.- Excellent problem-solving skills and attention to detail. ? Strong communication and interpersonal skills, with the ability to work effectively in a team environmentApply now