Job Description AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia. If you like a challenging environment where you're working with the best and are encouraged to learn and experiment daily, there's no better place — guaranteed! :) We are looking for Lead Data Software Engineer What you will do Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals; Design, build, and maintain scalable data pipelines and infrastructure to support ML model development and deployment; Collect, process, and prepare large datasets for analysis, feature engineering, and model training; Implement data quality checks, validation, and monitoring to ensure the reliability and accuracy of data used in ML models; Optimize data storage, retrieval, and processing performance for ML workloads; Develop and maintain ETL (Extract, Transform, Load) processes and workflows; Manage data versioning, storage, and access control for ML datasets; Collaborate with DevOps and IT teams to ensure smooth deployment and scaling of ML models in production environments; Stay up-to-date with emerging technologies, tools, and best practices in data engineering and ML infrastructure. Must haves Bachelor's or Master's degree in Computer Science, Data Science, or a related field; Proven experience as a Data Engineer, preferably in a role supporting Data Scientists; Strong proficiency in programming languages such as Python, Java, or Scala; Proficiency with data storage and processing technologies, including SQL databases, NoSQL databases, and distributed computing frameworks (e.g., Hadoop, Spark); Experience with data warehousing solutions and data integration tools; Experience with data pipeline and workflow management tools: AWS glue, Airflow, etc; Knowledge of ML frameworks (e.g., TensorFlow, PyTorch) and ML model deployment; Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization (e.g., Docker, Kubernetes); Excellent problem-solving skills and a collaborative mindset; Excellent oral and written communication skills with a keen sense of customer service. Nice to haves Experience in ad/marketing environment Experience working with Data Lakes Experience with Scala Experience with Glue/EMR/Redshift/Airflow Experience with Terraform. The benefits of joining us Professional growth Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps. Competitive compensation We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities. A selection of exciting projects Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands. Flextime Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive. Requirements Experience with Python; Experience working with Data Lakes; Strong knowledge of SQL.
