Job DescriptionAgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc.5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.If you like a challenging environment where you're working with the best and are encouraged to learn and experiment daily, there's no better place guaranteed! : )We are looking for Senior Data Software EngineerWhat you will do- Collaborate closely with Data Scientists to understand their data requirements, model development needs, and performance optimization goals;- Design, build,and maintain scalable data pipelines and infrastructure to support ML model development and deployment;- Collect, process, and prepare large datasets for analysis, feature engineering, and model training;- Implement data quality checks, validation, and monitoring to ensure the reliability and accuracy of data used in ML models;- Optimize data storage, retrieval, and processing performance for ML workloads;- Develop and maintain ETL (Extract, Transform, Load) processes and workflows;- Manage data versioning, storage, and access control for ML datasets;- Collaborate with DevOps and IT teams to ensure smooth deployment and scaling of ML models in production environments;Stay up-to-date with emerging technologies, tools, and best practices in data engineering and ML infrastructure.Must haves- Bachelor's or Master's degree in Computer Science, Data Science, or a related field;- Proven experience as a Data Engineer, preferably in a role supporting Data Scientists;- Strong proficiency in programming languages such as Python, Java, or Scala;- Proficiency with data storage and processing technologies, including SQL databases,NoSQL databases, and distributed computing frameworks (e.g., Hadoop, Spark);- Experience with data warehousing solutions and data integration tools;- Experience with data pipeline and workflow management tools : AWS glue, Airflow, etc;- Knowledge of ML frameworks (e.g., TensorFlow, PyTorch) and ML model deployment;- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization (e.g., Docker, Kubernetes);- Excellent problem-solving skills and a collaborative mindset;Excellent oral and written communication skills with a keen sense of customer service.Nice to havesExperience in ad / marketing environmentExperience working with Data LakesExperience with ScalaExperience with Glue / EMR / Redshift / AirflowExperience with Terraform.The benefits of joining usProfessional growthAccelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.Competitive compensationWe match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.A selection of exciting projectsJoin projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.FlextimeTailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office whatever makes you the happiest and most productive.RequirementsExperience with Python; Experience working with Data Lakes; Strong knowledge of SQL.
