Databricks Developer / Architect

Databricks Developer / Architect
Empresa:

(Confidencial)



Área:

Otros

Databricks Developer / Architect

Detalles de la oferta

San Isidro, Buenos Aires

We are looking for DataBrinks Developer/ Architect who responsibilities will be:

- Designing and implementing highly performance data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks
- Delivering and presenting proofs of concept to of key technology components to project stakeholders.
- Developing scalable and re-usable frameworks
- Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
- Working with event based / streaming technologies to ingest and process data

- Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
- Evaluating the performance and applicability of multiple tools against customer requirements
- Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Requisitos

- Strong knowledge of Data Management principles
- Experience in building ETL / data warehouse transformation processes
- Direct experience of building data piplines using Azure Data Factory and Apache Spark (preferably Databricks).
- Microsoft Azure Big Data Architecture certification (Desired but not required).
- Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
- Experience with Apache Kafka / Nifi for use with streaming data / event-based data
- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data
- Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform

Beneficios


Fuente: Kitempleo


Área:

  • Otros / Otros

Requisitos


Conocimientos:

  • SQL

Ofertas Relacionadas

Research associate - library team

Evalueserve is a global professional services provider offering research, analytics, and data management services. We’re powered by mind+machine – a unique...


Desde Evalueserve S.A. - Capital Federal

Publicado hace un mes

Psiquiatra

La Municipalidad de Tres de Febrero incorporará un/a Médico/a Psiquiatra para asesorar al equipo de la Junta Médica Municipal. Requisitos Mínimos: Perfil:...


Desde Municipalidad De Tres De Febrero - GBA Oeste

Publicado hace un mes

Business systems analyst ii

Buenos Aires, Buenos Aires Our Business Systems Analysists are responsible of Billing cycles, suporting Billing applications and being point of contact with...


Capital Federal

Publicado hace un mes

Chef de rang

Neuquén, Neuquén Lieu(x) de travail : Hilton Garden Inn Neuquen, Argentina Doctor Ramon, Esquina Avenida Neuquen 8300 Un chef de rang doit servir les...


Neuquén

Publicado hace un mes