Sobre

Tech lead - Data Engineer As part of the Data Engineer team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You will interact with the engineers, product managers, QA, BI developers and architects to provide scalable robust technical solutions.Responsabilidades y atribucionesDesign, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.Provides and supports the implementation and operations of the data pipelines and analytical solutionsExperience in REST API data service – Data ConsumptionExperience in managing work teamsAdvanced project managementRequisitos y calificaciones8 a 10 years in technology project implementationEnglish conversational (Advanced)Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development.Experience in agile modelsExperience with, Python, Java to write data pipelines and data processing layersExperience in Advance Pipelines with AirflowExperience Continuous Integration, DevOps, Github.Performance tuning experience of systems working with large data setsProven, working expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark.Highly Proficient in SQL.Experience with Cloud TechnologiesGCP – DataProc, Big Query, Cloud FuctionsAzure – ADLS, Data Factory.Experience with relational model, memory data stores desirable (Sql Server, Oracle, Cassandra, Druid)Knowledge in implementing advanced analytics models using ML/AI (Desirable)Knowledge of BI tools (Power BI, Tableau, Looker, etc.) DesirableRetail experience is a huge plus.