Sobre

• About the Job

• Dadosfera, a leader in Data & AI Platform Solutions, is seeking exceptional talent in Data Engineering. We’re looking for someone who is passionate about data, thrives in an autonomous, high-learning environment, and enjoys working with cutting-edge technologies. As a Data Engineer, your mission will be to manage large volumes of data, creating solutions and generating insights for our clients.

• Responsibilities
• Design, develop, and maintain scalable, efficient, and robust data pipelines.
• Implement data ingestion, transformation, and quality processes, ensuring reliability and governance across deliveries.
• Build and optimize data architectures using cloud services, Kubernetes, and orchestration tools.
• Develop and maintain APIs, scripts, and integrations to ingest data from multiple sources (APIs, files, crawlers, connectors).
• Execute web scraping and crawler development, ensuring performance and integrity of collected data.
• Collaborate with product, analytics, data science, and engineering teams to enable end-to-end data solutions.
• Monitor performance of pipelines and implemented solutions, identifying bottlenecks and proposing continuous improvements.
• Support data architecture initiatives, technical standardization, and engineering best practices.
• Contribute to the development of data applications (data apps), including prototyping and optimization using Streamlit.
• Participate in strategic projects involving automations, integrations, and—when applicable—AI-enabled features.
• Minimum Qualifications
• Bachelor's degree in a STEM field or equivalent industry experience.
• Proficiency in building, maintaining, and optimizing data pipelines.
• Experience with SQL and Python development.
• Hands-on experience with Linux environments and cloud services.
• Familiarity with CDC ingestion tools (e.g., Debezium, DMS) and data orchestration tools (e.g., Airflow, NiFi).
• Practical experience with Kubernetes and Apache Spark.
• Ability to build, maintain, and consume APIs, as well as develop scripts and automations for data manipulation and integration from various sources (APIs, files, custom connectors).
• Experience with web scraping, crawlers, and web data extraction tools (e.g., Scrapy, Beautiful Soup).
• Strong organizational and prioritization skills in multi-demand environments.
• Experience developing data applications (data apps), especially with Streamlit.
• Preferred Qualifications
• Experience with LLM-based projects, including integration and consumption of AI models within data solutions.
• Experience in data platform or environment migration projects.
• Knowledge of MLOps and DataOps practices to support AI-driven applications.
• Experience with infrastructure-as-code tools such as Terraform or CloudFormation.
• Knowledge of relational and non-relational databases.
• Experience in tech startups or with BI tools (Power BI, Tableau, Metabase).
• Intermediate or advanced English.

• At Dadosfera, we celebrate diversity in all its forms and are committed to fostering an inclusive environment every day. We have zero tolerance for any form of discrimination. Do you share our values? Then don’t wait—apply today!