Data Engineer for Scalable Data Systems

Data Engineer for Scalable Data Systems

Data Engineer for Scalable Data Systems

Upwork

Upwork

Remoto

2 dias atrás

Nenhuma candidatura

Sobre

We are seeking an experienced data engineer to design and maintain scalable data systems. The role involves managing data flow from scraping and API ingestion to indexing and automation, ensuring data is clean, organized, and ready for AI models. Architect and manage MongoDB databases (schema design, indexing, aggregation pipelines) Build data ingestion pipelines using n8n and custom scripts (Node.js, Python) Develop API scrapers / connectors for social and brand data (Instagram, TikTok, YouTube, LinkedIn, etc.) Automate workflows for data syncing, deduplication, and enrichment Maintain data integrity, logging, and monitoring of ETL processes Collaborate with AI engineers and product team to surface clean datasets for training and dashboards