Tech Stack

Description

As a Senior Data Engineer at Nearform, you will design, build, and maintain scalable data platforms, pipelines, and warehouses using SQL, Python, Spark, and other technologies. You'll collaborate with cross-functional teams to translate complex business requirements into efficient data solutions that drive business intelligence and analytics.

Requirements

• At least 6 years of commercial experience in data engineering
• Extensive hands-on experience with SQL, Python, and Spark for large-scale data processing
• Strong expertise in data warehousing technologies (e.g., Snowflake, Redshift, BigQuery)
• Experience with cloud-based data solutions (AWS, Azure, GCP) and data lake architectures
• Experience with automation, CI/CD for data pipelines, and Infrastructure as Code (IaC)

Responsibilities

• Design, build, and optimize data pipelines and ETL processes for large-scale data ingestion and transformation
• Develop and maintain data platforms and warehousing solutions to support analytics and business intelligence
• Implement scalable data storage solutions ensuring high availability and performance
• Enhance performance in data processing workflows for maximum speed and scalability
• Collaborate with data scientists and stakeholders to translate business needs into data engineering solutions