Tech Stack

Description

As a Senior Data Engineer at tvScientific, you will implement robust data infrastructure in AWS using Spark with Scala, evolve core data pipelines for massive growth, and collaborate with cross-functional teams to design data solutions that meet business needs.

Requirements

• Production data engineering experience
• Proficiency in Spark and Scala
• Familiarity with data lakes, cloud warehouses, and storage formats
• Strong proficiency in AWS services
• Expertise in SQL for data manipulation and extraction

Responsibilities

• Implement robust data infrastructure in AWS, using Spark with Scala
• Evolve core data pipelines to efficiently scale for massive growth
• Store data in optimal engines and formats
• Build fault-tolerant batch and streaming pipelines
• Leverage and optimize AWS resources while designing for scale