Duties and Responsibilities:

Work with leaders, engineering, and data scientists to understand data needs.
Design, build and launch efficient and reliable data pipelines to best utilize connected vehicle data for real-time systems and within data warehouses.
Educate your partners: Use your data and analytics experience to 'see what's missing', identifying and addressing gaps in their existing logging and processes.
Help ensure that best practices are followed when storing, retrieving and accessing data.
Work with entire data life cycle including data integration, warehousing, dimensional models, in-memory architectures, data management, transformations, feature extraction and maintenance.
Technical Skills required :

Experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)
Experience with Data Modeling.
Hands on experience in AWS/ Azure data lake, data ingestion, processing and scheduling.
Kafka data processing and publication and vector processing experience.
Experience in SQL.
Experience in Spark/ clickhouse.
Experience in Python.
Experience in custom ETL design, implementation, and maintenance.
Hands on experience with Data Lake, and Data maintenance using Big data architecture.