Data Engineering AWS

Job Offer Description

As a Spark, python ETL Data engineer, you will be instrumental in joining data from various sources to create a holistic view of the customer journey. This integrated data product will connect our back-end systems for equipment service activations to our front-end experiences on digital applications, helping minimize customer friction, reduce costs, and increase sales.

In this role you will play a key role in:

  • Developing robust ETL code running on cloud infrastructure that adheres to our CICD processes
  • Creating and maintaining Athena (Iceberg) tables that serve as the foundation for data export services
  • Building data consumption layers for Tableau reporting and other analytical tools
  • Collaborating with team leads to design and implement data integration solutions
  • Optimizing PySpark code for performance, scalability, and reliability

 

Your profile

  • 5+ years of experience in data engineering with a strong focus on ETL development
  • Proven expertise in PySpark and SQL for large-scale data processing
  • Extensive experience with AWS services including EKS, EMR, Lambda, Airflow, StepFunctions, S3, and Athena
  • Proficiency with GitLab for CICD pipelines and version control
  • Experience working with cloud-based data lakes and data warehousing concepts
  • Strong problem-solving skills and ability to work in a collaborative team environment

 

What you'll love about working here

  • Free access to learning platforms: Free access for all to world-class learning assets and curated programs from Harvard Business Review, Coursera, Pluralsight, Udemy, Microsoft, AWS, Google and many more.
  • Dedicated innovation labs: We help the world's largest innovators engineer the products and services of tomorrow by leveraging our experts and labs, dedicated to topics as 5G, 6G, AI, Autonomous Vehicles and Quantum.
  • Empowering environment: Autonomy and Goal setting are among the top scores with 8,4+ ratings in our monthly employee feedback Pulse.
Apply now
Choose the type of application
Capgemini Colombia S.A.S.

Durante más de 50 años, hemos sido un socio dedicado a organizaciones de todo el mundo, ayudándolas a transformar y gestionar sus negocios.

Un colectivo diverso de más de 325.000 expertos estratégicos y tecnológicos en más de 50 países, todos estamos impulsados por una pasión compartida: liberar la energía humana a través de la tecnología.

A medida que aprovechamos la nube, los datos, la IA, la conectividad, el software, la ingeniería digital y las plataformas para abordar toda la amplitud de las necesidades empresariales, esta pasión impulsa un poderoso compromiso. Desbloquear el verdadero valor de la tecnología para su negocio, nuestro planeta y la sociedad para un futuro más inclusivo y sostenible.

Show all >

Job offers similar to Data Engineering AWS

Job Offer summary

Data Engineering AWS

  • Colombia
  • Permanent
  • 2 to 10 years experience
  • University
  • A convenir
  • ingles (
    )
  • 0 (
    )

Create your ticjob.co HV

If you are not yet registered as a candidate, publish your HV, find the best offers in the ICT sector and let companies find you

Create your free account