
Luccio Lee
Tecnologia / Internet
Serviços oferecidos
A Chemical Engineer with experience in Data engineering projects, who, for more than 3 years, develops and maintain data pipelines projects and tools with Python using Airflow and Docker in Cloud environments applications for a better data-driven decision making in business and has some API building experience in Golang.
Experiência
At PierCloud (from nov/23 to jul/24), i worked as an Data Engineer and did two main projects:
Project Dexter: Developed and implemented ELTL pipelines with Python from many cloud sources (GCP, Azure, AWS,…) with Airflow orchestrator in an ECS and EC2 envirorment. The orchestrator deployed EMR clusters to execute Python Scripts to read, load and enrich data with Spark
Project Auth: Developed and implemented an Authenticator API for services acess with Golang and Keycloak to manage keys.
Also migrated some legacy code.
At Selia Full Commerce (from may/23 to jan/24), i worked as an Data Engineer and did two main projects:
Project Integration: Developed and implemented ETL pipelines with Python to obtain data from many sources (API's like shopfy) to feed an datamart with Airflow as an orchestrator and AWS-Batch with python containers (ECS) for small jobs.
Project finance: Developed a tool to calculate customer charges in Python and SQL.
I also migrated many ETLs from Nifi to Python and maintained legacy projects
Educação
BSc – Chemical engineering @ University of São Paulo (2019)
Profissionais do mesmo Tecnologia / Internet setor que Luccio Lee
Profissionais de diferentes setores próximos São Paulo, São Paulo
Outros usuários que são chamados Luccio
Empregos próximos São Paulo, São Paulo
-
A Polígono Capital está procurando por um(a) Junior Analytics/Data Engineer para colaborar em equipes multifuncionais. · ...
São Paulohá 1 mês
-
Zurich Santander Insurance America busca um Engenheiro(a) de Dados Especialista para liderar tecnicamente a arquitetura da plataforma de dados. Principais responsabilidades incluem projetar pipelines escaláveis, garantir qualidade dos dados e atuar como referência técnica. · ...
São Paulohá 1 mês
-
A NEORIS ajuda empresas a se moverem para o futuro. · Desenvolver pipelines de dados; · Apoiar na ingestão de dados provenientes de APIs; · ...
Sao Paulo, Brazilhá 1 semana