Senior Azure Data Architect - Rio de Janeiro, Brasil - Inclusion Cloud

Inclusion Cloud

Empresa verificada

Rio de Janeiro, Brasil

há 1 semana

Postado por:

Ana Silva

beBee Recruiter

Descrição

About the job Senior Azure Data Architect

Summary of Duties & Responsibilities
The Senior Azure Data Architect is expected to evangelize and educate others on engineering design and development standards.

Senior Azure Data Architect is expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers.

Essential Functions

Design and develop data pipelines.
Design and develop Azure ML model execution architecture.
Design and develop methods for handling 3rd party data for use within ML models.
Evangelize engineering design and development standards.
Participate in Agile ceremonies including daily standups, sprint planning, retrospectives, and product demonstrations.
Produce efficient and elegant code that meets business requirements
Author unit tests that adhere to code coverage guidelines.
Proactively communicate progress, issues, and risks to stakeholders.
Accurately estimate assignments.
Create and maintain technical documentation.
Mentor less experienced engineers.
Contribute to the growth and maturity of the Software Engineering Group.
Performs other related duties as directed.

Required Skills & Competencies

7 years of handson experience designing and implementing multitenant solutions using Azure Databricks for data governance, data pipelines for near realtime data warehouse, and machine learning solutions.
10 years of extensive, handson experience designing and implementing largescale multitenant distributed data architecture for BI and OLTP systems.
5 years of handson experience designing and developing multitenant solutions using Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow.
10 years of advanced handson experience designing and implementing largescale multitenant data pipeline (TB or PB in size) including Change Data Capture (CDC) solutions for structured, semistructured, and unstructured data in batch and realtime environments.
5 years of handson experience in Azure services including Azure SQL Database, Azure Databricks, Azure Analysis Services, Azure ML Services, and Azure Synapse Analytics.
5 years of handson experience with data integration using ETL / ELT tools (e.g., SSIS, Azure Data Factory, Airflow).
Advanced knowledge of Python, Object-Oriented Programming, and unit testing.
Expert in data modeling.
Broad experience in Microsoft SQL technologies including SSAS Tabular models, DAX, T-SQL, Service Broker, Replication, and Performance Tuning.
Broad multitenant data architecture and implementation experience across different data stores (e. g., Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage, HDFS), messaging systems (e. g., Azure Event Hubs, Apache Kafka), and data processing engines (e. g., Azure Data Lake Analytics, Apache Hadoop, Apache Spark, Apache Storm, Azure HDInsight).
Experience with Pandas and parallel processing. Experience with Ray is a plus.
Experience with data integration through APIs, Web Services, SOAP, and/or REST services.
Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence.
Additional programming experience is a plus including experience with NET, Scala, R, Java.
Must have demonstrated experience designing and implementing data pipelines for consumption by machine learning and BI solutions.
Knowledge of SOA and Micros Services Application Architecture.
Ability to work in a fastpaced, collaborative team environment.
Excellent written and verbal communication skills and ability to express ideas clearly and concisely.

Education or Prior Work Experience

Bachelor's degree in CS or related field, master's degree preferred.
10+ years of experience with designing and developing complex data architecture solutions.
5+ years of design and development experience with Microsoft Azure data architecture and related solutions (e.g., Azure Data Lake Gen2, Azure Data Factory, CDM, Event Hub, Azure Databricks, Synapse, Azure SQL DW).

Salary:
R$ R$20.00 per month