Principal Data Engineer (Specialist I - Software Engineering)

You will play a pivotal role in leading and delivering complex data engineering solutions with a focus on data analysis, data modeling, and designing ETL processes. As a Principal Data Engineer, you will work with a variety of advanced tools, platforms, and techniques to ensure high-quality data solutions that support the business and its goals.

Key Responsibilities:

• Data Engineering & Architecture:
  • Design and implement scalable data models and ETL processes to support the company's analytics and reporting needs.
  • Work with Data Mesh architecture principles and Data Products to ensure effective data sharing and governance across the organization.
  • Lead the development of end-to-end data solutions using Azure Synapse, Azure SQL Database, SSAS, Power Query/DAX, Microsoft Fabric, and Power BI.
  • Develop data solutions in Azure, leveraging Data Lakes, Data Warehouses, and Azure Data Factory to deliver robust data pipelines.
• Technical Expertise:
  • Expert in T-SQL, with strong performance tuning skills for handling large volumes of data.
  • Design and implement solutions using Snowflake and open-source frameworks, while ensuring multi-cloud infrastructure support.
  • Proficiency in understanding and applying enterprise big data architecture concepts.
  • Experience in implementing Power Platform solutions (Power Automate, Power Apps) is a plus.
• Security & Data Governance:
  • Design and implement security models within the data estate to ensure compliance and protect sensitive information.
  • Maintain and promote high standards of Data Quality, adopting approaches such as shift-left strategies to ensure data integrity from the beginning of the development lifecycle.
• Collaboration & Leadership:
  • Collaborate with cross-functional teams to gather requirements and translate them into efficient data engineering solutions.
  • Lead the full Software Development Lifecycle (SDLC), including the use of Azure DevOps, GitHub for continuous integration and deployment, and Visual Studio (SSDT).
  • Provide mentorship and guidance to junior team members, fostering a culture of knowledge sharing and skill development.
• Business & Financial Services Knowledge:
  • Bring a strong understanding of the financial investment services domain to design and implement data solutions aligned with business needs.
  • Experience working in the financial industry is highly beneficial.
• Agile Practices:
  • Work in an Agile environment, ensuring timely and high-quality delivery of data solutions that meet business requirements.

Qualifications:

• Proven experience as a Data Engineer or in a similar role, with experience in data engineering and analytics.
• Expertise in T-SQL, performance tuning, and working with large data volumes.
• Strong knowledge of Azure Synapse, Azure SQL Database, SSAS, Power BI, Power Query/DAX, and Microsoft Fabric.
• Experience in Data Lakes, Data Warehouses, and Azure Data Factory.
• Familiarity with Snowflake, open-source frameworks, and multi-cloud infrastructure.
• Experience with Power Platform (Power Automate, Power Apps) is a plus.
• Solid understanding of Data Mesh, Data Products, and enterprise big data architectures.
• Experience with SDLC, Azure DevOps, GitHub, and Visual Studio (SSDT).
• Strong business acumen, particularly in the financial investment services industry.
• Experience in Agile methodologies.
• Excellent attention to detail, with the ability to balance the bigger picture and strategic vision.
• Strong communication skills, able to engage with non-technical and senior stakeholders effectively.
• Ability to adapt to changing environments and proactively contribute to team growth and knowledge sharing.

Skills:

• Data Modeling & ETL Development
• Performance Tuning in T-SQL
• Azure Ecosystem (Azure Synapse, SQL Database, Power BI)
• Data Mesh & Data Products
• Snowflake & Open Source Frameworks
• Data Security & Governance
• Power Platform (Power Automate, Power Apps)
• Agile Methodologies
• SDLC & DevOps Tools (Azure DevOps, GitHub, Visual Studio)

Personality Traits:

• Personable, credible, and able to build strong relationships with both technical and non-technical stakeholders.
• Strong leadership and mentorship abilities, with a passion for helping others grow and succeed.
• Open-minded, proactive, and eager to contribute to a collaborative team environment.
• Excellent problem-solving skills with the ability to think strategically while focusing on execution.

Microsoft Azure,adf,sql