We are looking for a Data Architect/Data Engineer to design, develop, and manage data solutions that align with business needs and industry standards. The ideal candidate will have expertise in Java, SQL, Python, and Spark (PySpark & SparkSQL) while also being comfortable working with Microsoft Power Platform. Experience with Microsoft Purview is a plus.
The role requires strong communication skills to collaborate effectively with both technical and non-technical stakeholders. You will be responsible for data governance, data modelling, metadata management, and ensuring compliance with data standards.
Key Responsibilities:
1. Data Architecture & Engineering
- Design and implement scalable data architectures that align with business objectives.
- Work with Java, SQL, Python, PySpark, and SparkSQL to build robust data pipelines.
- Develop and maintain data models tailored to organizational needs.
- Reverse-engineer data models from existing live systems.
- Utilize Microsoft Power Platform for low-code data solutions.
2. Data Governance & Compliance
- Ensure adherence to data governance policies and regulatory requirements.
- Monitor and maintain compliance with data standards and security measures.
- Develop and manage metadata repositories for accurate data tracking and integration.
- Support data assurance processes and provide recommendations for compliance improvements.
3. Data Analysis & Communication
- Conduct data profiling and analyze source systems to derive insights.
- Translate business problems into data-driven designs and solutions.
- Create visual presentations and reports to communicate insights to stakeholders.
- Collaborate across multidisciplinary teams and advocate for data best practices.
4. Problem-Solving & Innovation
- Identify and address data-related issues using analytical and problem-management techniques.
- Explore innovative tools and methodologies for improving data processes.
- Support strategic planning by aligning data solutions with business goals.
- Analyze and mitigate the impact of data standard breaches.
Required Skills & Qualifications:
- Strong proficiency in Java, SQL, Python, SparkSQL, and PySpark.
- Experience with Microsoft Power Platform (PowerApps, Power Automate, etc.).
- Good understanding of data governance, metadata management, and compliance frameworks.
- Ability to communicate effectively with both technical and non-technical stakeholders.
- Experience in data modelling, data profiling, and source system analysis.
- Strong analytical and problem-solving skills with experience in problem management.
- Knowledge of data architecture principles and the ability to align them with business needs.
Nice to Have:
- Experience with Microsoft Purview for data governance and cataloging.
- Exposure to cloud platforms (Azure, AWS, or Google Cloud).
- Experience working in an Agile environment.
Why Join Us?
- Work on cutting-edge data technologies and contribute to innovative projects.
- Collaborate with a team of experienced professionals in a dynamic environment.
- Career growth opportunities with access to training and certifications.
- Competitive compensation and comprehensive benefits package