Data Specialist

We are seeking a highly skilled Data Specialist to join our CDS Team. This role is critical for developing and maintaining efficient and scalable data pipelines using our in-house developed data framework, built and maintained in Python. The ideal candidate will have a deep understanding of data pipeline development, proficiency in Source Control, T-SQL, Python, and excellent documentation skills.

Key Responsibilities:

• Data Pipeline Development:
  • Develop and maintain data pipelines using our in-house developed data framework, leveraging technologies such as Azure Synapse, Blob Storage, and Redis.
  • Write efficient, scalable, and maintainable code for data processing and integration.
• Technical Expertise:
  • Demonstrate proficiency in Source Control and T-SQL.
  • Utilize Python to create and manage data pipelines, ensuring high performance and reliability.
• Collaboration and Integration:
  • Work collaboratively with cross-functional teams to integrate data pipelines seamlessly into existing systems.
  • Troubleshoot and resolve issues related to data pipelines, ensuring minimal disruption to operations.
• Documentation:
  • Create and maintain comprehensive technical documentation for all data pipelines and processes.
  • Ensure that documentation is up-to-date and accurately reflects the current state of the data pipelines.
• Problem-Solving:
  • Apply excellent problem-solving skills to identify and address issues in data pipelines.
  • Pay close attention to detail to ensure data accuracy and integrity.

Qualifications:

• Experience:
  • At least 3 years of experience in data engineering or a related field.
  • Proven expertise in Source Control, T-SQL, Python, and data pipeline development and management.
• Education:
  • Bachelor’s degree in Computer Science, Data Science, or a related field.
• Skills:
  • Deep understanding of data warehousing, ETL processes, and big data technologies.
  • Experience with Azure Architecture, including Synapse, Blob Storage, and Redis.
  • Excellent problem-solving skills and attention to detail.
  • Ability to work collaboratively with cross-functional teams.

Additional Information:

• Role Suitability: This role is not suitable for full-stack or frontend developers. We are looking for a highly specialized data specialist who is passionate about creating efficient and scalable data pipelines.
• What You Will Be Doing:
  • Developing and maintaining data pipelines.
  • Writing efficient, scalable, and maintainable code.
  • Collaborating with cross-functional teams.
  • Troubleshooting and resolving issues.
  • Creating and maintaining technical documentation.

If you have the required skills and experience, we would love to hear from you. Join us to make a significant impact on our data infrastructure and contribute to our continued success.