Data Engineer

The Role : As a Data Engineer, you will play a crucial role in creating and managing the dataflows used by production machine learning models and data scientists. You will be responsible for collaborating with cross-functional teams, engineers, product managers and data scientists to understand requirements and deliver high-quality solutions. You will be expected to implement best practices in data management, coding, testing, and deployment, ensuring scalability, performance, and security. Strong problem-solving skills, excellent communication, and the ability to adapt to new challenges in a fast-paced environment is essential for this role.

Key Responsibilities

• Design, build, and maintain large-scale data pipelines to ingest, process, and transform complex financial data
• Develop data ingestion frameworks to handle high-volume and high-variety data feeds
• Implement data quality control measures to detect and handle data anomalies, duplicates, and inconsistencies
• Optimize data pipeline performance for scalability, reliability, and latency
• Collaborate with data scientists to integrate machine learning models into the data pipeline and ensure seamless data flow
• Develop and maintain model serving infrastructure to support real-time predictions and batch scoring
• Implement model monitoring and logging to track performance, data quality, and model drift
• Manage cloud-based infrastructure to support data pipeline and model serving workloads
• Troubleshoot data pipeline issues, data quality problems, and model performance degradation
• Collaborate with cross-functional teams, including data science, product, and engineering teams to ensure alignment and effective communication

Required Skills, Experience, and Qualifications

About us We are a diverse group of visionary innovators who provide trading and workflow automation software, high-value analytics, and strategic consulting to corporations, central banks, financial institutions, and governments. Founded in 1999, we have achieved tremendous growth by bringing together some of the best and most successful financial technology companies in the world.