Data Engineer
Job description
Description:
Global Markets Technology division looking for Senior Data Engineer with strong Python programming skills to assist to analyze the datasets of Regulatory Transaction Reporting data across multiple jurisdictions and asset classes for OTC Derivatives and FX products. Experience in Dodd Frank regulatory transaction reporting for CFTC, EMIR, or MiFID II is a plus
Responsibilities:
The candidate should have a solid experience in designing, building, and maintaining scalable data pipelines and leverage Python to identify patterns, trends, and anomalies of data, and will be responsible for contributing to all phases of the SDLC including analysis, design, development, unit test, QA, UAT, and also tier-2 production support.
- Lead the design and implementation of scalable and reliable data pipelines to support regulatory reporting data analysis.
- Analyze large volumes of transactional and reference data to identify recurring data issues, patterns, trends, and anomalies.
- Build automated solutions for data cleansing, transformation, enrichment, and validation to reduce manual intervention in regulatory submissions.
- Work closely with compliance and reporting teams to ensure regulatory rules are correctly implemented across jurisdictions.
- Design frameworks to detect and proactively resolve data exceptions.
- Collaborate with engineering, architecture, and DevOps teams to optimize performance and ensure auditability and traceability.
- Drive best practices in data governance, metadata management, and lineage tracking.
- Out of hours support when needed.
- Promote quality engineering and good coding practices across the company.
Competencies:
- Structured & logical thinking.
- Problem solving.
- Results oriented.
- Independent, and self-motivated.
- Strong communication (written & verbal).
Skills we look for:
- 5+ years of experience in data engineering, with deep expertise in data architecture and pipeline development.
- Strong programming skills in Python (pandas, NumPy, PySpark) and experience with SQL-based data extraction and transformation.
- Proven experience with regulatory reporting data (e.g., EMIR, CFTC, SEC, MiFID II, SFTR, MAS, ASIC, etc.) and understanding of trade lifecycle and financial products.
- Experience with data pattern recognition, root-cause analysis, and rule-based data validation frameworks.
- Hands-on experience with big data platforms and technologies (e.g., Apache Spark, Hive, Kafka).
- Familiarity with data orchestration tools like Airflow, dbt, or equivalent.
- Knowledge of cloud platforms (AWS, GCP, or Azure) and regulatory data lake/warehouse strategies.
- The candidate should be a self-starter who enjoys programming, can work as part of a global team and who has successfully delivered significant enterprise-scale projects to end-users previously.
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related technical field.
* Experience working in financial services or capital markets environments is a plus
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian’s platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian’s brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.