Data Engineer
Job description
1 DAY ONSITE PER WEEK IN COLUMBIA, MD – CANDIDATE MUST BE LOCAL
Job Title: Data Engineer
Reports To: Senior Data Engineer Technical Lead
Location: Columbia, MD (onsite 1 day/week)
Essential Duties & Responsibilities
- Design, build and maintain large, complex data‑processing pipelines to meet business requirements
- Develop automated quality controls; perform unit, integration and user‑acceptance testing
- Create scalable, reusable frameworks for ingestion and transformation of large data sets
- Troubleshoot pipeline issues and perform root‑cause analysis
- Collaborate with source‑system and business owners to incorporate requirements into data pipelines
- Document data workflows, processes and infrastructure comprehensively
Required Skills & Experience
- Advanced programming in PySpark, Python and Spark SQL
- Deep understanding of Data Lake architecture (raw, enriched and curated layers) and ETL in Azure
- Proven experience building complex data pipelines for lakehouse/data‑warehouse environments using Agile methods
- Hands‑on architecture, design and implementation experience with Databricks and Azure Data Factory
Education & Background
- Bachelor’s degree (4‑year college)
- Minimum 4 years’ experience in data integration
- At least 2 years of advanced PySpark programming
- Databricks experience preferred
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian’s platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian’s brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.