Data Engineer
Job description
- 10+ years’ experience developing Spark or Spring Batch Services for Data movement.
- Schedule, Monitor and debug ETL Spring Batch and Spark Batch.
- Hands on Experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application.
- Develop, Test, Deploy and maintain ETL Batch Jobs using Spring Batch and Apache Spark/EMR Jobs.
- Utilizing Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte.
- Experience with cloud-based data warehousing and data lake solutions such as Snowflake
- Experience with data storage and data management for large datasets like parquet, HDF5, etc.
- Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS.
-
Data Engineering
-
Expert Level Scala
-
Some Java knowledge
-
Amazon EMR
-
Cassandra DB or any distributed database experience
-
Any streaming platform ideally with Kafka
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian’s platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian’s brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.