Sr. Data Engineer

Position Overview

Location: Fort Worth (onsite for 3 days in a week). This role is a 6+ Months contract with the possibility to convert to full-time employment.
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To learn more, please visit www.ustechsolutions.com.
US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.
For further details, please contact our recruiter Cindy Won at cindyw@ustechsolutionsinc.com (Internal Id: 26-02220).

Key Responsibilities

• Provide product technical leadership for teams to both analyze and take charge of long-term opportunities, designing a cutting-edge data solution and helping with core development when needed.
• Act as Product Technical Lead and subject matter expert for the data domain within the IT organization, working with business to author self-service data products.
• Collaborate with leaders, business analysts, project managers, IT architects, technical leads, and other developers, along with internal customers and cross-functional teams to implement data strategy.
• Design and build data engineering pipeline frameworks ensuring they are reusable, scalable, efficient, maintainable, gracefully recover from failures, and facilitate easy data reprocessing.
• Drive data quality, best practices, coding standards, and Test Driven Development while identifying a single source of truth for data across systems and implementing quality analytics.

Required Qualifications

• Apache Spark, Scala, Azure Databricks 10+
• Data-Principal Engineer / 7-9yrs Experience
• 9+ years of full Software Development Life Cycle (SDLC) experience designing, developing, and implementing large-scale applications in data analytics, warehousing, and data engineering.
• Working experience in data analytics including data wrangling, mining, integration, analysis, visualization, data modeling, and reporting.
• Should have at least 5 years of experience in optimizing Spark jobs for performance and cost-efficiency using techniques such as partitioning, caching, cluster configuration tuning, and troubleshooting bottlenecks.
• Education: Bachelor's degree.

Preferred Qualifications

• SQL 5+ and CICD 5+