Data Engineer II (IT@JH Office of the Deputy CIO)
Johns Hopkins University10 months ago
Baltimore, MD, United States
On-site
Full-time
Junior Level (1-3 years)
Job Description
Position Overview
IT@JH Office of Deputy CIO is seeking a Data Engineer II responsible for the data architecture and integration of university processes, systems, and data to improve reporting and analytics across functions, offices, and schools. The role includes the architecture, design, and implementation of infrastructure and operations for the University Data Warehouse (UDW), a complementary Lakehouse, and other modern data technologies.
Key Responsibilities
- Contribute to the design, production, and maintenance of data pipelines for data acquisition, management, transformation, and back-end code development to power data web applications and convert raw data into usable information.
- Write and maintain ETL/ELTs that operate on a variety of structured and unstructured sources.
- Develop and maintain web data scraping systems for automatic data acquisition.
- Help design data architecture and provide ongoing support.
- Input/output data from databases and perform queries.
- Create scripts to clean, transform, and analyze data.
- Put data pipelines into production using data warehousing systems.
- Create and implement production software to monitor data quality and detect data anomalies.
- Perform daily manual data quality assurance tasks.
- Support, maintain, and troubleshoot the software infrastructure.
- Source data, conduct analyses, visualize data, and generate insights to support ongoing research projects and other requests across the organization.
- Collaborate with developers, analysts, data scientists, researchers, policy experts, and other partners.
- Communicate with Division leadership, and others on the team.
- Collaborate with external partners, contractors, and vendors.
- Other duties as assigned.
Required Qualifications
- Bachelor's Degree.
- Five years of related work experience focused within database management, design, and business requirement gathering.
- Additional education may substitute for required experience and additional related experience may substitute for required education beyond a high school diploma/graduation equivalent, to the extent permitted by the JHU equivalency formula.
Preferred Qualifications
- Five years of progressive responsibility for data architecture in a complex environment, with extensive experience in relational, analytic, and other primary data and BI development approaches.
- Implementation and support experience with large-scale real-time and batch ETL/ELT for data ingestion and integration.
- Experience in dimensional modeling, student systems and information, APIs, advanced SQL, Power BI, Fabric, Azure, and pipelines.
Required Skills
Data Transformation
SQL
Python
Infrastructure Implementation
Azure
Lakehouse
Data Warehousing
Web Scraping
Data Architecture
Power BI
Data Pipelines
ETL/ELT