• Job Description

  Req#: 90669

  Eligible for remote, hybrid or onsite status .

  The Sr. Data Engineer will support the underlying data needs for the data governance platform, provide auxiliary support for the sftp platform as well as additional support for the overall data management data platform.

  Will lead and mentor core Data Engineers to identify, design, test, and develop data load processes and data warehouse architecture solutions that support the organizations business needs. Maintain and support systems raw data, metadata and other data assets. Create and implement various data load processes used in populating various Databases (relational/dimensional) and Data Warehouses. Ultimately, transforming data into a variety of formats that is easily analyzed and utilized throughout the organization.

  • Mentor and train junior data engineers.
  • Identify, design, develop, test, and implement internal data load processes and data structures.
  • Design, create and populate architecture to support our business intelligence developers, data architects, data analysts and data scientists on data initiatives while we ensure optimal data delivery consistency throughout ongoing projects.
  • Improve data models that feed business intelligence tools and users transforming data into a format that can be easily analyzed by data professionals (Data analysts, BI developers, data scientists).
  • Troubleshoot failures during data load process and identify / correct potential data or data load issues.
  • Create and maintain an optimal data pipeline architecture.
  • Coordinate with MaineHealth data professionals to create and augment unique data infrastructure.
  • Proactively identify, design and implementing internal process improvements including re-designing infrastructure for extensibility, optimizing data delivery, and automating manual processes.
  • Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using SQL technologies.
  • Work with stakeholders including build analysts, data analysts, business intelligence professionals, and executive teams to assist them with data-related technical issues.
  • Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
  • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
  • Designs and evaluates open source and vendor tools for data lineage.

  Required Minimum Knowledge, Skills, and Abilities (KSAs)

  1. Education : A Bachelor’s degree in information systems, informatics, statistics, computer science or another quantitative field (equivalent work experience (4+ years)).
  2. License/Certifications : N/A
  3. Experience : 4+ years of professional experience in data pipeline management
  4. Demonstrated ability to effectively convey and articulate complex concepts and ideas to both technical and nontechnical staff.
  5. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
  6. Experience with a major data pipeline tool/platform (examples could include: Informatica PowerCenter, SSIS, Talend, Pentaho, etc)
  7. Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  8. Experience with schema design and dimensional data modeling (Kimball preferred)
  9. Strong analytic skills related to working with unstructured datasets.
  10. Ability to troubleshoot and optimize ETL jobs (i.e. leveraging temporary tables, reviewing opportunities for partitioning, indexing, and considering incremental loads or splitting complex jobs into multiple jobs).
  11. Ability to find opportunities to reduce development times by incorporating reusable code
  12. Ability to automate data processes and implement error tracking.
  13. Experience with or knowledge of Agile Software Development methodologies

• About the company

  Maine Medical Center is a 637 licensed-bed teaching hospital for Tufts University School of Medicine, and previously Robert Larner College of Medicine, located at 22 Bramhall Street in Portland, Maine, United States, with a staff of over 6,000.

Notice