City of Ottawa

Data Engineer


PayCompetitive
LocationOttawa/Ontario
Employment typeFull-Time

This job is now closed

  • Job Description

      Req#: 7981

      Competition Number: 7981

      Applications will be accepted until the position is filled.

      Posting Details:

      This posting is for two (2) permanent positions available. All civilian competitions include the possibility of extension and/or additional temporary or permanent positions.

      All applications must be received on time and through our online application system. Applicants are required to upload their cover letter and resume in addition to the candidate profile. The cover letter should clearly outline your qualifications for this position.

      More Information and templates for the Civilian Competition Process can be found on the WIKI, Civilian Competition Process, Candidate's Tool Kit.

      Job Information

      Directorate: Information and Technology Services Section: Data Analytics
      Pay Group: Eight (8) - Under Review Job Code: 10142951
      Work Location: Fairmont – 19 Fairmont Avenue
      Supervisor’s Title: Manager Data Analytics
      Effective Date: May 1, 2023

      Overall Purpose

      As a member of the Analytics Enablement Team, the Data Engineer reports to the Manager of Data Analytics is an integral part of developing data-driven solutions that improve operational decision-making, enhance community safety, foster transparency, and build trust. The position is responsible for:

      • Designing, building, and maintaining data infrastructure that supports the efficient extraction, transformation, and loading (ETL) of data from various sources.
      • Serves as a subject matter expert in data management, integration, and processing and facilitates the creation of reliable and scalable data platforms that support informed decision-making.
      • Collaborates with cross-functional teams to enable Ottawa Police Service members and the community with access to accurate, reliable, and timely data.

      Major Responsibilities

      Designing, building, and maintaining data infrastructure that supports the efficient extraction, transformation, and loading (ETL) of data from various sources.

      • Develops ways to increase the usability of data through changes in business process and/or data cleansing techniques
      • Design, build, and maintain data pipelines and ETL processes using tools such as Streamsets, Apache Spark, Hadoop, and other big data technologies.
      • Develop and maintain data infrastructure including data warehouses and other data storage solutions to support business intelligence and reporting needs
      • Design and implement data security measures to protect sensitive data.
      • Develop and maintain data quality control processes to ensure the accuracy, reliability, and accessibility of data to all stakeholders.
      • Monitors system performance of scheduled ETL batches, and streaming data process and ensures all systems are working at an acceptable standard and that data pipelines are scalable, repeatable, and secure.
      • Performs data migration between development, UAT, and production systems, and plans and coordinates these data migrations.
      • Analyzes and troubleshoots technical issues quickly to resolution, working with internal ITS sections and software vendors, when required.

      Major Responsibilities (continued)

      Serves as a subject matter expert in data management, integration, and processing and facilitates the creation of reliable and scalable data platforms that support informed decision-making.

      • Supports the translation of business requirements for data acquisition/manipulation and provides detailed specifications to end users
      • Proactively identify analytical opportunities and provide recommendations that improve all elements of the data analysis process and increase analytical capacity throughout the organization.
      • Creates documentation of data engineering activities and data dictionaries to support end-users of data systems.
      • Maintains knowledge of current trends and best practices respecting data engineering, data science, and data privacy regulations.

      Major Responsibilities (continued)

      Collaborates with cross-functional teams to enable Ottawa Police Service members and the community with access to accurate, reliable, and timely data.

      • Work with data analysts and data scientists to ensure that data is properly structured and available for analysis.
      • Collaborate with stakeholders across the police service to design and implement race data collection strategies.
      • Proactively establishes partnerships, identifies opportunities, and makes recommendations that increase analytical capacity throughout the organization and with our community.
      • Provides supervision, guidance, and training to analysts, researchers, and others in the organization on data analytics.

      Statement of Required Qualifications

      Education

      • Completion of a four (4) year university degree in Information Technology, Computer Science, Computer Engineering, or a related discipline.
      • Experience and formal training combined may substitute for stipulated education requirements.


      Experience
      Five (5) years’ work experience in a Data Analytics environment with progressively more technical responsibilities in an engineering role, including:

      • Working with cloud computing platforms such as Azure and being familiar with setting up and managing cloud-based data storage and computing environments.
      • Working with stream processing frameworks such as Apache Kafka or Streamsets
      • Designing and implementing:
      • Real-time data processing pipelines using these tools.
      • Database solutions using technologies such as MySQL, PostgreSQL or SQL Server.

      Designing and creating:

      • ETL processes, data pipelines and workflows.
      • Logical and physical data models using data modelling best practices.
      • Designing, building, and supporting data warehouses, data hubs and other data storage and processing systems.
      • Project implementation analysis and support in data management systems, data integrity and security as it relates to environmental business systems.
      • Develop scripts, applications and APISs to automate data processing tasks using programming languages such as SQL, Python, Java, Scala, shell scripting, JavaScript
      • Machine Learning concepts and tools (R, Python, Jupyter Notebook).
      • Utilization of tools such as Apache Spark, Hadoop, and other big data technologies.

      Language

      • English – fluency in oral, reading, and writing.

      Certifications and Licences

      N / A

      In service Training

      The following mandatory training and education is provided to all civilian employees of the OPS:

      • Occupational Health & Safety.
      • Respectful Workplace.
      • Harassment & Violence in the Workplace.
      • Accessibility for Ontarians with Disabilities Act (AODA).
      • Equity, Diversity & Inclusion (EDI).

      Job Knowledge

      General knowledge of the Organization’s Mission, Vision, and Values.
      Understanding of data security and privacy regulations to support implementation of appropriate security measures to protect data.
      Knowledge and experience of data analytics development lifecycles/methodologies. such as Agile or other rapid application development methods.

      Advanced knowledge, skills, and proficiency in:

      • Data warehousing and data modeling principles and practices.
      • Documenting data pipelines processes, data models and data dictionaries.
      • Designing, building, and supporting data warehouses, data hubs and other data storage and processing systems.
      • Windows and Linux operating systems and their commands, on prem and cloud environments.
      • Query development in SQL.
      • Programming languages, such as Python, Java, Scala, shell scripting, JavaScript.
      • Machine learning concepts and tools (R, Python, Jupyter Notebook).
      • Virtual platforms, MS Office Suite, including the use of virtual platforms for conducting meetings and/or presentations.

      Strong political acuity to make recommendations to leadership, build consensus amongst stakeholders and provide appropriate recommendations to resolve conflict.
      Strong knowledge of data and statistical methods, tools, and operationalizing analytic models

      OPS Competencies

      Competency Level Competency Level
      Communication 3 Leadership 1
      Teamwork 2 Planning & Organizing 2
      Adaptability 2 Resource & Fiscal Managmentt 2
      Service Orientation 2 Organizational & Envuronmental Awareness 1
      Network & Relationship Building 3 Strategic Thinking 1
      Problem So;ving 3

      Hours of Work

      Monday to Friday day shift schedule

      Effort and Working Conditions

      • Works independently and as a team, under the general direction of the Manager.
      • Work is performed in accordance with the Ontario Human Rights Code, Anti-Racism Act, Occupational Health and Safety Act, Employment Standards Act, Accessibility for Ontarians with Disabilities Act, Youth Criminal Justice Act, Police Services Act and Municipal Freedom of Information and Protection of Privacy Act.
      • Utilizes advanced analytical skills to research, plan and resolve technical problems associated with capturing data, using integrated computerized databases and police systems.
      • Organizes own assignments to ensure tasks are completed in a timely manner while performing daily activities.

      Desired Qualifications

      • Oral, reading, and writing fluency in French or other languages.
      • Experience working on projects in a large health or public safety organization is preferred.
      • Experience with Power BI desktop, mobile and service offerings, or other similar business intelligence tools.
      • Experience with geospatial analysis using the ArcGIS platform.

      Additional Competition Information:

      We thank all candidates for their interest, however, only those selected to continue in the selection process will be contacted.

      Please save a copy of the job poster. Once the closing date has passed, it will no longer be available.

      The Ottawa Police Service promotes the principles of diversity and inclusion. We provide accommodation during all parts of the hiring process as required. Applicants need to make their needs known if contacted to proceed to the selection process. Accessible formats and communication supports are available upon request.

      Additional information about our hiring process can be found on the recruiting website.

      Please direct any questions to CivilianStaffing@ottawapolice.ca.

  • About the company

      Compte français disponible à : https://www.facebook.com/villedottawa Social Media Protocol The City welcomes feedback and ideas from its followers and fans. All comments and replies will be monitored, and any emerging themes or helpful suggestio...