Wells Fargo & Company
Lead Big (Java/Spark) Data Engineer
This job is now closed
Job Description
- Req#: R-354916
Lead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area
Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership
Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors
Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change
Strategically collaborate and consult with internal partners to resolve highly risky data engineering challenge
This role is required for Design and lead the Collections dataspace technical team. Lead engineer is for building and maintaining metadata-driven pipelines for ingesting, transforming, and mastering content metadata with the goal of providing clean and accurate metadata for various use-cases to support business objectives throughout the collection's organization.
The role requires expert knowledge of building scalable, fault-tolerant data processing pipelines using Spark, Kafka, Hive to ensure the reliable delivery of data to our stakeholders.
This role is important in ensuring the quality and expediency of our reporting in regard to content KPIs.
Lead the successful design and development of our Data Products and Operational Datastore around Collections Technology.
Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data environments (cloud, on-prem, hybrid)
Designing, building data pipelines, data migration experience is needed.
Performance tuning of Spark jobs, Java Memory tuning
Support data pipelines within SQL Server, Azure and Hadoop.
Help architect data solutions/frameworks around operational data store.
Collaborate with Product Managers, POs, Architects and Principal Engineers to design, implement, and deliver successful data solutions
Maintain detailed documentation of your work and changes to support data quality and data governance
Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers
Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team
Serve as an advanced resource to other Data Engineers on the team, and mentor and coach more junior members of the team helping to improve their skills, knowledge, and productivity.
7+ years of data engineering experience developing large data pipelines
10+ years SQL skills and ability to create queries to extract data and build performant datasets
5+ years hands-on experience with distributed systems such as CDP, Hadoop (HDFS, Hive, Spark, PySpark) to query and process data
7+ years of programming experience using Java/Scala, Python, or similar languages
2+ years experience with at least one major cloud services provider (AWS, Azure, GCP)
Nice to have in-depth experience developing applications in a Domain driven approach
Familiarity with Data Modeling techniques and ODS standard methodologies and practices
Good to have system migrations (application and data migration)
Good Scripting skills, including Python and Bash
Familiar with Scrum and Agile methodologies
You are a problem solver with strong attention to detail and excellent analytical and communication skills
About this role:
Wells Fargo is seeking a Lead Data Engineer in Technology as part of the Technology for the Chief Operating Office (TCOO) group. Learn more about the career areas and lines of business at wellsfargojobs.com.
In this role, you will:Job Summary
Responsibilities
Required QualificationsDesired Qualifications:
Salary Range: $115,900 to $206,100
Posting End Date:
24 May 2024*Job posting may come down early due to volume of applicants.
We Value Diversity
At Wells Fargo, we believe in diversity, equity and inclusion in the workplace; accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit’s risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in US: All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
Applicants with Disabilities
To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo .
Drug and Alcohol Policy
Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.
About the company
Wells Fargo & Company is an American multinational financial services company with corporate headquarters in San Francisco.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.