Apply Now    

Data Engineer (Big Data and Metadata strategies)

Req #: 170094061
Location: Wilmington, DE, US
Job Category: Technology
Potential Referral Amount: 0 US Dollar (USD)
JP Morgan Chase is undertaking an aggressive digital transformation agenda within the Consumer and Community Bank (CCB) which serves over 50 million customers, and builds on the success of the our market leading mobile and online service offerings. JPMC is investing in innovative ways to deepen customer engagement and create the most compelling digital experience in the financial services industry. We are looking for talent that will help us position JPMC as the undisputed leader in digital financial services and payments, enabling JPMC to deliver highly personalized, real time experiences that wow our customers.
CCB is advancing towards a transformation where high velocity software engineering of business capabilities is paramount.   This strategy is being driven by the increasing use of digital platforms on the part of our customers as they bank with us and the evolution of financial products and services and their potential integration into digital banking ecosystems.  The growth of distributed data, event driven architecture and imperatives for actionable analytics will elevate the need for metadata that is engineered into our software delivery including tool chain, development frameworks, registries and platforms.  
In this role, the Metadata Engineer will play a hands-on, lead role for establishing a modern metadata strategy and driving implementation of those strategies and taxonomies into the capabilities, code and tool chain so data is understood, self-describing, locatable and usable from the start. 
Position Summary:
  • The Metadata Engineer will be responsible for assessing and defining a holistic, yet pragmatic metadata strategy and reference architecture for the new banking architecture (API, microservices, event-driven architecture) and big data catalog to ensure all data is self-describing, locatable, traceable and is right-fit to answers consumption questions (humans and machines).  Key areas include:
    • Document the current landscape of metadata management tools, standards, taxonomies and reference data being used across CCB – Channel/Operational data to Analytic Data. 
    • Document inventory of champion metadata across CCB so the role/purpose is understood
    • Prioritize and document MVP metadata for key assets:  APIs, events, microservices (private data), information flows, and data catalog across strategic operational and big data assets (lifecycle management compliance;  organized and ordered catalog)
    • Recommend use of registries and catalogs in support of Microservice, event driven architecture and big data, including aggregation and visualization
    • Recommend Integration with other Technology Data Management tooling and CCB Metadata Repository, as required
  • Research, evaluate and select champion tools and open source to meet detailed and higher level catalog (index) metadata for data stores and modern, highly distributed data ecosystems, including data lakes with both batch and real-time integration architectures.  
    • Ensure metadata is designed-in and traceable from the start
    • Ensure metadata can be located and is usable
    • Ensure metadata can be leveraged to support data quality
  • Establish data flow metadata standards and drive adoption of those standards across CCB
  • Establish reference implementations with the Chief Development Office, to integrate metadata capture at design and deploy time (CI/CD) to automate evergreen metadata. 
  • Define the pattern for contribution and enrichment of metadata, especially in the big data space.
  • Gather, research and establish key ontologies, semantics, and taxonomies to support consistency in describing ‘assets’ and improved operational and analytical consumption – transparency and to drive efficient and effective use of analytic insights
  • Collaborate on the Event Streaming as a Service with focus on standards around event structure metadata, naming, schema registration, topics/grouping, guidance and governance automation
  • Collaborate with the Lead Architects, Chief Information Architects, Chief Technology Officers and the Chief Data Office to understand metadata requirements as they transform their areas and product architectures as well as drive understanding and adoption
  • Assist in collection and cataloging of data engineering patterns and decision trees across CCB Sub-LOB and Domains for the New Banking Architecture (Microservice, Event Driven Architecture, Cloud Integration)
  • Roll up sleeves and develop as needed
  • Over 12 years of experience in data management and engineering
  • Expertise with meta data management and data lifecycle management
  • Expertise in engineering with distributed database technologies like Hadoop and Cassandra
  • Expertise with event driven architecture including event schemas and standards around technologies like Kafka
  • Expertise with microservices design and development, including API and cloud based platforms and technologies such as containers a plus
  • On-going information sharing and supporting the organization to ramp up and embrace the distributed database architecture
  • Ability to communicate with senior leaders in the organization.
  • Hands-on experience with Java, JSON, Avro, Cassandra, Kafka, Spark, Akka, Java, RDF/Taxonomies, Hadoop, BI/visualization, lambda architectures and technologies, cloud based microservices.
  • Experience implementing data pipelines in big data technologies such as Hadoop, Spark, AWS EMR, and Redshift a plus
  • Shows passion for hands-on work in the metadata and data engineering space.
Apply Now    

Join our Talent Community

Not ready to apply? Leave your information with us and we will keep you up to date with new career opportunities.

Things to note

Sign in to our application system to continue your job search or update your profile.

Current employees sign in here. Contractors sign in here.

Any information you provide is confidential and will only be viewed by our recruiters in an effort to fill open positions. In addition, the information you provide is subject to our privacy policy practices.

Please note that J.P. Morgan will not accept unsolicited approaches or speculative CVs, nor will J.P. Morgan be responsible for any related fees, from Third Party Firms who are not preferred suppliers.

The firm invites all interested and qualified candidates to apply for employment opportunities.

Need disability related assistance?

If you are a US or Canadian applicant with a disability who is unable to use our online tools to search and apply for jobs, please click here.

Important links

Click here to view the "EEO is the Law" poster.

Click here to view the "EEO is the Law" supplemental poster.

Click here to view our U.S. Pay Transparency Policy.

JPMorgan Chase is an equal opportunity and affirmative action employer Disability/Veteran.