AI QA AGENT Lead
NT Careers
·Today
- Salary
- $134k – $227k/yr
- Location
- Chicago, IL, United States of America · Tempe, AZ
- Type
- Full-time
- Seniority
- Lead
- Visa
- Not sponsored
- Source
- Workday
Description
About Northern Trust
As a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families, corporations and institutions.
Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide.
With more than 135 years of financial experience and over 24,000 partners, we serve the world’s most sophisticated clients using leading technology and exceptional service.
1. Develop software, typically in Python, to independently acquire data from disparate sources (databases, files, APIs, etc.) and combine them into appropriate training, validation and testing datasets.
2. Analyze raw datasets using descriptive statistics, working directly with domain experts to understand the meaning of data fields
3. Have a deep understanding of Generative AI and LLMs, evaluation metrics and theory behind LLMs & conversational AI, since Gen AI will be a core part of many solutions being developed at the Bank.
4. Be able to explain the full pattern of Retrieval Augmented Generation (RAG) and make recommendations on which specifics technology and techniques to use when building solutions based on this pattern. In most cases the candidate will be developing and integrating Retrieval-Augmented Generation (RAG) systems on Azure cloud.
5. Leverage open-source AI software like TensorFlow, PyTorch, HuggingFace, LangChain, AutoGen, LangGraph and LamaIndex for the solution development and evaluation.
6. Evaluate various AI frameworks and services for efficacy and make recommendations on their inclusion as standardized tooling for AI development.
7. Integrate these tools and software with Azure services for a seamless development and deployment experience.
8. IAC and automation – leverage Terraform for automating cloud provisioning of resources and other infrastructure tasks.
9. Build unit tests, data quality checks and data pipelines to ensure that algorithms use trusted data.
10. Implement CI/CD pipelines using Azure DevOps, ML Ops, Github Actions, TerraForms for the automated deployment of AI solutions.
11. Utilize Azure Kubernetes Service (AKS) for managing and scaling containerized AI applications.
12. Regularly update and maintain the AI models, ensuring their relevance and effectiveness using Azure Monitory tools.
13. Enforce strict security measures and controls in Azure, including network security configurations and identity management, data encryption and privacy.
14. Comply with industry standards, best practices and regulations for AI solutions.
16. Work across multiple projects in a fluid environment where work is required across the full research lifecycle from forming a hypothesis, acquiring data, and developing ETL-style software to presenting findings.
16. Provide guidance to other software development teams as prototypes and frameworks are engineered for full production environments
Knowledge:
IAC and automation concepts with various tools
Full stack Azure application development
Security related concepts and controls, particularly in the cloud environment: virtual networks, subnets, private endpoints, authentication mechanisms, identities and role based access.
Data protection and encryption techniques and tooling such as key vaults, encryption keys, masking and concepts such as BYOK.
DevOps including CI/CD techniques and tools particularly Azure based and Github repos
Develop and maintain an understanding of many algorithms across supervised learning, unsupervised learning and time series analysis
Propose and develop machine learning ensemble methods that exhibit the best out-of-sample characteristics possible given the input dataset
Utilize expertise in machine learning algorithms to tune algorithms using available hyper-parameters and carefully select feature subsets
Discover biases or leakage in datasets and ensure that train/test splits reflect realistic expectations of real-world performance
Run large scale (either in parallel and/or distributed) training and inference jobs on private or public cloud infrastructure
Present findings to internal and external customers using both data science language (F1 scores, regression error, statistical significance, etc.) as well as business domain specific language gained from experience analyzing the data in scope.
Plan and execute data science training sessions and hackathons
Work with external parties (vendors, universities, etc.) to incorporate new techniques and tools into the data science lab.
Developing open-source software in a collaborative environment, desired but not required.
Experience:
A Bachelor’s degrees in Computer Science or related field required.
Languages in Python, Common Python libraries (NumPy , Pandas, Sklearn, etc.), Linux based operating systems, and basic development tools (Python IDEs, source control, etc.) required.
Tools in advanced distributed machine learning frameworks (e.g. Keras, TF, etc.), Azure cloud infrastructure is preferred.
Certifications in Azure Security, DevOps, and Azure AI Engineer Associate or equivalent are preferred, but not required.
Salary Range:
$133,500 - 226,900 USDSalary range is a good faith estimate of base pay. Northern Trust provides a comprehensive benefits package including retirement benefits (401k and pension), health and welfare benefits (medical, dental, vision, spending accounts and disability), paid time off, parental and caregiver leave, life & accident insurance, and other voluntary and well-being benefits. Northern Trust also provides a discretionary bonus program that may include an equity component.
Work Authorization
Applicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future. Northern Trust will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa).
Working with Us
As a Northern Trust partner, you will be part of a flexible and collaborative work culture, which has a strong history of financial strength and stability. Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to an inclusive workplace and assisting the communities we serve.
Philanthropy is deeply rooted in Northern Trust’s history and is an essential element of our culture. Employees around the world give their time and talent to work for the greater good of their communities.
Reasonable Accommodation
Northern Trust is committed to working with and providing adjustments to individuals with health conditions and disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at [email protected], or alternatively you can discuss your individual requirements with the recruiter you are working with.