Job Purpose

The Senior AI Engineer is an individual contributor who defines technical direction while driving the quality, scalability, and reliability of next-generation AI-powered systems. This role operates at the intersection of research, software engineering, and advanced testing, transforming cutting-edge ideas into robust, production-ready platforms.

This is a senior individual contributor leadership role: the Senior AI Engineer operates as a force multiplier, shaping architecture and core platforms and frameworks, guiding teams, and also pioneering and designing research projects that are evaluated, presented, and then delivered at enterprise scale with high confidence.

About RWS

RWS is a global AI solutions company empowering the world’s most trusted enterprise AI.

Our proprietary Cultural Intelligence Layer, powered by 250,000 data specialists, cultural and language experts and deep domain professionals, backed by 45+ patents, makes enterprise AI culturally fluent, contextually accurate and secure, ensuring every interaction reflects a brand’s tone, context and customer values.

Through our Generate, Transform and Protect segments, we deliver intelligent content, enterprise knowledge, large-scale localization and IP protection for global growth. Trusted by 80+ of the world’s top 100 brands, RWS provides the confidence, governance and expertise organizations need to deploy AI safely, responsibly and at scale.

Headquartered in the UK, RWS is listed on AIM (RWS.L).

More information: rws.com.

About AI Platforms and Excellence

The AI Platforms and Excellence team aims to accelerate the development of external-facing, product-ready AI capabilities that materially differentiate RWS offerings, improve customer outcomes, and drive revenue growth across the business.

The team provides a centralized, execution-focused capability that productizes AI at scale. It delivers reusable platforms, proven patterns, and clear guardrails so product teams can rapidly ship secure, high-quality, and commercially relevant AI features, consistently and sustainably.

With a global reach, RWS provides technology and services to over 7500 end users worldwide. Our core functions encompass Enterprise & Technical Architecture, Network & Voice, Infrastructure, Service Delivery, Service Operations, Data & Analytics, Security & Quality Compliance, Transformation, Application Development, and Enterprise Platforms.

Job Overview

Key Responsibilities

Architecture and technical strategy

Contribute to the design and architecture of core platform components and evaluation systems, making the load-bearing technical decisions and bearing accountability for their reliability, scalability, and long-term maintainability.
Help set the technical direction for how AI capabilities are built, evaluated, and deployed across the company, and define a coherent platform vision that scales beyond your immediate team.
Design reusable abstractions, SDKs, and services for model integration, prompt management, experimentation, and deployment that establish organization-wide patterns and reduce duplicated effort.

Research and delivery excellence

Help define the evaluation strategy and methodology for AI capabilities across the company – automated metrics, human-in-the-loop workflows, test set management, and benchmarking – and establish the quality standards other teams build against.
Build evaluation frameworks and developer tooling robust enough for production yet simple enough for non-specialist developers to adopt.
Establish observability standards for AI systems – quality, performance, cost, and regression signals – and build dashboards and reporting that turn those signals into actionable decisions.
Drive engineering rigor in delivery through testing discipline, reproducibility, sound experimental design, and statistically defensible measurement of model quality.

Technical leadership

Provide technical leadership on the team's most ambiguous and highest-impact problems, scoping and sequencing work where direction is limited.
Mentor engineers and raise engineering standards through code review, design review, and leading by example.
Contribute to model and system governance practices including documentation (model cards, system cards), dataset and test-set versioning, reproducibility, and responsible-AI checks embedded directly into the platform.
Act as a technical multiplier – codifying best practices into tooling and standards adopted by hundreds of developers.

Innovation and technology adoption

Track developments in LLMs, evaluation research, and AI tooling, and translate them into pragmatic, well-scoped improvements to the platform.
Prototype and de-risk emerging techniques and tools, shepherding the promising ones from experiment to supported capability.
Champion the adoption of new platform capabilities across teams, lowering the barrier for developers to use them well.
Keep the platform current and competitive without chasing novelty for its own sake.

Cross-functional collaboration and stakeholder leadership

Partner with research, product, and localization leaders to align evaluation methodology with real-world quality and customer needs.
Influence roadmap and technical strategy beyond your immediate team, building consensus across engineering and product stakeholders.
Gather requirements from developers across the company and represent their needs in platform direction, acting as a trusted technical partner.
Communicate technical direction, trade-offs, and quality standards clearly to both technical and non-technical audiences.

Skills & Experience

Required

Significant software engineering experience (typically 5+ years) building and operating production systems, tools, libraries, or services that many other engineers depend on, with excellent API design, reliability, and developer experience. Also, a track record with CI/CD and cloud infrastructure.
Proficiency in Python and/or another general-purpose language, with strong testing discipline
Hands-on experience building with LLMs or other ML systems (prompt engineering, fine-tuning, retrieval, model integration), with an understanding of their failure modes and tradeoffs.
Proven experience designing and leading evaluation for AI/ML systems: defining metrics and methodology, building evaluation pipelines, managing test sets, and reasoning rigorously about model quality and regressions.
Strong command of evaluation concepts — various types of metrics (accuracy, precision, recall, F1), the distinction and tradeoffs between automated and human evaluation, statistical significance, and the limits of each approach.
Excellent written and verbal communication, and a history of influencing technical direction across teams and mentoring other engineers.
Comfort with ambiguity and the judgment to scope, prioritize, and sequence high-impact work with limited direction.

Preferred

Deep experience evaluating NLP, machine translation, or content-generation systems, including metrics such as COMET, chrF++, BLEU, MetricX, and MQM-style human evaluation.
Experience with experimentation and observability tooling, data/test-set versioning, and rigorous benchmarking workflows.
Established practice in AI governance and documentation - model cards, system cards, reproducibility, and responsible-AI considerations - at an organizational level.
Broad familiarity with the modern LLM ecosystem (open and proprietary models, orchestration frameworks, vector stores) and well-formed views on the tradeoffs.
Experience supporting multilingual or localization-focused products at enterprise scale.

For all applicants in Poland and accordance with applicable pay transparency legislation, candidates will be informed of the salary range for this position prior to interview. Pay is determined without reference to previous salary history and is aligned to objective job‑related criteria.

Life at RWS

Life at RWS - If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood, then you’ll love life at RWS.

Our purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career.

In return, we expect all our people to live by the values that unite us: to partner, putting clients fist and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients.

RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.

RWS Values

Get the 3Ps right – Partner, Pioneer, Progress – and we´ll Deliver together as RWS.

Recruitment Agencies: RWS Holdings PLC does not accept agency resumes. Please do not forward any unsolicited resumes to any RWS employees. Any unsolicited resume received will be treated as the property of RWS and Terms & Conditions associated with the use of such resume will be considered null and void.

#LI-IV1 #LI-Hybrid

Senior AI Engineer

Job Description