Thomson Reuters
Heute veröffentlichtGehöre zu den ersten 5 Bewerbern

Director, Model Inference Engineering

Landis + Gyr-Strasse 3, 6300 Zug · Informationsdienste / Legal- und Steuer-Software · Globales Unternehmen · Deutsch

Hybrid100%Senior / Lead

About Us

Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news. We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward. As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace. We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law. More information on requesting an accommodation here.

Key Responsibilities

Build and operate the model-serving infrastructure that runs Thomson's production traffic. Implement and tune inference-optimization techniques (batching, caching, quantization, or comparable) to reduce cost and latency without sacrificing quality. Improve Mariner's observability as call volume and the deployment surface grow. Build out Thomson's production footing: implement the controls and evidence for the ISO 27001 compliance path, the cost-tracking and attribution Finance relies on, and GPU-capacity contingency plans so a capacity change doesn't force downtime or costly parallel running. Make and document cost vs. latency vs. reliability tradeoffs, and bring them to the Director and partner teams. Work directly with the training and evaluation pods to get new model releases live on the serving stack. Help stand up the team's own practices and tooling (on-call, incident reviews, onboarding) as an early member, rather than inheriting a fixed system. Collaborate with research and product stakeholders and engineering leadership so the serving stack keeps pace with new model releases.

Required Qualifications

Hands-on infrastructure engineering experience with Kubernetes or similar, comfortable owning a system in production rather than only prototyping one. Experience keeping model services up across multiple use cases: peak load, scaling, disaster recovery, and operational excellence. Direct experience with model-serving infrastructure and/or inference optimization for large models, at whatever scale you've worked at so far. Large-scale distributed systems experience, including scaling and reliability under production load. Comfort debugging distributed systems and production incidents under real traffic. A track record of shipping software end to end: design, build, and operate production systems. Champion and enforce engineering best practices while working with dynamic product requirements. Ability to operate autonomously as an early lead engineer, and to mentor and grow other team members as the team scales.

Fähigkeiten

RustGoML / AIKubernetes
Inference OptimizationDistributed SystemsGPU ClustersISO 27001LLM-serving StacksTensorRT-LLMTriton

Gehaltsspanne

Auf Anfrage

Dieser Arbeitgeber nennt die Gehaltsspanne im ersten Gespräch.

Thomson Reuters
Der ArbeitgeberThomson Reuters
Unternehmenstyp
Globales Unternehmen
Teamsprache
Deutsch
Branche
Informationsdienste / Legal- und Steuer-Software

Kontakt

Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.

Standort

Landis + Gyr-Strasse 3, 6300 Zug
Reisezeiten ab deiner Adresse: kostenlos registrieren.

Weitere Stellen bei Thomson Reuters

Thomson Reuters · Zug · 100%
Hybrid
PythonML / AILLMsAINLPBenchmarkingModel EvaluationResearchExperimental Design
Thomson Reuters · Zug · 100%
Hybrid
ML / AIReinforcement LearningLarge Language ModelsPyTorchReward ModellingPolicy OptimisationMulti-turn RLNeMo-RLOpenRLHFTRLMixture-of-ExpertsLong-context Models
Thomson Reuters · Zug · 100%
Hybrid
ML / AIRustGoKubernetesML PlatformLLM developmentDistributed SystemsGPU-cluster planningMulti-cloud deploymentISO 27001SOC 2Model-serving infrastructureInference optimizationCost-optimizationObservabilityLatency managementReliability engineering
Thomson Reuters · Zug · 100%
Hybrid
ML / AIAILLMModel EvaluationOptimizationISO 27001BenchmarkingMulti-agent SystemsDecision ModelsEvaluation FrameworksAI-assisted Coding

Ähnliche Jobs

Mistral · Zürich · 100%
Hybrid
PythonC++RustGoJavaKubernetesSLURMCI/CDDistributed SystemsContainer OrchestrationAPIsGPU ClustersCUDAProfilingI/O OptimizationAutomationCLIDashboards
IMC Trading · Zug · 100%
Vor Ort
GoRustSecurityGolangSolidityMoveLinuxGitBlockchainSmart ContractsCryptography
Dialectic · Zug · 80-100%
Hybrid
RustML / AIEthereumSolanaSmart ContractsAI ToolsData PipelinesDeFiSolidityData Visualization
Mistral · Zürich · 100%
Hybrid
PythonRustGoJavaPyTorchJAXRayKubernetesMLOpsTransformer models
DeepJudge AG · Zürich · 100%
Vor Ort
PythonRustGoCI/CDTestingKubernetesJavaScriptBuild SystemsDependency ManagementVulnerability ManagementInternal ToolingObservability
AXA · Zürich · 80-100%
Hybrid
PythonGoML / AIGCPGolangREST APIsMicroservicesGoogle ADKLangChainLangGraphPostgrespgvectorServerlessTerraformGitHub ActionsAgentic AIMulti-Agent ArchitekturenAgent2Agent ProtocolContext EngineeringRAG