Thomson Reuters
Heute veröffentlichtGehöre zu den ersten 5 Bewerbern

Senior/Lead Research Scientist, Model Evaluations

Landis + Gyr-Strasse 3, 6300 Zug · Informationsdienste / Legal- und Steuer-Software · Globales Unternehmen · Deutsch

Hybrid100%Senior / Lead

About Us

Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news. We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward.

Key Responsibilities

Build and operate the evaluation suite that runs Thomson evaluations. Leverage our existing suite to identify and understand the strengths and weakness of Thomson. Create new evaluations to meet the gaps in our coverage, based on a combination of product, external, and aspirational use cases for the model. Lead cross-functional teams in the creation of evaluation assets. Use your technical expertise to guide teams of scientists, engineers, and subject-matter experts working on evaluations and benchmarks. Mentor junior scientists in developing their own research and technical skills. Inform the technical direction of Thomson. Propose opportunities for improvements on topics such as more robust and reliable evaluation, new opportunities for applying LLMs, and optimizations on existing assets. Draw on evaluation results to inform our training objectives. Provide recommendations to senior leadership on technical trade-offs in model development. Conduct fundamental research. Develop new ideas in model evaluation across science of evaluations, new benchmarks, and safety and alignment. Publish research findings in top AI/ML/NLP conferences on a regular cadence. Integrate new research findings into model development and product pipelines.

Required Qualifications

Hands-on research experience in evaluations – with examples of designing, building and releasing benchmarks for frontier models or agents, including research publications in top conferences such as NeurIPS/ICML/ICLR/*ACL. Experience working closely with researchers and cross-functional stakeholders to translate ideas into practical evaluations. Hands-on Python coding experience implementing benchmarks, agents or other systems built around LLMs. Familiarity with current developments in LLMs, with an interest in staying up to date with the evolving frontier. A PhD in Computer Science or a related field, or equivalent practical experience, plus industry experience working on post-training or evaluation. Professional experience will be considered as a factor for levelling between Senior and Lead.

Fähigkeiten

PythonML / AI
LLMsAINLPBenchmarkingModel EvaluationResearchExperimental Design

Gehaltsspanne

Auf Anfrage

Dieser Arbeitgeber nennt die Gehaltsspanne im ersten Gespräch.

Thomson Reuters
Der ArbeitgeberThomson Reuters
Unternehmenstyp
Globales Unternehmen
Teamsprache
Deutsch
Branche
Informationsdienste / Legal- und Steuer-Software

Kontakt

Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.

Standort

Landis + Gyr-Strasse 3, 6300 Zug
Reisezeiten ab deiner Adresse: kostenlos registrieren.

Weitere Stellen bei Thomson Reuters

Thomson Reuters · Zug · 100%
Hybrid
ML / AIReinforcement LearningLarge Language ModelsPyTorchReward ModellingPolicy OptimisationMulti-turn RLNeMo-RLOpenRLHFTRLMixture-of-ExpertsLong-context Models
Thomson Reuters · Zug · 100%
Hybrid
ML / AIRustGoKubernetesML PlatformLLM developmentDistributed SystemsGPU-cluster planningMulti-cloud deploymentISO 27001SOC 2Model-serving infrastructureInference optimizationCost-optimizationObservabilityLatency managementReliability engineering
Thomson Reuters · Zug · 100%
Hybrid
ML / AIAILLMModel EvaluationOptimizationISO 27001BenchmarkingMulti-agent SystemsDecision ModelsEvaluation FrameworksAI-assisted Coding
Thomson Reuters · Zug · 100%
Hybrid
ML / AIPythonArchitectPyTorchMegatron-LMMegatron-CoreFSDPDTensorDeepSpeedGPUCUDANCCLvLLMSGLangRayKubernetesSlurmAWSAzureGoogle Cloud

Ähnliche Jobs

Mistral · Zürich · 100%
Hybrid
PythonML / AITest & QAPyTorchJAXTensorFlowDeepSpeedFSDPSLURMK8sCUDANLPLLMsCI/CD
ERNI · Zürich · 80-100%
Hybrid
PythonML / AISecurityMachine LearningAICloudAPIsData EngineeringSoftware IntegrationLLMsEmbeddingsVector SearchPrompt EngineeringCI/CDObservabilityResponsible AI
Novartis AG · Basel · 100%
CHF 129'500 - 240'500Hybrid
PythonDockerML / AIMachine LearningAIData ScienceSQLGitCI/CDREST APIsMLOpsMLflowBayesian methodsscikit-learnPyTorchData EngineeringSparkAPIsData ArchitectureKnowledge Graphs
Adaptyv Bio · Lausanne · 100%
Vor Ort
PythonML / AIpandasnumpybioinformaticsstatistical analysisdata pipelinesanomaly detectionQC modelsAIMLprotein datasequence-structure datadata qualitydataset building
Swissquote · Lausanne · 100%
Hybrid
PythonDockerML / AIMLflowArgo WorkflowsKubernetesCI/CDGitHub ActionsLLMsAI agents
Scalera · Zürich · 100%
Hybrid
PythonML / AIDockerPyTorchLLMsLangGraphLangfusePostgreSQLpgvectorPineconeGCPCI/CD