[Skip to main content](#main-content)

[OpenNash Jobs](https://jobs.opennash.com/)
[Hiring report](/reports/hiring/) · [All Tencent Holdings jobs](https://jobs.opennash.com/companies/tencent-holdings/) · [Search jobs](/search/)

Tencent Holdings · Beijing

# 微信-WeLM 大模型预训练框架研发工程师（深圳、上海）

Beijing 

Listed on Tencent Holdings’s official careers site. Listed as of October 19, 2026. Check that it is still open and apply there.
[Apply on Tencent Holdings’s careers site →](https://careers.tencent.com/en-us/jobdesc.html?postId=2020723054623227904)

[OpenNash Jobs](https://jobs.opennash.com/) / [Tencent Holdings](https://jobs.opennash.com/companies/tencent-holdings/) / 微信-WeLM 大模型预训练框架研发工程师（深圳、上海）

## Job description

### Responsibilities
- 负责构建和优化大规模预训练框架，支持文本、语音、图像等多模态数据的联合学习与高效训练；
- 深入优化长序列场景下的分布式训练与显存利用（如context parallel、2D/环形 Attention、混合并行、激活重计算等），在百万级 token 训练中提升吞吐与性价比；
- 负责后训练（Post-training）阶段框架建设，包括强化学习（RL/RLHF）、偏好建模（Reward Model）及人类反馈优化（Alignment）等流程；
- 深入优化分布式训练框架与推理效率，提升算力利用率与模型吞吐性能；
- 跟踪前沿研究趋势，探索高效预训练策略（如Mixture of Experts、Continual Pretraining等）；
- 与算法、数据、平台团队协作，形成从数据处理到训练部署的全流程自动化解决方案。 Requirements
- 计算机科学、人工智能、模式识别、计算语言学等相关专业硕士及以上学历；
- 精通一种或多种主流深度学习框架（PyTorch、JAX、TensorFlow），具备大规模分布式训练经验；
- 熟悉Transformer系列架构，理解其在语言、语音、视觉等方向的模型原理与实现；
- 了解 LLM 的训练流程，有 Megatron, DeepSpeed 等大规模训练框架使用经验者优先；
- 对RL/RLHF、偏好学习、奖励建模有实践经验者优先；
- 具备扎实的工程实现能力与代码规范意识，熟悉CUDA优化、参数并行、流水线并行等技术；
- 具备良好的团队协作与沟通能力，热爱探索与创新。

## At a glance
- Posted by the employer: Not stated
- First seen by OpenNash: Jul 19, 2026
- Last checked: Oct 19, 2026
- Listed for: 92 days
- Location: Beijing[Apply on Tencent Holdings’s careers site →](https://careers.tencent.com/en-us/jobdesc.html?postId=2020723054623227904)

## More jobs at Tencent Holdings

### [3D动作游戏《狩》-后台开发-UE5 DS后台开发](https://jobs.opennash.com/companies/tencent-holdings/jobs/6d535d770b7d94786b5e/)

Beijing

### [AI infra研发工程师(北京/深圳)](https://jobs.opennash.com/companies/tencent-holdings/jobs/eda44bea14836b2b9952/)

Beijing

### [AI ⽹络集合通信库运营⼯程师](https://jobs.opennash.com/companies/tencent-holdings/jobs/59f91606e7bdc470bf0b/)

Beijing

### [Aigc内容检测算法工程师（图像与视频方向）](https://jobs.opennash.com/companies/tencent-holdings/jobs/ca1cf721bb29a8df9bdf/)

Beijing

### [AI智能体评测高级工程师](https://jobs.opennash.com/companies/tencent-holdings/jobs/9312d7b2c30640f3f245/)

Beijing

OpenNash lists jobs from employers’ own careers sites and does not handle applications.
Dates come from the employer where stated; “first seen” and “last checked” are our own observations.

OpenNash Jobs · Official listings with dates and links to the employer. [Weekly hiring report](/reports/hiring/) · [Methodology](/methodology/)