SWattention: designing fast and memory-efficient attention for a new Sunway Supercomputer

Ruohan WuXianyu ZhuJunshi ChenSha LiuTianyu ZhengXin LiuHong AnSWattention: designing fast

高性能计算与并行算法方向论文：SWattention: designing fast and memory-efficient attention for a new Sun

◫预览 PDFPreview PDF ↓下载 PDFDownload PDF ↗在线页面Official page ◇DOI

内容导读Reading note

分类与摘要Category & abstract

关注大规模并行算法、超算平台和性能优化，是 HPC 方向的重要条目。

Metadata

完整论文信息Full record

title: SWattention: designing fast and memory-efficient attention for a new Sunway Supercomputer
title_zh: 待补充
abstract: 待补充
abstract_zh: 待补充
keywords: HPC, 学位认定 C
year: 2024
published_date: 待补充
online_date: 待补充
paper_type: Journal
publication_status: Published
volume: 待补充
issue: 待补充
pages: 待补充
article_number: 待补充
publisher: 待补充
doi: 10.1007/s11227-024-05890-8
research_area: 高性能计算与并行算法
tags: HPC, 学位认定 C
category: 高性能计算与并行算法
summary: 关注大规模并行算法、超算平台和性能优化，是 HPC 方向的重要条目。
authors: Ruohan Wu, Xianyu Zhu, Junshi Chen, Sha Liu, Tianyu Zheng, Xin Liu, Hong An, SWattention: designing fast
corresponding_authors: 待补充
affiliations: 待补充
funding: 待补充

Research area

高性能计算与并行算法

Citation

Ruohan Wu, Xianyu Zhu, Junshi Chen, Sha Liu, Tianyu Zheng, Xin Liu, Hong An*, SWattention: designing fast and memory-efficient attention for new Sunway supercomputer, The Journal of Supercomputing, 11 March 2024

BibTeX

@article{acsa2024_36,
  title = {SWattention: designing fast and memory-efficient attention for a new Sunway Supercomputer},
  year = {2024},
  doi = {10.1007/s11227-024-05890-8}
}