基于社团优化的动态网络 Transformer 表示学习
李天鹏 , 郭翾 , 张旺 , 陶润国 , 廖浩然 , 王文俊
天津大学学报(自然科学与工程技术版) ›› 2026, Vol. 59 ›› Issue (11) : 1219 -1230.
基于社团优化的动态网络 Transformer 表示学习
Transformer-Based Dynamic Network Embedding via Community Optimization
现有动态网络表示学习方法对动态网络时序演化的建模大多服从网络平滑性假设与隐马尔可夫性假设,然而现实世界的数据往往并不严格遵循上述假设,部分动态网络在时序演化过程中可能出现周期性依赖或长程依赖,进而降低了现有动态网络表示学习方法的有效性和泛用能力.为解决这一问题,本文提出了基于社团优化的Transformer 动态网络表示学习模型 CO-TDNE,该方法利用 Transformer 堆叠的注意力机制结合时间位置编码策略刻画高度可变的图结构和动态网络复杂的时间依赖关系,更加适应真实世界动态网络在时序维度的突变与噪声影响.另外为了缓解 Transformer 在大规模图数据上的高计算成本和有限可扩展性问题,通过在全局视角下识别稳定社团,并在社团内进行参数共享来提升效率. 这一策略在不影响模型效果的同时将训练速度提高了 30%~35%. 本文在 6 组真实世界数据对动态网络的隐马尔可夫性假设的有效性进行了实证验证,证明了现实世界的数据并不严格符合该假设. 在现实世界数据集上的新边链接预测与缺失边链接预测实验表明,CO-TDNE 对动态网络时序演化模式的建模以及拓扑结构的刻画优于对比方法. 所构建的大量消融实验也证明了本文所提出的全局稳定社团优化策略能够有效降低模型参数规模,并证明了基于网络层次结构优化策略的有效性.
Existing methods for dynamic network representation learning typically rely on assumptions of network smoothness and first-order Markovian dynamics to model temporal evolution. However,real-world dynamic networks often violate these assumptions,exhibiting periodic or long-range dependencies that undermine the effectiveness and generalizability of current techniques. To overcome this limitation,we introduce a community-optimized Transformer-based dynamic network embedding(CO-TDNE) model. The CO-TDNE model employs stacked Transformer attention mechanisms combined with a temporal positional encoding strategy to effectively capture diverse graph structures and complex temporal dependencies,thereby accommodating abrupt changes and noise inherent in real-world dynamic networks. To address the high computational cost and scalability challenges of Transformer on large-scale graphs,we propose a novel optimization strategy that identifies stable communities from a global perspective and implements parameter sharing within these communities. This strategy improves training efficiency by 30%—35% while maintaining model performance. Empirical validation on six real-world datasets confirms that the first-order Markovian assumption does not strictly hold in practice. In addition,experiments on new link and missing link prediction tasks demonstrate that CO-TDNE outperforms baseline methods in modeling temporal evolution patterns and topological structures. Comprehensive ablation studies further demonstrate the efficiency of the proposed global stable community optimization strategy in reducing model parameter complexity and highlight the effectiveness of the community-based hierarchical network optimization approach.
| [1] |
|
| [2] |
|
| [3] |
|
| [4] |
|
| [5] |
|
| [6] |
|
| [7] |
|
| [8] |
|
| [9] |
|
| [10] |
|
| [11] |
|
| [12] |
|
| [13] |
|
| [14] |
|
| [15] |
|
| [16] |
|
| [17] |
|
国家自然科学基金资助项目(6247072183)
/
| 〈 |
|
〉 |