Education, Science, Technology, Innovation and Life
Open Access
Sign In
  1. Home
  2. Journals
  3. Computing, Performance and Communication Systems
  4. Vol 9, Issue 1, 2025

Research on Temporal Knowledge Graph Reasoning Based on Trend and Dynamic Change Perception Enhancement

Download as PDF

DOI: 10.23977/cpcs.2025.090107 | Downloads: 5 | Views: 404

Author(s)

Hanzhang Liu 1

Affiliation(s)

1 Nanjing University of Finance and Economics, Nanjing, China

Corresponding Author

Hanzhang Liu

ABSTRACT

Temporal knowledge graphs (TKGs), as an effective means of modeling dynamic relationships among entities, have shown great potential in tasks such as event prediction in recent years. However, most existing reasoning approaches tend to overlook the diversity and complexity of historical information. In reality, reasoning at the current timestamp is often constrained by the limited scope of historical data and the influence of unobserved latent factors. There are three major limitations in current TKG reasoning methods: (1) the inability to effectively highlight the importance of historical snapshots relevant to the current query when integrating both local and global history; (2) the neglect of temporal trends inherent in the evolution of facts, resulting in insufficient modeling of evolutionary patterns; and (3) the lack of effective mechanisms for capturing abrupt, short-term changes in the temporal dimension of facts. To address these challenges, we propose a novel Trend- and Variation-aware Contrastive Learning Network. Specifically, we introduce a local-global contrastive learning mechanism to guide the model's focus toward historical information that is more relevant to the current query. We further design a trend-aware attention module to capture the regularities and temporal evolution patterns in long-term entity representations. Additionally, a time-aware convolution module is developed to perceive abrupt dynamic changes in entity states across consecutive time slices, enabling the model to better integrate this information with current context representations. Experimental results on four benchmark TKG datasets demonstrate that our model outperforms several state-of-the-art baseline models in prediction tasks, showcasing its superior generalization ability and effectiveness in modeling complex temporal evolution patterns.

KEYWORDS

Temporal Knowledge Graphs; Trend Modeling; Dynamic Entity Representation; Contrastive Learning; Temporal Reasoning

CITE THIS PAPER

Hanzhang Liu, Research on Temporal Knowledge Graph Reasoning Based on Trend and Dynamic Change Perception Enhancement. Computing, Performance and Communication Systems (2025) Vol. 9: 41-58. DOI: http://dx.doi.org/10.23977/cpcs.2025.090107.

REFERENCES

[1] Trivedi, R., Dai, H., Wang, Y., & Song, L. (2017, July). Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. In international conference on machine learning (pp. 3462-3471). PMLR.
[2] Trivedi, R., Farajtabar, M., Biswal, P., & Zha, H. (2019, May). Dyrep: Learning representations over dynamic graphs. In International conference on learning representations.
[3] W. Jin, M. Qu, X. Jin, and X. Ren, "Recurrent event network: Autoregressive structure inferenceover temporal knowledge graphs," in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 2022-11-24, pp. 6669–6683
[4] Zhao, L., Song, Y., Zhang, C., Liu, Y., Wang, P., Lin, T., ... & Li, H. (2019). T-GCN: A temporal graph convolutional network for traffic prediction. IEEE transactions on intelligent transportation systems, 21(9), 3848-3858.
[5] Z. Li, Z. Hou, S. Guan, X. Jin, W. Peng, L. Bai, Y. Lyu, W. Li, J. Guo, and X. Cheng, "Hismatch: Historical structure matching based temporal knowledge graph reasoning," in Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. Association for Computational Linguistics, 2022, pp. 7328–7338.
[6] Y. Li, S. Sun, and J. Zhao, "Tirgn: time-guided recurrent graph network with local-global historical patterns for temporal knowledge graph reasoning," in Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI 2022, Vienna, Austria, 23-29 July 2022. ijcai. org, 2022, pp. 2152–2158
[7] Lin, Y., Wang, H., Sun, Y., & Zha, D. (2025). LTGQ: Learning Temporal Granularity for Temporal Knowledge Graph Forecasting with Quadruplet Networks. In Proceedings of the 2025 International Conference on Learning Representations (ICLR).
[8] Ju, W., Luo, X., Ma, Z., Yang, J., Deng, M., & Zhang, M. (2022). GHNN: Graph harmonic neural networks for semi-supervised graph-level classification. Neural Networks, 151, 70-79.
[9] Liu, W., Zhang, C., Lin, G., & Liu, F. (2020). Crnet: Cross-reference networks for few-shot segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 4165-4173).
[10] L. A. Galárraga, C. Teflioudi, K. Hose, and F. Suchanek, "Amie: association rule mining under incomplete evidence in ontological knowledge bases," in Proceedings of the 22nd international conference on World Wide Web, 2013, pp. 413–422.
[11] Omran, P. G., Wang, K., & Wang, Z. (2018). Scalable rule learning via learning representation. In IJCAI-18. International Joint Conferences on Artificial Intelligence. Ji, S. et al. (2021). A Survey on Knowledge Graphs: Representation, Acquisition, and Applications. IEEE TNNLS.
[12] A. Bordes, N. U sunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, "Translating embeddings for modeling multi relational data," in Advances in Neural Information Processing Systems, 2013, pp. 2787–2795.
[13] Nickel, M., Tresp, V., & Kriegel, H. P. (2011, June). A three-way model for collective learning on multi-relational data. In Icml (Vol. 11, No. 10.5555, pp. 3104482-3104584). T. N. Kipf and M. Welling, "Semi-supervised classification with graph convolutional networks," in ICLR, 2017.
[14] M. S. Schlichtkrull, T. N. Kipf, P. Bloem, R. van den Berg, I. Titov, and M. Welling, "Modeling relational data with graph convolutional networks," in The Semantic Web - 15th International Conference, ESWC 2018, Heraklion, Crete, Greece, June 3-7, 2018, Proceedings, ser. Lecture Notes in Computer Science, vol. 10843. Springer, 2018, pp. 593–607.
[15] Liu, W., Zhou, P., Zhao, Z., Wang, Z., Ju, Q., Deng, H., & Wang, P. (2020, April). K-bert: Enabling language representation with knowledge graph. In Proceedings of the AAAI conference on artificial intelligence (Vol. 34, No. 03, pp. 2901-2908). 
[16] Pareja, A., Domeniconi, G., Chen, J., Ma, T., Suzumura, T., Karsai, M., & Benson, A. R. (2020). EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04), 5363–5370.
[17] Sankar, A., Wu, Y., Gou, W., Zhang, Y., Yang, J., & Sundaram, H. (2020). Dynamic Graph Representation Learning via Self-Attention Networks. In ICLR 2020.
[18] Rossi, E., Chamberlain, B. P., Frasca, F., Eynard, D., Monti, F., & Bronstein, M. M. (2020). Temporal Graph Networks for Deep Learning on Dynamic Graphs. ICML 2020 Workshop. arXiv preprint.
[19] Wang, Xuhong, et al. "Apan: Asynchronous propagation attention network for real-time temporal graph embedding." Proceedings of the 2021 international conference on management of data. 2021.Xu, D., Ruan, C., Korpeoglu, E., Kumar, S., & Achan, K. (2020). Inductive representation learning on temporal graphs. In International Conference on Learning Representations (ICLR).
[20] He, Y., Zhang, P., Liu, L., Liang, Q., Zhang, W., & Zhang, C. (2024). Hip network: Historical information passing network for extrapolation reasoning on temporal knowledge graph. arxiv preprint arxiv:2402.12074.
[21] Xu, D., Ruan, C., Korpeoglu, E., Kumar, S., & Achan, K. (2020). Inductive representation learning on temporal graphs. arXiv preprint arXiv:2002.07962.
[22] Z. Li, X. Jin, W. Li, S. Guan, J. Guo, H. Shen, Y. Wang, and X. Cheng, "Temporal knowledge graph reasoning based on evolutional representation learning," in Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, 2021, pp. 408–417.
[23] Wang, Y., He, X., Cao, Y., Zhang, M., & Chua, T.-S. (2021). CAWN: Causal Anonymous Walks for Temporal Graphs. In NeurIPS 2021.
[24] Y. Xu, J. Ou, H. Xu, and L. Fu, "Temporal knowledge graph reasoning with historical contrastive learning," in Thirty-Seventh AAAI Conference on Artificial Intelligence, AAAI 2023, Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence, IAAI 2023, Thirteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2023, Washington, DC, USA, February 7-14, 2023. AAAI Press, 2023, pp. 4765–4773
[25] C. Zhu, M. Chen, C. Fan, G. Cheng, and Y. Zhang, "Learning from history: Modeling temporal knowledge graphs with sequential copygeneration networks," vol. 35, no. 5, pp. 4732–4740, 2021, number: 5.
[26] S. Li, X. Jin, Y. Xuan, X. Zhou, W. Chen, Y.-X. Wang, and X. Yan,"Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting," in Advances in Neural Information Processing Systems, 2019, pp. 5244–5254
[27] Z. Li, Z. Hou, S. Guan, X. Jin, W. Peng, L. Bai, Y. Lyu, W. Li, J. Guo, and X. Cheng, "Hismatch: Historical structure matching based temporal knowledge graph reasoning," in Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. Association for Computational Linguistics, 2022, pp. 7328–7338.
[28] P. Khosla, P. Teterwak, C. Wang, A. Sarna, Y. Tian, P. Isola, A. Maschinot, C. Liu, and D. Krishnan, "Supervised contrastive learning," in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.
[29] Y. Xu, J. Ou, H. Xu, and L. Fu, "Temporal knowledge graph reasoning with historical contrastive learning," in Thirty-Seventh AAAI Conference on Artificial Intelligence, AAAI 2023, Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence, IAAI 2023, Thirteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2023, Washington, DC, USA, February 7-14, 2023. AAAI Press, 2023, pp. 4765–4773
[30] C. Shang, Y. Tang, J. Huang, J. Bi, X. He, and B. Zhou, "End-to-end structure-aware convolutional networks for knowledge base completion," in The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019. AAAI Press, 2019, pp. 3060–3067.
[31] E. Boschee, J. Lautenschlager, S. O’Brien, S. Shellman, J. Starz, and M. Ward, “Icews coded event data. harvard dataverse,” V4 (http://dx. doi. org/10.7910/DVN/28075), 2015.
[32] K. Leetaru and P. A. Schrodt., "Gdelt: Global data on events, location, and tone, 1979-2012," ISA Annual Convention, vol. 4, pp. 1–49, 2013.
[33] Z. Li, X. Jin, W. Li, S. Guan, J. Guo, H. Shen, Y. Wang, and X. Cheng, "Temporal knowledge graph reasoning based on evolutional representation learning," in Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. Association for Computing Machinery, 2021, pp. 408–417.
[34] W. Jin, M. Qu, X. Jin, and X. Ren, "Recurrent event network: Autoregressive structure inferenceover temporal knowledge graphs," in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 2022-11-24, pp. 6669–6683.
[35] B. Yang, W. Yih, X. He, J. Gao, and L. Deng, "Embedding entities and relations for learning and inference in knowledge bases," in 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015
[36] T. Trouillon, J. Welbl, S. Riedel, E. Gaussier, and G. Bouchard, ´ "Complex embeddings for simple link prediction," in Proceedings of the 33nd International Conference on Machine Learning, ICML 2016,
[37] Z. Sun, Z. Deng, J. Nie, and J. Tang, "Rotate: Knowledge graph embedding by relational rotation in complex space," in 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net, 2019.
[38] J. Leblay and M. W. Chekol, "Deriving validity time in knowledge graph,” in Companion of the The Web Conference 2018 on The Web Conference 2018, WWW 2018, Lyon , France, April 23-27, 2018, P. Champin, F. Gandon, M. Lalmas, and P. G. Ipeirotis, Eds. ACM, 2018, pp. 1771–1776
[39] R. Goel, S. M. Kazemi, M. A. Brubaker, and P. Poupart, "Diachronic embedding for temporal knowledge graph completion," in The ThirtyFourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020. AAAI Press, 2020, pp. 3988–3995
[40] A. Garc´ıa-Duran, S. Dumancic, and M. Niepert, "Learning sequence ´ encoders for temporal knowledge graph completion," in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31 - November 4, 2018. Association for Computational Linguistics, 2018, pp. 4816–4821.
[41] T. Lacroix, G. Obozinski, and N. Usunier, "Tensor decompositions for temporal knowledge base completion," in 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020.
[42] Z. Han, Z. Ding, Y. Ma, Y. Gu, and V. Tresp, "Learning neural ordinary equations for forecasting future links on temporal knowledge graphs," in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. Association for Computational Linguistics, 2021, pp. 8352–8364.
[43] Z. Han, P. Chen, Y. Ma, and V. Tresp, "Explainable subgraph reasoning for forecasting on temporal knowledge graphs," in 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021.
[44] H. Sun, J. Zhong, Y. Ma, Z. Han, and K. He, "TimeTraveler: Reinforcement learning for temporal knowledge graph forecasting," in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2021, pp. 8306–8319.
[45] Z. Li, S. Guan, X. Jin, W. Peng, Y. Lyu, Y. Zhu, L. Bai, W. Li, J. Guo, and X. Cheng, "Complex evolutional pattern learning for temporal knowledge graph reasoning," in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, 2022, pp. 290– 296.
[46] K. Liu, F. Zhao, G. Xu, X. Wang, and H. Jin, "Retia: relation-entity twin-interact aggregation for temporal knowledge graph extrapolation," in IEEE International Conference on Data Engineering. IEEE, 2023.
[47] Z. Han, Z. Ding, Y. Ma, Y. Gu, and V. Tresp, "Learning neural ordinary equations for forecasting future links on temporal knowledge graphs," in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. Association for Computational Linguistics, 2021, pp. 8352–8364
[48] ] Z. Li, Z. Hou, S. Guan, X. Jin, W. Peng, L. Bai, Y. Lyu, W. Li, J. Guo, and X. Cheng, "Hismatch: Historical structure matching based temporal knowledge graph reasoning,” in Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. Association for Computational Linguistics, 2022, pp. 7328–7338
[49] D. P. Kingma and J. Ba, "Adam: A method for stochastic optimization," in 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015. 

Subscription
E-Mail Alert
Most popular papers
Call for Special Issue
Publication Ethics & OA Statement
Plagiarism Policy
Contact Us
Downloads: 3179
Visits: 186888

Sponsors, Associates, and Links

All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.