Vision, Language and Sound (VLS)

Current advancements in digital technologies have caused an explosion in the volume and diversity of document collections, which include textual, image, audio and video. This has spurred widespread interest in media-specific information retrieval and its related computational research. The VLS research group focuses on investigating techniques in managing large document collections, transforming data into computational representations and devising strategies for storage, processing, organisation, retrieval and interaction with these digital document collections. The main research fields that members are actively involved in include Information Retrieval; Intelligent Multimedia Data Processing, Analysis and Access; Natural Language Processing; Multimodal Sentiment Analysis; Multimodal Interaction and Query Technologies; Image and Video Processing and Sense-making; Speech and Audio Processing; Music and Computing; Web and Search Engine Technologies; Multimedia Analytics and Emerging Trends in Multimedia Big Data. For more information please click here.

Group members:

	Name	Expertise
	Dr. Alfian Abdul Halin (Leader) alfian@upm.edu.my	Applied Machine and Deep Learning, Pattern Recognition, Computer Vision, Image and Video Processing
	Assoc. Prof. Dr. Muhamad Taufik Abdullah mta@upm.edu.my	Information Retrieval, Multimedia Computing, Natural Language Processing
	Assoc. Prof. Dr. Azreen Azman azreenazman@upm.edu.my	Information Retrieval, Natural Language Processing, Intelligent Systems
	Assoc. Prof. Dr. Mas Rina Mustaffa masrina@upm.edu.my	Multimedia Systems and Applications, Content-based Image Retrieval, Pattern Recognition, Image Processing, Computer Vision
	Dr. Nurul Amelina Nasharuddin nurulamelina@upm.edu.my	Information Retrieval, Natural Language Processing, Multimedia Computing

Current Research Projects/Grants:

1. Ultra-layered Perception with Brain-inspired Information Processing for Vehicle Collision Avoidance (ULTRACEPT) (EU Horizon 2020 Marie Sklodowska-Curie, MSCA-RISE Grant)
   Duration: 2018 – 2022
   Institution project leader: Assoc. Prof. Dr. Shyamala Doraisamy
2. Sarcasm Detection using Machine Learning (Geran Putra IPS)
   Duration: 2018 – 2020
   Project leader: Dr. Alfian Abdul Halin
3. Effective Durian Species Feature Representation and Recognition (Geran Putra)
   Duration: 2018 – 2020
   Project leader: Dr. Mas Rina Mustaffa
4. Building A High Quality English-Malay Comparable Corpus using an Effective Cross-lingual Keyword Retrieval Technique (Geran Putra Muda)
   Duration: 2018 – 2020
   Project leader: Dr. Nurul Amelina Nasharuddin
5. Multimodal Learning Analytics Towards Improvement of Personalised Learning (Geran Putra)
   Duration: 2017 – 2019
   Project leaders: Assoc. Prof. Dr. Shyamala Doraisamy, Assoc. Prof. Dr. Azreen Azman

Recent Publications:

Al-Najjar, H.A., Kalantar, B., Pradhan, B., Saedi, V., Abdul Halin, A., Ueda, N., Mansor, S.  Land Cover Classification from fused DSM and UAV Images Using Convolutional Neural Networks. Remote Sensing, Vol 11(12), 2019. (IF: 4.118).

Ashour, M.W., Khalid, F., Abdul Halin, A., Abdullah, L.N., Darwish, S.H. Surface Defects Classification of Hot-Rolled Steel Strips Using Multi-directional Shearlet Features. Arabian Journal for Science and Engineering, Vol 44, 2019, pp. 2925-2932. (IF: 1.518).

Mansourian, L., Abdullah, M.T., Abdullah, L.N., Azman, A., Mustaffa, M.R. An Effective Fusion Model for Image Retrieval. Multimedia Tools and Applications, Vol 77(13), July 2018, pp. 16131-16154 (IF: 2.101).

Mustaffa, M.R., Nyon, X.Y., Abdullah, L.N., Nasharuddin, N.A. Durian Recognition based on Multiple Features and Linear Discriminant Analysis. Malaysian Journal of Computer Science, 2018, pp. 57-72. (IF: 0.625).

Alksher, M., Azman, A., Yaakob, R., Alshari, E.M., Kadir, R.A., Mohamed, A. Effective Idea Mining Technique Based on Modeling Lexical Semantic. Journal of Theoretical and Applied Information Technology, Vol 96(16), August 2018, pp. 5350-5362. (Scopus)

Roko, A., Doraisamy, S., Azman, A., Jantan, A.H. Named Entity Based Ranking with Term Proximity for XML Retrieval. International Journal of Information Retrieval, Vol 8(2), 2018, pp. 57-77. (Scopus)

Kalantar, B., Mansor, S., Abdul Halin, A., Mohd Shafri, H.Z., Zand, M. Multiple Moving Object Detection from UAV Videos Using Trajectories of Matched Regional Adjacency Graphs. IEEE Transactions on Geoscience and Remote Sensing, Vol 55(9), 2017, pp. 5198-5213. (IF: 5.630).

Abubacker, N.F., Azman, A., Doraisamy, S., Murad, M.A.A. An Integrated Method of Associative Classification and Neuro-fuzzy Approach for Effective Mammographic Classification. Neural Computing and Applications, Vol 28(12), December 2017, pp. 3967-3980. (IF: 4.215).

Alotaibi, F., Abdullah, M.T., Abdullah, R., Rahmat, R.W., Hashem, I.A.T., Sangaiah, A.K. Optical Character Recognition for Quranic Image Similarity Matching. IEEE Access, Vol 6, 2017, pp. 554-562. (IF: 4.098).

Updated:: 20/03/2025 [hafizrahim]