Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by CEGI

2022

Traffic State Prediction Using One-Dimensional Convolution Neural Networks and Long Short-Term Memory

Authors
Reza, S; Ferreira, MC; Machado, JJM; Tavares, JMRS;

Publication
APPLIED SCIENCES-BASEL

Abstract
Traffic prediction is a vitally important keystone of an intelligent transportation system (ITS). It aims to improve travel route selection, reduce overall carbon emissions, mitigate congestion, and enhance safety. However, efficiently modelling traffic flow is challenging due to its dynamic and non-linear behaviour. With the availability of a vast number of data samples, deep neural network-based models are best suited to solve these challenges. However, conventional network-based models lack robustness and accuracy because of their incapability to capture traffic's spatial and temporal correlations. Besides, they usually require data from adjacent roads to achieve accurate predictions. Hence, this article presents a one-dimensional (1D) convolution neural network (CNN) and long short-term memory (LSTM)-based traffic state prediction model, which was evaluated using the Zenodo and PeMS datasets. The model used three stacked layers of 1D CNN, and LSTM with a logarithmic hyperbolic cosine loss function. The 1D CNN layers extract the features from the data, and the goodness of the LSTM is used to remember the past events to leverage them for the learnt features for traffic state prediction. A comparative performance analysis of the proposed model against support vector regression, standard LSTM, gated recurrent units (GRUs), and CNN and GRU-based models under the same conditions is also presented. The results demonstrate very encouraging performance of the proposed model, improving the mean absolute error, root mean squared error, mean percentage absolute error, and coefficient of determination scores by a mean of 16.97%, 52.1%, 54.15%, and 7.87%, respectively, relative to the baselines under comparison.

2022

A multi-head attention-based transformer model for traffic flow forecasting with a comparative analysis to recurrent neural networks

Authors
Reza, S; Ferreira, MC; Machado, JJM; Tavares, JMRS;

Publication
EXPERT SYSTEMS WITH APPLICATIONS

Abstract
Traffic flow forecasting is an essential component of an intelligent transportation system to mitigate congestion. Recurrent neural networks, particularly gated recurrent units and long short-term memory, have been the stateof-the-art traffic flow forecasting models for the last few years. However, a more sophisticated and resilient model is necessary to effectively acquire long-range correlations in the time-series data sequence under analysis. The dominant performance of transformers by overcoming the drawbacks of recurrent neural networks in natural language processing might tackle this need and lead to successful time-series forecasting. This article presents a multi-head attention based transformer model for traffic flow forecasting with a comparative analysis between a gated recurrent unit and a long-short term memory-based model on PeMS dataset in this context. The model uses 5 heads with 5 identical layers of encoder and decoder and relies on Square Subsequent Masking techniques. The results demonstrate the promising performance of the transform-based model in predicting long-term traffic flow patterns effectively after feeding it with substantial amount of data. It also demonstrates its worthiness by increasing the mean squared errors and mean absolute percentage errors by (1.25 - 47.8)% and (32.4 - 83.8)%, respectively, concerning the current baselines.

2022

A customized residual neural network and bi-directional gated recurrent unit-based automatic speech recognition model

Authors
Reza, S; Ferreira, MC; Machado, JJM; Tavares, JMRS;

Publication
EXPERT SYSTEMS WITH APPLICATIONS

Abstract
Speech recognition aims to convert human speech into text and has applications in security, healthcare, commerce, automobiles, and technology, just to name a few. Inserting residual neural networks before recurrent neural network cells improves accuracy and cuts training time by a good margin. Furthermore, layer normalization instead of batch normalization is more effective in model training and performance enhancement. Also, the size of the datasets presents tremendous influences in achieving the best performance. Leveraging these tricks, this article proposes an automatic speech recognition model with a stacked five layers of customized Residual Convolution Neural Network and seven layers of Bi-Directional Gated Recurrent Units, including a logarithmic so f tmax for the model output. Each of them incorporates a learnable per-element affine parameter-based layer normalization technique. The training and testing of the new model were conducted on the LibriSpeech corpus and LJ Speech dataset. The experimental results demonstrate a character error rate (CER) of 4.7 and 3.61% on the two datasets, respectively, with only 33 million parameters without the requirement of any external language model.

2022

Road networks structure analysis: A preliminary network science-based approach

Authors
Reza, S; Ferreira, MC; Machado, JJM; Tavares, JMRS;

Publication
ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE

Abstract
Road network studies attracted unprecedented and overwhelming interest in recent years due to the clear relationship between human existence and city evolution. Current studies cover many aspects of a road network, for example, road feature extraction from video/image data, road map generalisation, traffic simulation, optimisation of optimal route finding problems, and traffic state prediction. However, analysing road networks as a complex graph is a field to explore. This study presents comparative studies on the Porto, in Portugal, road network sections, mainly of Matosinhos, Paranhos, and Maia municipalities, regarding degree distributions, clustering coefficients, centrality measures, connected components, k-nearest neighbours, and shortest paths. Further insights into the networks took into account the community structures, page rank, and small-world analysis. The results show that the information exchange efficiency of Matosinhos is 0.8, which is 10 and 12.8% more significant than that of the Maia and Paranhos networks, respectively. Other findings stated are: (1) the studied road networks are very accessible and densely linked; (2) they are small-world in nature, with an average length of the shortest pathways between any two roads of 29.17 units, which as found in the scenario of the Maia road network; and (3) the most critical intersections of the studied network are 'Avenida da Boavista, 4100-119 Porto (latitude: 41.157944, longitude: - 8.629105)', and 'Autoestrada do Norte, Porto (latitude: 41.1687869, longitude: - 8.6400656)', based on the analysis of centrality measures.

2022

The impact of time windows constraints on metaheuristics implementation: a study for the Discrete and Dynamic Berth Allocation Problem

Authors
Barbosa, F; Rampazzo, PCB; de Azevedo, AT; Yamakami, A;

Publication
APPLIED INTELLIGENCE

Abstract
This paper describes the development of a mechanism to deal with time windows constraints. To the best of our knowledge, the time windows constraints are difficult to be fulfilled even for state-of-the-art methods. Therefore, the main contribution of this paper is to propose a new computational technique to deal with such constraints to ensure the algorithm convergence. We test such technique in two metaheuristics to solve the discrete and dynamic Berth Allocation Problem. A data set generator was created, resulting in a diversity of problems in terms of time windows constraints. A detailed computational analysis was carried out to compare the performance for each metaheuristic.

2022

The rectangular two-dimensional strip packing problem real-life practical constraints: A bibliometric overview

Authors
Neuenfeldt, A; Silva, E; Francescatto, M; Rosa, CB; Siluk, J;

Publication
COMPUTERS & OPERATIONS RESEARCH

Abstract
Over the years, methods and algorithms have been extensively studied to solve variations of the rectangular twodimensional strip packing problem (2D-SPP), in which small rectangles must be packed inside a larger object denominated as a strip, while minimizing the space necessary to pack all rectangles. In the rectangular 2D-SPP, constraints are used to restrict the packing process, satisfying physical and real-life practical conditions that can impact the material cutting. The objective of this paper is to present an extensive literature review covering scientific publications about the rectangular 2D-SPP constraints in order to provide a useful foundation to support new research works. A systematic literature review was conducted, and 223 articles were selected and analyzed. Real-life practical constraints concerning the rectangular 2D-SPP were classified into seven different groups. In addition, a bibliometric analysis of the rectangular 2D-SPP academic literature was developed. The most relevant authors, articles, and journals were discussed, and an analysis made concerning the basic constraints (orientation and guillotine cutting) and the main solving methods for the rectangular 2D-SPP. Overall, the present paper indicates opportunities to address real-life practical constraints.

  • 39
  • 170