Open Source Integrated Lexical Analyzer for Commented Code Lines

Radu Bucea – Manea – Ţoniş
Academy of Economic Studies of Bucharest

Abstract: This paper describes the design and implementation of a lexical analyzer that automatically generates documentation to assist classic code optimizations. This scanner contains one new component, a distinct module for analyzing tokens and lexemes in order to produce the basic documentation of the source code, which is not commonly found in traditional lexical analyzers. The resulted documentation accumulates profile information and supplies this information to identify new optimization opportunities that are not visible to traditional methods. Experimental results show that the AGCC lexical analyzer significantly improves the performance of C Compilers in terms of execution time and error alerts.

Keywords: Compiler, lexical analyzer, token, code optimization.

View full text

Radu Bucea – Manea – Ţoniş, Open Source Integrated Lexical Analyzer for Commented Code Lines, Romanian Journal of Information Technology and Automatic Control, ISSN 1220-1758, vol. 19(1), pp. 35-42, 2009.