Utilize este identificador para referenciar este registo:
http://hdl.handle.net/10773/34943
Título: | Normalized entropy: a comparison with traditional techniques in variable selection |
Autor: | Macedo, Pedro Costa, Maria Conceição Cruz, João Pedro |
Palavras-chave: | Maximum entropy Regression analysis Variable selection |
Data: | 6-Abr-2022 |
Editora: | American Institute of Physics |
Resumo: | A variable selection procedure in regression analysis using a normalized entropy measure was firstly proposed in 1996, by Amos Golan, George Judge and Douglas Miller, in the book Maximum Entropy Econometrics - Robust Estimation with Limited Data. To the best of the authors' knowledge, the idea has not been explored in the literature since then, despite many noteworthy advantages that have been pointed out by Amos Golan and coauthors, such as: it is simple to perform, even for a large number of variables (useful in some big data problems); it allows the use of non-sample information (easily incorporated in the optimization structure); and it can be implemented for ill-posed models (frequently observed in real-world problems). Following a recent work that illustrates how normalized entropy can represent a promising approach to identify pure noise models, this paper revises the procedure of normalized entropy, proposes some improvements, and illustrates its performance when compared with some well-known traditional techniques in variable selection problems. |
Peer review: | yes |
URI: | http://hdl.handle.net/10773/34943 |
DOI: | 10.1063/5.0081504 |
ISBN: | 978-0-7354-4182-8 |
Versão do Editor: | https://aip.scitation.org/doi/abs/10.1063/5.0081504 |
Aparece nas coleções: | CIDMA - Capítulo de livro DMat - Capítulo de livro PSG - Capítulo de livro |
Ficheiros deste registo:
Ficheiro | Descrição | Tamanho | Formato | |
---|---|---|---|---|
MMAI2020-RIA.pdf | 236.25 kB | Adobe PDF | Ver/Abrir |
Todos os registos no repositório estão protegidos por leis de copyright, com todos os direitos reservados.