DNA microarrays is a technology that can be used to diagnose cancer and other diseases. To automate the analysis of such data, pattern recognition and machine learning algorithms can be applied. However, the curse of dimensionality is unavoidable: very few samples to train, and many attributes in each sample. As the predictive accuracy of supervised classifiers decays with irrelevant and redundant features, the necessity of a dimensionality reduction process is essential. The main idea is to retain only the genes that are the most influential in the classification of the disease. In this paper, a new methodology based on Principal Component Analysis and Logistics Regression is proposed. Our method enables the selection of particular genes that are relevant for classification. Experiments were run using eight different classifiers on two benchmark datasets: Leukemia and Lymphoma. The results show that our method not only reduces the number of required attributes, but also increase the classification accuracy in more than 10% in all the cases we tested.
AlizadehA.A., EisenM.B., DavisR.E., MaC., LossosI.S., RosenwaldA., BoldrickJ.C. et al., Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling, Nature403(6769) (2000), 503-511.
2.
AntoniadisA., Lambert-LacroixS. and LeblancF., Effective dimension reduction methods for tumor classification using gene expression data, Bioinformatics19(5) (2003), 563-570.
3.
BellmanR., Adaptive Control Processes: A Guided Tour, Princeton University Press, 1961.
4.
BielzaC., RoblesV. and LarrañagaP., Regularized logistic regression without a penalty term: An application to cancer classification with microarray data, Expert Systems with Applications38(5) (2011), 5110-5118.
5.
BrewsterJ.L., BeasonK.B., EckdahlT.T. and EvansI.M., The microarray revolution: Perspectives from educators, Biochemistry and Molecular Biology Education32(4) (2004), 217-227.
6.
BrownP.O. and BotsteinD., Exploring the new world of the genome with DNA microarrays, Nature Genetics21 (1999), 33-37.
7.
ChangC.-C. and LinC.-J., LIBSVM: A library for support vector machines, ACM Transactions on Intelligent Systems and Technology (TIST)2(3) (2011), 27.
8.
ChenX.-W., Gene selection for cancer classification using bootstrapped genetic algorithms and support vector machines, in: Proc of IEEE Bioinformatics Conference, (2003), 504-505.
9.
ChiangY.-M., ChiangH.-M. and LinS.-Y., The application of ant colony optimization for gene selection in microarray-based cancer classification, in: Proc of International Conference on Machine Learning and Cybernetics7 (2008), 4001-4006.
10.
ChoS.-B. and WonH.-H., Machine learning in DNA microarray analysis for cancer classification, in: Proc of the First Asia-Pacific Bioinformatics Conference on Bioinformatics, APBC '03, Australian Computer Society, Inc. (2003), 189-198.
11.
ChouH.-L., YaoC.-T., SuS.-L., LeeC.-Y., HuK.-Y., TerngH.-J., ShihY.-W., ChangY.-T., LuY.-F., ChangC.-W. et al., Gene expression profiling of breast cancer survivability by pooled cdna microarray analysis using logistic regression, artificial neural networks and decision trees, BMC Bioinformatics14(1) (2013), 100.
12.
ChuF. and WangL., Applications of support vector machines to cancer classification with microarray data, Int Journal of Neural Systems15(6) (2005), 475-484.
13.
De VosJ., ThykjaerT., TarteK., EnsslenM., RaynaudP., RequirandG., PelletF., PantescoV., RemeT., JourdanM. et al., Comparison of gene expression profiling between malignant and normal plasma cells with oligonucleotide arrays, Oncogene21(44) (2002), 6848-6857.
14.
DiazJ.M., PinonR.C. and SolanoG., Lung cancer classification using genetic algorithm to optimize prediction models, in: The 5th International Conference on Information, Intelligence, Systems and Applications, (2014), 1-6.
15.
DingC. and PengH., Minimum redundancy feature selection from microarray gene expression data, Journal of Bioinformatics and Computational Biology3(2) (2005), 185-205.
16.
Dolled-FilhartM., RydénL., CreggerM., JirströmK., HarigopalM., CampR.L. and RimmD.L., Classification of breast cancer using genetic algorithms and tissue microarrays, Clinical Cancer Research12(21) (2006), 6459-6468.
17.
El AkadiA., AmineA., El OuardighiA. and AboutajdineD., A two-stage gene selection scheme utilizing MRMR filter and GA wrapper, Knowledge and Information Systems26(3) (2011), 487-500.
FureyT.S., CristianiniN., DuffyN., BednarskiD.W., SchummerM. and HausslerD., Support vector machine classification and validation of cancer tissue samples using microarray expression data, Bioinformatics16(10) (2000), 906-914.
20.
GarroB.A., VazquezR.A. and Rodr'ıguezK., Classification of DNA microarrays using artificial bee colony (ABC) algorithm, in: Advances in Swarm Intelligence, Springer (2014), 207-214.
21.
GolubT.R., SlonimD.K., TamayoP., HuardC., GaasenbeekM., MesirovJ.P., CollerH., LohM.L., DowningJ.R., CaligiuriM.A. et al., Molecular classification of cancer: class discovery and class prediction by gene expression monitoring, Science286(5439) (1999), 531-537.
22.
GuyonI., WestonJ., BarnhillS. and VapnikV., Gene selection for cancer classification using support vector machines, Machine Learning46(1-3) (2002), 389-422.
23.
HairJ., BlackW., BabinB. and AndersonR., Multivariate Data Analysis, 7th edition, Prentice Hall, USA, 2010.
24.
HallM., FrankE., HolmesG., PfahringerB., ReutemannP. and WittenI.H., The WEKA data mining software: An update, ACM SIGKDD Explorations Newsletter11(1) (2009), 10-18.
25.
HuangG.-B., ZhuQ.-Y. and SiewC.-K., Extreme learning machine: Theory and applications, Neurocomputing70(1-3) (2006), 489-501.
26.
HuangJ., LuJ. and LingC.X., Comparing naive bayes, decision trees, and SVM with AUC and accuracy, in: Data Mining, 2003 ICDM 2003 Third IEEE International Conference on, IEEE (2003), 553-556.
27.
HuertaE.B., DuvalB. and HaoJ.-K., A hybrid GA/SVM approach for gene selection and classification of microarray data, in: Applications of Evolutionary Computing, Springer (2006), 34-44.
28.
HuynhH.T., KimJ.-J. and WonY., DNA microarray classification with compact single hidden-layer feedforward neural networks, in: Frontiers in the Convergence of Bioscience and Information Technologies, (2007), 193-198.
JefferyI.B., HigginsD.G. and CulhaneA.C., Comparison and evaluation of methods for generating differentially expressed gene lists from microarray data, BMC Bioinformatics7(1) (2006), 359.
31.
JolliffeI., Principal Component Analysis, Wiley Online Library, 2002.
32.
KhanJ., WeiJ.S., RingnerM., SaalL.H., LadanyiM., WestermannF., BertholdF., SchwabM., AntonescuC.R., PetersonC. et al., Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks, Nature Medicine7(6) (2001), 673-679.
33.
KohaviR. and JohnG.H., Wrappers for feature subset selection, Artificial Intelligence97(1) (1997), 273-324.
LeeJ.W., LeeJ.B., ParkM. and SongS.H., An extensive comparison of recent classification tools applied to microarray data, Computational Statistics & Data Analysis48(4) (2005), 869-885.
36.
LiW. and YangY., How many genes are needed for a discriminant microarray data analysis, in: Methods of Microarray Data Analysis, Springer, (2002), 137-149.
37.
LiaoJ. and ChinK.-V., Logistic regression for disease classification using microarray data: model selection in a large p and small n$ case, Bioinformatics23(15) (2007), 1945-1951.
38.
LinderR., RichardsT. and WagnerM., Microarray data classified by artificial neural networks, in: Microarrays, Springer (2007), 345-372.
39.
LiuB., CuiQ., JiangT. and MaS., A combinational feature selection and ensemble neural network method for classification of gene expression data, BMC Bioinformatics5(1) (2004), 136.
40.
LiuH. and SetionoR., A probabilistic approach to feature selection-a filter solution, in: ICML, Citeseer 96 (1996), 319-327.
41.
LiuX., KrishnanA. and MondryA., An entropy-based gene selection method for cancer classification using microarray data, BMC Bioinformatics6(1) (2005), 76.
42.
MaS. and HuangJ., Regularized ROC method for disease classification and biomarker selection with microarray data, Bioinformatics21(24) (2005), 4356-4362.
43.
MahmoudA.M., MaherB.A., El-HorbatyE.-S.M. and SalemA.B.M., Analysis of machine learning techniques for gene selection and classification of microarray data, in: Proc ICIT 2013 The 6th International Conference on Information Technology, (2013).
44.
MukherjeeS., Classifying microarray data using support vector machines, in: A Practical Approach to Microarray Data Analysis, BerrarD.P., DubitzkyW. and GranzowM., eds, Springer US, 2003, pp. 166-185.
45.
MukherjeeS., TamayoP., SlonimD., VerriA., GolubT., MesirovJ. and PoggioT., Support vector machine classification of microarray data, Technical report, Massachusetts Institute of Technology, 1999.
46.
NguyenD.V. and RockeD.M., Tumor classification by partial least squares using microarray gene expression data, Bioinformatics18(1) (2002), 39-50.
47.
NobleW.S. et al., Support vector machine applications in computational biology, Kernel Methods in Computational Biology (2004), 71-92.
48.
OcampoR., de LunaM.A., VegaR., Sanchez-AnteG., Falcon-MoralesL.E. and SossaH., Pattern analysis in DNA microarray data through PCA-based gene selection, in: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Bayro-CorrochanoE. and HancockE., eds, volume 8827 of Lecture Notes in Computer Science, Springer International Publishing, 2014, pp. 532-539.
49.
PiroozniaM., YangJ., YangM.Q. and DengY., A comparative study of different machine learning methods on microarray gene expression data, BMC Genomics9(1) (2008), S13.
50.
RevathiT. and SumathiP., A novel microarray gene ranking and classification using extreme learning machine algorithm, Journal of Theoretical and Applied Information Technology68(3) (2014).
51.
RuizR., RiquelmeJ.C. and Aguilar-RuizJ.S., Incremental wrapper-based gene selection from microarray data for cancer classification, Pattern Recognition39(12) (2006), 2383-2392.
52.
RyuJ. and ChoS.-B., Towards optimal feature and classifier for gene expression classification of cancer, in: Advances in Soft Computing, AFSS 2002, Springer (2002), 310-317.
53.
ShahM., MarchandM. and CorbeilJ., Feature selection with conjunctions of decision stumps and learning from microarray data, IEEE Transactions on Pattern Analysis and Machine Intelligence34(1) (2012), 174-186.
54.
ShenL. and Chong-TanE., Reducing multiclass cancer classification to binary by output coding and SVM, Computational Biology and Chemistry30(1) (2006), 63-71.
55.
SossaH. and GuevaraE., Efficient training for dendrite morphological neural networks, Neurocomputing131 (2014), 132-142.
56.
StatnikovA., AliferisC.F., TsamardinosI., HardinD. and LevyS., A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis, Bioinformatics21(5) (2005), 631-643.
57.
ThomasJ.G., OlsonJ.M., TapscottS.J. and ZhaoL.P., An efficient and robust statistical modeling approach to discover differentially expressed genes using genomic expression profiles, Genome Research11(7) (2001), 1227-1236.
58.
TongD.L. and SchierzA.C., Hybrid genetic algorithm-neural network: Feature extraction for unpreprocessed microarray data, Artificial Intelligence in Medicine53(1) (2011), 47-56.
59.
TsamardinosI. and AliferisC.F., Towards principled feature selection: Relevancy, filters and wrappers, in: Proc of the Ninth International Workshop on Artificial Intelligence and Statistics, (2003).
60.
WangY., TetkoI.V., HallM.A., FrankE., FaciusA., MayerK.F. and MewesH.W., Gene selection from microarray data for cancer classification-a machine learning approach, Computational Biology and Chemistry29(1) (2005), 37-46.
61.
XingE.P., JordanM.I., KarpR.M. et al., Feature selection for high-dimensional genomic microarray data, in: ICML, Citeseer 1 (2001), 601-608.
62.
YuH., GuG., LiuH., ShenJ. and ZhaoJ., A modified ant colony optimization algorithm for tumor marker gene selection, Genomics, Proteomics & Bioinformatics7(4) (2009), 200-208.
63.
YuH., HongS., YangX., NiJ., DanY. and QinB., Recognition of multiple imbalanced cancer types based on DNA microarray data using ensemble classifiers, BioMed Research International, (2013).
64.
ZhangH., CohenA.L., KrishnakumarS., WapnirI.L., VeeriahS., DengG., CoramM.A., PiskunC.M., LongacreT.A., HerrlerM. et al., Patient-derived xenografts of triple-negative breast cancer reproduce molecular features of patient tumors and respond to mTOR inhibition, Breast Cancer Res16(2) (2014), R36.
65.
ZhangR., HuangG.-B., SundararajanN. and SaratchandranP., Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis, IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)4(3) (2007), 485-495.
66.
ZhouX., LiuK.-Y. and WongS.T., Cancer classification and prediction using logistic regression with Bayesian gene selection, Journal of Biomedical Informatics37(4) (2004), 249-259.
