Cost-sensitive learning has become an increasingly important area that recognizes that real world classification problems need to take the costs of misclassification and accuracy into account. Much work has been done on cost-sensitive decision tree learning, but very little has been done on cost-sensitive Bayesian networks. Although there has been significant research on Bayesian networks there has been relatively little research on learning cost-sensitive Bayesian networks. Hence, this paper explores whether it is possible to develop algorithms that learn cost-sensitive Bayesian networks by taking (i) an indirect approach that changes the data distribution to reflect the costs of misclassification; and(ii) a direct approach that amends an existing accuracy based algorithm for learning Bayesian networks.An empirical comparison of the new approaches is carried out with cost-sensitive decision tree learning algorithms on 33 data sets, and the results show that the new algorithms perform better in terms of misclassification cost and maintaining accuracy.
AhmadlouM. and AdeliH., Enhanced probabilistic neural network with local decision circles: A robust classifier, Integrated Computer-Aided Engineering17(3) (2010), 197-210.
2.
AkaikeH., A new look at the statistical model identification, IEEE Transactions on Automatic Control19(6) (1974), 716-723.
3.
AsuncionA. and NewmanD.H., UCI machine learning repository, https://archive.ics.uci.edu/ml/datasets.html, (2007).
4.
BreimanL., FriedmanJ., StoneC.J. and OlshenR.A., Classification and regression trees. CRC press, 1984.
5.
ChowC.K. and LiuC.N., Approximating discrete probability distributions with dependence trees, IEEE Transactions on Information Theory4(3) (1968), 462-467.
6.
DasguptaS., Learning polytrees, In Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence (1999), pp. 134-141.
7.
DomingosP., Metacost: A general method for making classifiers cost-sensitive, In Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, (1999), pp. 155-164.
8.
DrummondC. and HolteR.C., Exploiting the cost (in) sensitivity of decision tree splitting criteria, In ICML, (2000), pp. 239-246.
9.
ElkanC., The foundations of cost-sensitive learning, International Joint Conference on Artificial Intelligence17(1) (2001), 973-978.
10.
FriedmanJ.H., Data Mining and Statistics: What's the connection?Computing Science and Statistics29(1) (1998), 3-9.
FriedmanN. and GoldszmidtM., Learning Bayesian networks with local structure, In Learning in Graphical Models, Springer Netherlands, (1998), pp. 421-459.
13.
Ghosh-DastidarS. and AdeliH., Improved spiking neural networks for EEG classification and epilepsy and seizure detection, Integrated Computer-Aided Engineering14(3) (2007), 187-212.
14.
HeckermanD., MamdaniA. and WellmanM.P., Real-world applications of Bayesian networks, Communications of the ACM 38(3) (1995), 24-26.
15.
LangleyP., IbaW. and ThompsonK., An analysis of Bayesian classifiers, In Proceedings, Tenth National Conference on Artificial Intelligence, Menlo Park, CA: AAAI Press, 90, (1992), 223-228.
16.
LingC.X. and ShengV.S., Cost-sensitive learning, In Encyclopedia of Machine Learning (2010), pp. 231-235.
17.
LingC.X., YangQ., WangJ. and ZhangS., Decision Trees with Minimal Costs, ACM International Conference Proceeding Series 21st international conference on Machine learning, Banff, Alberta, Canada, Article No. 69, ACM Press New York, NY, USA, (2004).
18.
LomaxS. and VaderaS., A survey of cost-sensitive decision tree induction algorithms, ACM Computing Surveys (CSUR)45(2) (2013), 16.
19.
MeilaM. and JordanM.I., Learning with Mixtures of Trees, Journal of Machine Learning Research (2000), 1-48.
20.
MitchellT.M., Does machine learning really work?AI magazine18(3) (1997), 11.
21.
NashnushE. and VaderaS., Cost-Sensitive Bayesian Network Learning Using Sampling, In Recent Advances on Soft Computing and Data Mining, Springer International Publishing, (2014), pp. 467-476.
PazzaniM.J., MerzC.J., MurphyP.M., AliK., HumeT. and BrunkC., Reducing Misclassification Costs, In ICML, (1994), pp. 217-225.
24.
PearlJ., Embracing Causality in Formal Reasoning, In AAAI, (1988), pp. 369-373.
25.
PhuaC., LeeV., SmithK. and GaylerR., A comprehensive survey of data mining-based fraud detection research, arXiv preprint arXiv: 1009.6119, (2010).
26.
QuinlanJ.R., Induction of decision trees, Machine Learning1(1) (1986), 81-106.
27.
RissanenJ., Modeling by shortest data description, Automatica14(5), (1978), 465-471.
28.
Santos-RodríguezR., García-GarcíaD. and Cid-SueiroJ., Cost-sensitive classification based on Bregman divergences for medical diagnosis, In Machine Learning and Applications, ICML, (2009), pp. 551-556.
29.
SchwarzG., Estimating the dimension of a model, The Annals of Statistics6(2) (1978), 461-464.
30.
ShengV.S. and LingC.X., Thresholding for making classifiers cost-sensitive, In Proceedings of the national conference on artificial intelligence. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press. 21(1) (2006), pp. 476.
31.
ShengV.S. and LingC.X., Roulette sampling for cost-sensitive learning, In Machine Learning: ECML, Springer, (2007), pp. 724-731.
32.
ThingK.M., An Instance-Weighting Method to Induce Cost-Sensitive Decision Trees, IEEE Transactions on Knowledge and Data Engineering14(3) (2002), 659-665.
33.
WittenI.H. and FrankE., Data Mining - Practical Machine Learning Tools and Techniques with Java Implementations, Morgan Kaufmann Publishers, (2005).
34.
ZadroznyB., LangfordJ. and AbeN., A simple method for cost-sensitive learning, IBM Technical Report RC22666, (2003).
35.
ZadroznyB., LangfordJ. and AbeN., Cost-sensitive learning by cost-proportionate example weighting, In Data Mining, ICDM, Third IEEE International Conference, (2003), pp. 435-442.
36.
ZhangY., ZhouG., JinJ., ZhaoQ., WangX. and CichockiA., Aggregation of sparse linear discriminant analysis for event-related potential classification in brain-computer interface, International Journal of Neural Systems24(1) (2014), 1450003.
37.
ZhangY., ZhouG., ZhaoQ., JinJ., WangX. and CichockiA., Spatial-temporal discriminant analysis for ERP-based brain-computer interface, IEEE Transactions on Neural Systems and Rehabilitation Engineering21(2) (2013), 233-243.
